Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260928 10:43:50.830730 5521 test_util.cc:268] Using random seed: -1109708205
2026-09-28T10:43:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T10:43:50Z Disabled control of system clock
I20260928 10:43:50.863267 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.126:39997
--webserver_interface=127.5.100.126
--webserver_port=0
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 10:43:51.185150 5529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:51.185451 5529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:51.185524 5529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:51.192735 5529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 10:43:51.192854 5529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:51.192895 5529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 10:43:51.192945 5529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 10:43:51.202162 5529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.126:39997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.100.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:51.203526 5529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:51.205327 5529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:51.217754 5534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:51.217690 5537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:51.217723 5535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:51.218075 5529 server_base.cc:1034] running on GCE node
I20260928 10:43:51.219249 5529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:51.220755 5529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:51.221997 5529 hybrid_clock.cc:648] HybridClock initialized: now 1790592231221935 us; error 46 us; skew 500 ppm
I20260928 10:43:51.222374 5529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:51.229455 5529 webserver.cc:460] Webserver started at http://127.5.100.126:38451/ using document root <none> and password file <none>
I20260928 10:43:51.230278 5529 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:51.230422 5529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:51.230782 5529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:51.233563 5529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/instance:
uuid: "a2eb817eda984ab99ec4704c47699846"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.234404 5529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal/instance:
uuid: "a2eb817eda984ab99ec4704c47699846"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.240024 5529 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260928 10:43:51.243795 5543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:51.245378 5529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260928 10:43:51.245565 5529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
uuid: "a2eb817eda984ab99ec4704c47699846"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.245769 5529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:51.263739 5529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:51.264622 5529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:51.264917 5529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:51.281890 5529 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.126:39997
I20260928 10:43:51.281911 5594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.126:39997 every 8 connection(s)
I20260928 10:43:51.283272 5529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
I20260928 10:43:51.286985 5595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:51.289129 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 5529
I20260928 10:43:51.289363 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal/instance
I20260928 10:43:51.291678 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.125:37939
--webserver_interface=127.5.100.125
--webserver_port=0
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 10:43:51.293193 5595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:51.315366 5595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } has no permanent_uuid. Determining permanent_uuid...
W20260928 10:43:51.316897 5544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
W20260928 10:43:51.318764 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.125:37939: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
I20260928 10:43:51.368306 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } attempt: 1
W20260928 10:43:51.370282 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.125:37939: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
I20260928 10:43:51.438583 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } attempt: 2
W20260928 10:43:51.440600 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.125:37939: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
I20260928 10:43:51.531881 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } attempt: 3
W20260928 10:43:51.533808 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.125:37939: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
W20260928 10:43:51.631052 5597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:51.631366 5597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:51.631448 5597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:51.639035 5597 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 10:43:51.639158 5597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:51.639200 5597 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 10:43:51.639276 5597 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 10:43:51.648936 5597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.125:37939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.100.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:51.650461 5597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:51.652408 5597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:51.664541 5606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:51.664565 5605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:51.664546 5608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:51.665184 5597 server_base.cc:1034] running on GCE node
I20260928 10:43:51.666101 5597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:51.667796 5597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:51.669049 5597 hybrid_clock.cc:648] HybridClock initialized: now 1790592231668986 us; error 48 us; skew 500 ppm
I20260928 10:43:51.669410 5597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:51.671880 5597 webserver.cc:460] Webserver started at http://127.5.100.125:45673/ using document root <none> and password file <none>
I20260928 10:43:51.672564 5597 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:51.672677 5597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:51.672971 5597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:51.675683 5597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/instance:
uuid: "7a1529a7b0d7479db7dabebf471795b5"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.676414 5597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal/instance:
uuid: "7a1529a7b0d7479db7dabebf471795b5"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.677071 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } attempt: 4
W20260928 10:43:51.679008 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.125:37939: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111)
I20260928 10:43:51.681946 5597 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260928 10:43:51.685279 5614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:51.686638 5597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260928 10:43:51.686791 5597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
uuid: "7a1529a7b0d7479db7dabebf471795b5"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:51.686966 5597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:51.699469 5597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:51.700323 5597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:51.700623 5597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:51.717731 5597 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.125:37939
I20260928 10:43:51.717751 5665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.125:37939 every 8 connection(s)
I20260928 10:43:51.719256 5597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
I20260928 10:43:51.719704 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 5597
I20260928 10:43:51.719846 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal/instance
I20260928 10:43:51.721139 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.124:42487
--webserver_interface=127.5.100.124
--webserver_port=0
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 10:43:51.724444 5666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:51.732596 5666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:51.748728 5666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:51.758258 5666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
W20260928 10:43:51.759303 5615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
W20260928 10:43:51.760936 5666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:51.810273 5666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 1
W20260928 10:43:51.812356 5666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:51.880625 5666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 2
W20260928 10:43:51.882500 5666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:51.973755 5666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 3
W20260928 10:43:51.975728 5666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:51.978232 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } attempt: 5
I20260928 10:43:51.984917 5595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
W20260928 10:43:51.986517 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:52.037781 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 1
W20260928 10:43:52.039841 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
W20260928 10:43:52.053865 5668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:52.054201 5668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:52.054275 5668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:52.061908 5668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 10:43:52.062041 5668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:52.062083 5668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 10:43:52.062129 5668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 10:43:52.071517 5668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.124:42487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.100.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:52.072765 5668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:52.074568 5668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:52.085866 5679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:52.085927 5676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:52.085958 5677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:52.086781 5668 server_base.cc:1034] running on GCE node
I20260928 10:43:52.087553 5668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:52.088949 5668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:52.090201 5668 hybrid_clock.cc:648] HybridClock initialized: now 1790592232090124 us; error 43 us; skew 500 ppm
I20260928 10:43:52.090595 5668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:52.092900 5668 webserver.cc:460] Webserver started at http://127.5.100.124:40223/ using document root <none> and password file <none>
I20260928 10:43:52.093585 5668 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:52.093698 5668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:52.094010 5668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:52.096711 5668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data/instance:
uuid: "0ef695111ecc46a1bc1439b0b1a282bf"
format_stamp: "Formatted at 2026-09-28 10:43:52 on dist-test-slave-wgrf"
I20260928 10:43:52.097508 5668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal/instance:
uuid: "0ef695111ecc46a1bc1439b0b1a282bf"
format_stamp: "Formatted at 2026-09-28 10:43:52 on dist-test-slave-wgrf"
I20260928 10:43:52.103180 5668 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260928 10:43:52.107169 5685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:52.108129 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 2
I20260928 10:43:52.108989 5668 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260928 10:43:52.109210 5668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal
uuid: "0ef695111ecc46a1bc1439b0b1a282bf"
format_stamp: "Formatted at 2026-09-28 10:43:52 on dist-test-slave-wgrf"
I20260928 10:43:52.109419 5668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260928 10:43:52.110126 5595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:52.118961 5666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 4
W20260928 10:43:52.120733 5666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.100.124:42487: Network error: Client connection negotiation failed: client connection to 127.5.100.124:42487: connect: Connection refused (error 111)
I20260928 10:43:52.125298 5668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:52.126168 5668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:52.126454 5668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:52.143639 5668 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.124:42487
I20260928 10:43:52.143661 5736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.124:42487 every 8 connection(s)
I20260928 10:43:52.145085 5668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/data/info.pb
I20260928 10:43:52.148741 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 5668
I20260928 10:43:52.148934 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-2/wal/instance
I20260928 10:43:52.151278 5737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:52.159595 5737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:52.177680 5737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:52.185300 5737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
I20260928 10:43:52.195470 5737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Bootstrap starting.
I20260928 10:43:52.198879 5737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:52.199954 5737 log.cc:824] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:52.202415 5737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: No bootstrap required, opened a new log
I20260928 10:43:52.210141 5737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.210709 5737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:52.210842 5737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef695111ecc46a1bc1439b0b1a282bf, State: Initialized, Role: FOLLOWER
I20260928 10:43:52.211509 5737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.212452 5745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.212778 5745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.213665 5737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: configured and running, proceeding with master startup.
I20260928 10:43:52.216368 5595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 3
W20260928 10:43:52.223510 5756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 10:43:52.223673 5756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 10:43:52.220132 5668 master_runner.cc:186] Error getting master registration for 127.5.100.126:39997: OK, instance_id { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" instance_seqno: 1790592231277023 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 10:43:52.229952 5668 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 10:43:52.233999 5595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Bootstrap starting.
I20260928 10:43:52.238639 5595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:52.239775 5595 log.cc:824] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:52.242452 5595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: No bootstrap required, opened a new log
I20260928 10:43:52.250906 5595 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.251340 5595 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:52.251498 5595 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2eb817eda984ab99ec4704c47699846, State: Initialized, Role: FOLLOWER
I20260928 10:43:52.252135 5595 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.253055 5759 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.253468 5759 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.254348 5595 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 10:43:52.264343 5745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:43:52.264793 5770 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260928 10:43:52.264708 5745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
W20260928 10:43:52.264921 5770 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 10:43:52.268108 5570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2eb817eda984ab99ec4704c47699846" is_pre_election: true
I20260928 10:43:52.268760 5570 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ef695111ecc46a1bc1439b0b1a282bf in term 0.
I20260928 10:43:52.266369 5745 leader_election.cc:288] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997), 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939)
I20260928 10:43:52.269630 5687 leader_election.cc:302] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef695111ecc46a1bc1439b0b1a282bf, a2eb817eda984ab99ec4704c47699846; no voters:
I20260928 10:43:52.270440 5745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:52.270605 5745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:52.270700 5745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:52.273794 5745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
W20260928 10:43:52.274703 5549 tablet.cc:2369] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:43:52.276032 5570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2eb817eda984ab99ec4704c47699846"
I20260928 10:43:52.276261 5570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:52.265408 5529 master_runner.cc:186] Error getting master registration for 127.5.100.125:37939: OK, instance_id { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" instance_seqno: 1790592231712925 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 10:43:52.276878 5529 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 10:43:52.277372 5745 leader_election.cc:288] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [CANDIDATE]: Term 1 election: Requested vote from peers a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997), 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939)
I20260928 10:43:52.279609 5570 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef695111ecc46a1bc1439b0b1a282bf in term 1.
I20260928 10:43:52.280043 5687 leader_election.cc:302] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef695111ecc46a1bc1439b0b1a282bf, a2eb817eda984ab99ec4704c47699846; no voters:
I20260928 10:43:52.280365 5745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:52.280987 5745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [term 1 LEADER]: Becoming Leader. State: Replica: 0ef695111ecc46a1bc1439b0b1a282bf, State: Running, Role: LEADER
I20260928 10:43:52.291025 5745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.305164 5772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef695111ecc46a1bc1439b0b1a282bf. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.305691 5772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:43:52.306710 5774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 10:43:52.308993 5774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 10:43:52.324620 5570 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Refusing update from remote peer 0ef695111ecc46a1bc1439b0b1a282bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:52.325824 5772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:52.345114 5759 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef695111ecc46a1bc1439b0b1a282bf. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.345476 5759 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.349830 5775 mvcc.cc:205] Tried to move back new op lower bound from 7334265783589576704 to 7334265783468978176. Current Snapshot: MvccSnapshot[applied={T|T < 7334265783589576704}]
I20260928 10:43:52.350744 5772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.351033 5772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:43:52.356864 5774 catalog_manager.cc:1347] Generated new cluster ID: d8fef7b33cab4615b13ae7bbac9dc27a
I20260928 10:43:52.356992 5774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 10:43:52.375895 5759 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.376252 5759 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.384938 5774 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 10:43:52.386832 5774 catalog_manager.cc:1504] Loading token signing keys...
I20260928 10:43:52.402603 5774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Generated new TSK 0
I20260928 10:43:52.403841 5774 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 10:43:52.419962 5666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } attempt: 5
I20260928 10:43:52.421940 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.100.65:0
--local_ip_for_outbound_sockets=127.5.100.65
--webserver_interface=127.5.100.65
--webserver_port=0
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 10:43:52.435343 5666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Bootstrap starting.
I20260928 10:43:52.440049 5666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:52.441665 5666 log.cc:824] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:52.451779 5666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: No bootstrap required, opened a new log
I20260928 10:43:52.464143 5666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.464696 5666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:52.464866 5666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1529a7b0d7479db7dabebf471795b5, State: Initialized, Role: FOLLOWER
I20260928 10:43:52.465786 5666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.483074 5782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.483727 5782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.484587 5666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 10:43:52.484644 5640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1529a7b0d7479db7dabebf471795b5"
I20260928 10:43:52.485199 5640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:52.488686 5640 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef695111ecc46a1bc1439b0b1a282bf in term 1.
I20260928 10:43:52.489246 5641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1529a7b0d7479db7dabebf471795b5" is_pre_election: true
I20260928 10:43:52.489603 5641 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ef695111ecc46a1bc1439b0b1a282bf in term 1. Re-sending same reply.
I20260928 10:43:52.490447 5639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Refusing update from remote peer 0ef695111ecc46a1bc1439b0b1a282bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:52.492398 5772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:52.538406 5782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef695111ecc46a1bc1439b0b1a282bf. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.538853 5782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.539270 5791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:52.546634 5791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:43:52.576028 5798 catalog_manager.cc:1259] Loaded cluster ID: d8fef7b33cab4615b13ae7bbac9dc27a
I20260928 10:43:52.576308 5798 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: loading cluster ID for follower catalog manager: success
I20260928 10:43:52.580268 5798 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: acquiring CA information for follower catalog manager: success
I20260928 10:43:52.582873 5798 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260928 10:43:52.958945 5780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:52.959261 5780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:52.959379 5780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:52.967284 5780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:52.967502 5780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.100.65
I20260928 10:43:52.977188 5780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.100.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.100.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.100.65
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:52.978556 5780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:52.980386 5780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:52.995214 5805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:52.995395 5804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:52.995921 5807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:52.995930 5791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ef695111ecc46a1bc1439b0b1a282bf)
I20260928 10:43:52.996142 5780 server_base.cc:1034] running on GCE node
I20260928 10:43:52.996197 5791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:52.997054 5780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:52.997870 5791 leader_election.cc:288] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997), 0ef695111ecc46a1bc1439b0b1a282bf (127.5.100.124:42487)
I20260928 10:43:52.998368 5570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a1529a7b0d7479db7dabebf471795b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2eb817eda984ab99ec4704c47699846" is_pre_election: true
I20260928 10:43:52.998819 5712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a1529a7b0d7479db7dabebf471795b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" is_pre_election: true
I20260928 10:43:52.999423 5780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:52.999924 5615 leader_election.cc:302] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1529a7b0d7479db7dabebf471795b5; no voters: 0ef695111ecc46a1bc1439b0b1a282bf, a2eb817eda984ab99ec4704c47699846
I20260928 10:43:53.000296 5791 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:43:53.000689 5780 hybrid_clock.cc:648] HybridClock initialized: now 1790592233000603 us; error 56 us; skew 500 ppm
I20260928 10:43:53.001032 5780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:53.003686 5780 webserver.cc:460] Webserver started at http://127.5.100.65:46053/ using document root <none> and password file <none>
I20260928 10:43:53.004474 5780 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:53.004611 5780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:53.004940 5780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:53.006827 5772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:53.007085 5772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:43:53.008893 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data/instance:
uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.009711 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/instance:
uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.015518 5780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260928 10:43:53.019366 5816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.020905 5780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260928 10:43:53.021122 5780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal
uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.021318 5780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:53.044723 5780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:53.045622 5780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:53.045933 5780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:53.046996 5780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 10:43:53.048588 5780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 10:43:53.048668 5780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.048784 5780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 10:43:53.048839 5780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.079270 5780 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.65:40035
I20260928 10:43:53.079321 5928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.65:40035 every 8 connection(s)
I20260928 10:43:53.080528 5780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/data/info.pb
I20260928 10:43:53.082561 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 5780
I20260928 10:43:53.082731 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/instance
I20260928 10:43:53.088311 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.100.66:0
--local_ip_for_outbound_sockets=127.5.100.66
--webserver_interface=127.5.100.66
--webserver_port=0
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 10:43:53.116740 5930 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:53.117122 5930 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.117244 5929 heartbeater.cc:347] Connected to a master server at 127.5.100.124:42487
I20260928 10:43:53.117362 5929 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.117551 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:43:53.117669 5931 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.118142 5929 heartbeater.cc:511] Master 127.5.100.124:42487 requested a full tablet report, sending...
I20260928 10:43:53.118189 5931 heartbeater.cc:511] Master 127.5.100.125:37939 requested a full tablet report, sending...
I20260928 10:43:53.118391 5930 heartbeater.cc:511] Master 127.5.100.126:39997 requested a full tablet report, sending...
I20260928 10:43:53.120572 5560 ts_manager.cc:194] Registered new tserver with Master: ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:53.120666 5702 ts_manager.cc:194] Registered new tserver with Master: ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:53.120646 5631 ts_manager.cc:194] Registered new tserver with Master: ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:53.122762 5702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.100.65:39775
I20260928 10:43:53.267019 5770 catalog_manager.cc:1259] Loaded cluster ID: d8fef7b33cab4615b13ae7bbac9dc27a
I20260928 10:43:53.267120 5770 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: loading cluster ID for follower catalog manager: success
I20260928 10:43:53.269587 5770 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: acquiring CA information for follower catalog manager: success
I20260928 10:43:53.271364 5770 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 10:43:53.301949 5940 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ef695111ecc46a1bc1439b0b1a282bf)
I20260928 10:43:53.302222 5940 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:43:53.303653 5940 leader_election.cc:288] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939), 0ef695111ecc46a1bc1439b0b1a282bf (127.5.100.124:42487)
I20260928 10:43:53.304252 5639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eb817eda984ab99ec4704c47699846" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a1529a7b0d7479db7dabebf471795b5" is_pre_election: true
I20260928 10:43:53.304355 5712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eb817eda984ab99ec4704c47699846" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" is_pre_election: true
I20260928 10:43:53.304983 5544 leader_election.cc:302] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2eb817eda984ab99ec4704c47699846; no voters: 0ef695111ecc46a1bc1439b0b1a282bf, 7a1529a7b0d7479db7dabebf471795b5
I20260928 10:43:53.305393 5940 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 10:43:53.435447 5937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:53.435758 5937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:53.435849 5937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:53.443239 5937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:53.443427 5937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.100.66
I20260928 10:43:53.452857 5937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.100.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.100.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.100.66
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:53.454229 5937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:53.456277 5937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:53.470273 5945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:53.470245 5946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:53.470212 5948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:53.471042 5937 server_base.cc:1034] running on GCE node
I20260928 10:43:53.471652 5937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:53.472746 5937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:53.474009 5937 hybrid_clock.cc:648] HybridClock initialized: now 1790592233473920 us; error 52 us; skew 500 ppm
I20260928 10:43:53.474329 5937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:53.476650 5937 webserver.cc:460] Webserver started at http://127.5.100.66:42261/ using document root <none> and password file <none>
I20260928 10:43:53.477321 5937 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:53.477424 5937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:53.477712 5937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:53.480358 5937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data/instance:
uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.481104 5937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/instance:
uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.486460 5937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260928 10:43:53.489917 5954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.491456 5937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260928 10:43:53.491641 5937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal
uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.491820 5937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:53.507332 5937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:53.508311 5937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:53.508621 5937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:53.509650 5937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 10:43:53.511317 5937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 10:43:53.511404 5937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.511531 5937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 10:43:53.511584 5937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.543237 5937 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.66:32919
I20260928 10:43:53.543282 6066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.66:32919 every 8 connection(s)
I20260928 10:43:53.544585 5937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/data/info.pb
I20260928 10:43:53.547253 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 5937
I20260928 10:43:53.547422 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/instance
I20260928 10:43:53.553774 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.100.67:0
--local_ip_for_outbound_sockets=127.5.100.67
--webserver_interface=127.5.100.67
--webserver_port=0
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 10:43:53.566311 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:43:53.566656 6069 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.567761 6069 heartbeater.cc:511] Master 127.5.100.125:37939 requested a full tablet report, sending...
I20260928 10:43:53.569681 5631 ts_manager.cc:194] Registered new tserver with Master: 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:53.569756 6068 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:53.569855 6068 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.570331 6068 heartbeater.cc:511] Master 127.5.100.126:39997 requested a full tablet report, sending...
I20260928 10:43:53.571316 5560 ts_manager.cc:194] Registered new tserver with Master: 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:53.571918 6067 heartbeater.cc:347] Connected to a master server at 127.5.100.124:42487
I20260928 10:43:53.572017 6067 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:53.572322 6067 heartbeater.cc:511] Master 127.5.100.124:42487 requested a full tablet report, sending...
I20260928 10:43:53.573174 5702 ts_manager.cc:194] Registered new tserver with Master: 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:53.574221 5702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.100.66:43487
I20260928 10:43:53.625873 5929 heartbeater.cc:503] Master 127.5.100.124:42487 was elected leader, sending a full tablet report...
W20260928 10:43:53.900419 6074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:53.900743 6074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:53.900856 6074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 10:43:53.908322 6074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:53.908535 6074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.100.67
I20260928 10:43:53.918758 6074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.100.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.100.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.100.67
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:53.920258 6074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:43:53.922124 6074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:43:53.935976 6079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:53.936002 6080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 10:43:53.936025 6082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:53.936813 6074 server_base.cc:1034] running on GCE node
I20260928 10:43:53.937460 6074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:53.938441 6074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:53.939692 6074 hybrid_clock.cc:648] HybridClock initialized: now 1790592233939624 us; error 50 us; skew 500 ppm
I20260928 10:43:53.939977 6074 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:53.942186 6074 webserver.cc:460] Webserver started at http://127.5.100.67:42131/ using document root <none> and password file <none>
I20260928 10:43:53.942909 6074 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:53.943022 6074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:53.943307 6074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 10:43:53.946111 6074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data/instance:
uuid: "4dab87557ec9445dbe35ea05e3561a94"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.946893 6074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/instance:
uuid: "4dab87557ec9445dbe35ea05e3561a94"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.952190 6074 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260928 10:43:53.956159 6088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.957736 6074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260928 10:43:53.957918 6074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal
uuid: "4dab87557ec9445dbe35ea05e3561a94"
format_stamp: "Formatted at 2026-09-28 10:43:53 on dist-test-slave-wgrf"
I20260928 10:43:53.958127 6074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:53.983316 6074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:53.984139 6074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:53.984457 6074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:53.985427 6074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 10:43:53.987051 6074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 10:43:53.987128 6074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:53.987244 6074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 10:43:53.987298 6074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:54.019994 6074 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.67:43661
I20260928 10:43:54.020053 6200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.67:43661 every 8 connection(s)
I20260928 10:43:54.021587 6074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/data/info.pb
I20260928 10:43:54.023195 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 6074
I20260928 10:43:54.023342 5521 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/instance
I20260928 10:43:54.039894 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:43:54.039966 6201 heartbeater.cc:347] Connected to a master server at 127.5.100.124:42487
I20260928 10:43:54.040228 6201 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:54.040232 6203 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:54.040282 6202 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:54.040414 6202 heartbeater.cc:464] Registering TS with master...
I20260928 10:43:54.041286 6201 heartbeater.cc:511] Master 127.5.100.124:42487 requested a full tablet report, sending...
I20260928 10:43:54.041314 6203 heartbeater.cc:511] Master 127.5.100.125:37939 requested a full tablet report, sending...
I20260928 10:43:54.041338 6202 heartbeater.cc:511] Master 127.5.100.126:39997 requested a full tablet report, sending...
I20260928 10:43:54.042793 5702 ts_manager.cc:194] Registered new tserver with Master: 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:54.042949 5631 ts_manager.cc:194] Registered new tserver with Master: 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:54.043110 5560 ts_manager.cc:194] Registered new tserver with Master: 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:54.043828 5702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.100.67:50395
I20260928 10:43:54.048421 5521 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 10:43:54.076561 6067 heartbeater.cc:503] Master 127.5.100.124:42487 was elected leader, sending a full tablet report...
I20260928 10:43:54.077440 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8b9d00673fe4480d9ba7ecdebe4bbd09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.079643 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b9d00673fe4480d9ba7ecdebe4bbd09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.079804 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c4175231ab5b4e73a92512cf34c07bbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.080411 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4175231ab5b4e73a92512cf34c07bbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.081149 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7d207595db5e40998a0639222018923a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.081701 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d207595db5e40998a0639222018923a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.083346 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_36c17b32d98f4fe4912537111ee5c589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.083913 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36c17b32d98f4fe4912537111ee5c589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.087006 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e38021bef5fe4f299ec0f26659a07e7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.087673 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e38021bef5fe4f299ec0f26659a07e7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.088644 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a9e47e380acd49f6b6899d45e87c4e60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.089257 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9e47e380acd49f6b6899d45e87c4e60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.090631 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0467f15d00b34fa49c4762076007a64a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.091109 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0467f15d00b34fa49c4762076007a64a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.092813 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5a934a446a0444ffbb5abbb64cdb49ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.093063 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a4faa2e31e8642de8d2efecf770ec4dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.093493 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a934a446a0444ffbb5abbb64cdb49ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:54.093684 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4faa2e31e8642de8d2efecf770ec4dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.094451 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_926e12e8c90f4df993842f8c9537f9f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.095074 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_926e12e8c90f4df993842f8c9537f9f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.170387 5521 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu pid 5529
I20260928 10:43:54.175133 5590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260928 10:43:54.188055 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_36c17b32d98f4fe4912537111ee5c589" } new_table_name: "default.Table_6e3f4789b89c428293b198f8c6f4f354" modify_external_catalogs: true
I20260928 10:43:54.192893 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b9d00673fe4480d9ba7ecdebe4bbd09" } new_table_name: "default.Table_c2d0b4f64ee04fa2ae86673337e46cad" modify_external_catalogs: true
I20260928 10:43:54.193754 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e38021bef5fe4f299ec0f26659a07e7b" } new_table_name: "default.Table_eababfe873544cceba9fecbeea0342a4" modify_external_catalogs: true
I20260928 10:43:54.194940 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a9e47e380acd49f6b6899d45e87c4e60" } new_table_name: "default.Table_5d91731b21b84051a5e0bb11ac43301b" modify_external_catalogs: true
I20260928 10:43:54.198869 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c4175231ab5b4e73a92512cf34c07bbb" } modify_external_catalogs: true
I20260928 10:43:54.199169 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c4175231ab5b4e73a92512cf34c07bbb" } modify_external_catalogs: true
I20260928 10:43:54.200835 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0467f15d00b34fa49c4762076007a64a" } new_table_name: "default.Table_f97383b0a19d4f55965d78b12989df04" modify_external_catalogs: true
I20260928 10:43:54.202466 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7d207595db5e40998a0639222018923a" } modify_external_catalogs: true
I20260928 10:43:54.202715 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7d207595db5e40998a0639222018923a" } modify_external_catalogs: true
I20260928 10:43:54.203866 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5a934a446a0444ffbb5abbb64cdb49ea" } modify_external_catalogs: true
I20260928 10:43:54.204070 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5a934a446a0444ffbb5abbb64cdb49ea" } modify_external_catalogs: true
I20260928 10:43:54.209378 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_926e12e8c90f4df993842f8c9537f9f0" } modify_external_catalogs: true
I20260928 10:43:54.209465 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a4faa2e31e8642de8d2efecf770ec4dc" } modify_external_catalogs: true
I20260928 10:43:54.209745 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a4faa2e31e8642de8d2efecf770ec4dc" } modify_external_catalogs: true
I20260928 10:43:54.209782 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_926e12e8c90f4df993842f8c9537f9f0" } modify_external_catalogs: true
W20260928 10:43:54.215998 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fabde6f461124805b216a8003023b38c has no consensus state
W20260928 10:43:54.216571 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5573b1fc93a648d291a6d1889df5c167 has no consensus state
W20260928 10:43:54.217065 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da1e674095e74b49a276c6783d47f022 has no consensus state
W20260928 10:43:54.217288 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0cf659188ff49a083f212715f8de77b has no consensus state
W20260928 10:43:54.218647 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddabd402cd040f99dcf6221c01c19af has no consensus state
I20260928 10:43:54.233229 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:54.245919 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:54.268095 5756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:54.268666 5756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1dfc37b147e442c1956550e4c7c0dbd5
W20260928 10:43:54.288431 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet da1e674095e74b49a276c6783d47f022 (table default.Table_c2d0b4f64ee04fa2ae86673337e46cad [id=add157aeb5784ac8bcc1979e47e5a630], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet da1e674095e74b49a276c6783d47f022 consensus state has no leader
I20260928 10:43:54.296510 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d4e66a9baddd47b9a2fee6ed6c21c741
I20260928 10:43:54.296717 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f77b83fd29ff4176baf37d71738a9433
I20260928 10:43:54.297541 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet fa3a40da10504c60a793672dcb7b3510
I20260928 10:43:54.307554 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.307556 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.310405 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.310741 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.314989 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 (DEFAULT_TABLE table=default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.316824 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfc37b147e442c1956550e4c7c0dbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.318732 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 (DEFAULT_TABLE table=default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.319214 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262c99c38fd84443a5d9440ec5c33d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.323010 6001 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a40da10504c60a793672dcb7b3510 (DEFAULT_TABLE table=default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.323629 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a40da10504c60a793672dcb7b3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.324035 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.324134 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.324986 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1098e4ad586f475b9f37c7e738c133ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.325685 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1098e4ad586f475b9f37c7e738c133ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.323016 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.327257 5997 tablet_service.cc:1467] Processing CreateTablet for tablet f0cf659188ff49a083f212715f8de77b (DEFAULT_TABLE table=default.Table_6e3f4789b89c428293b198f8c6f4f354 [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.327762 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cf659188ff49a083f212715f8de77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.330235 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddabd402cd040f99dcf6221c01c19af (DEFAULT_TABLE table=default.Table_f97383b0a19d4f55965d78b12989df04 [id=28c06470dcb4424282b28a9692f26039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.330466 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_010d6bc192ef407d927e04b61f5a7d2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.330789 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddabd402cd040f99dcf6221c01c19af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.331007 6002 tablet_service.cc:1467] Processing CreateTablet for tablet fabde6f461124805b216a8003023b38c (DEFAULT_TABLE table=default.Table_eababfe873544cceba9fecbeea0342a4 [id=fab19738f8114aa1b33a248981b40eaf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.331132 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_010d6bc192ef407d927e04b61f5a7d2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.331444 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fabde6f461124805b216a8003023b38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.334774 5994 tablet_service.cc:1467] Processing CreateTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 (DEFAULT_TABLE table=default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.335263 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4e66a9baddd47b9a2fee6ed6c21c741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.338738 5992 tablet_service.cc:1467] Processing CreateTablet for tablet f77b83fd29ff4176baf37d71738a9433 (DEFAULT_TABLE table=default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.339268 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77b83fd29ff4176baf37d71738a9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.342722 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 5573b1fc93a648d291a6d1889df5c167 (DEFAULT_TABLE table=default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.343212 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5573b1fc93a648d291a6d1889df5c167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.346406 5995 tablet_service.cc:1467] Processing CreateTablet for tablet da1e674095e74b49a276c6783d47f022 (DEFAULT_TABLE table=default.Table_c2d0b4f64ee04fa2ae86673337e46cad [id=add157aeb5784ac8bcc1979e47e5a630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.346966 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e674095e74b49a276c6783d47f022. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.354743 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because the tablet was not found. No further retry: Not found: Tablet not found: 1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:54.356444 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.356784 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.357093 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.358717 5858 tablet_service.cc:1467] Processing CreateTablet for tablet f0cf659188ff49a083f212715f8de77b (DEFAULT_TABLE table=default.Table_6e3f4789b89c428293b198f8c6f4f354 [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.360378 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddabd402cd040f99dcf6221c01c19af (DEFAULT_TABLE table=default.Table_f97383b0a19d4f55965d78b12989df04 [id=28c06470dcb4424282b28a9692f26039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.361280 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddabd402cd040f99dcf6221c01c19af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.358351 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 (DEFAULT_TABLE table=default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.363202 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262c99c38fd84443a5d9440ec5c33d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.366685 5855 tablet_service.cc:1467] Processing CreateTablet for tablet fabde6f461124805b216a8003023b38c (DEFAULT_TABLE table=default.Table_eababfe873544cceba9fecbeea0342a4 [id=fab19738f8114aa1b33a248981b40eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.367174 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fabde6f461124805b216a8003023b38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.309495 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.362282 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.364415 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.363643 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.362543 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.363152 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.310557 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.369021 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 (DEFAULT_TABLE table=default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.369612 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfc37b147e442c1956550e4c7c0dbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.362748 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 5573b1fc93a648d291a6d1889df5c167 (DEFAULT_TABLE table=default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.358834 5859 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a40da10504c60a793672dcb7b3510 (DEFAULT_TABLE table=default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.370800 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5573b1fc93a648d291a6d1889df5c167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.375059 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.367295 6129 tablet_service.cc:1467] Processing CreateTablet for tablet f0cf659188ff49a083f212715f8de77b (DEFAULT_TABLE table=default.Table_6e3f4789b89c428293b198f8c6f4f354 [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.377058 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cf659188ff49a083f212715f8de77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.367367 6127 tablet_service.cc:1467] Processing CreateTablet for tablet da1e674095e74b49a276c6783d47f022 (DEFAULT_TABLE table=default.Table_c2d0b4f64ee04fa2ae86673337e46cad [id=add157aeb5784ac8bcc1979e47e5a630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.379635 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7dd5cf3395ac42e695a8d6e296b714d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.379920 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e674095e74b49a276c6783d47f022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.379710 5856 tablet_service.cc:1467] Processing CreateTablet for tablet da1e674095e74b49a276c6783d47f022 (DEFAULT_TABLE table=default.Table_c2d0b4f64ee04fa2ae86673337e46cad [id=add157aeb5784ac8bcc1979e47e5a630]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.380282 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dd5cf3395ac42e695a8d6e296b714d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.380458 5852 tablet_service.cc:1467] Processing CreateTablet for tablet f77b83fd29ff4176baf37d71738a9433 (DEFAULT_TABLE table=default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.380712 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cf659188ff49a083f212715f8de77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.381603 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a40da10504c60a793672dcb7b3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.381695 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_98456711c31840d696f42f81c5e84139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.382237 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98456711c31840d696f42f81c5e84139 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.367446 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 (DEFAULT_TABLE table=default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.383283 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262c99c38fd84443a5d9440ec5c33d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.383666 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_80a60603440f492da273b0278ecaae0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.384124 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80a60603440f492da273b0278ecaae0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.385929 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77b83fd29ff4176baf37d71738a9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.368676 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddabd402cd040f99dcf6221c01c19af (DEFAULT_TABLE table=default.Table_f97383b0a19d4f55965d78b12989df04 [id=28c06470dcb4424282b28a9692f26039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.386549 5854 tablet_service.cc:1467] Processing CreateTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 (DEFAULT_TABLE table=default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.386920 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddabd402cd040f99dcf6221c01c19af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.387121 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4e66a9baddd47b9a2fee6ed6c21c741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.387593 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_253d19ff130b4d7a9e2d555cb7649868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.387876 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1e674095e74b49a276c6783d47f022. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.388059 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_253d19ff130b4d7a9e2d555cb7649868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.389410 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e4bcae3f092b4df78e04a2e940b69a05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.389587 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 5573b1fc93a648d291a6d1889df5c167 (DEFAULT_TABLE table=default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.390013 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5573b1fc93a648d291a6d1889df5c167. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.390340 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4bcae3f092b4df78e04a2e940b69a05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.368842 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 47b0cbf795354e869721f90b37c2e4dd (DEFAULT_TABLE table=default.Table_010d6bc192ef407d927e04b61f5a7d2f [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.390952 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b0cbf795354e869721f90b37c2e4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.392621 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_80ef988f3a724028854fa4a167dd5f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.393021 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80ef988f3a724028854fa4a167dd5f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.369048 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f77b83fd29ff4176baf37d71738a9433 (DEFAULT_TABLE table=default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.394093 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77b83fd29ff4176baf37d71738a9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.390542 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.390430 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.368602 6130 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a40da10504c60a793672dcb7b3510 (DEFAULT_TABLE table=default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.397498 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a40da10504c60a793672dcb7b3510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.369105 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 (DEFAULT_TABLE table=default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.399492 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfc37b147e442c1956550e4c7c0dbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.399698 6271 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.400938 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 47b0cbf795354e869721f90b37c2e4dd (DEFAULT_TABLE table=default.Table_010d6bc192ef407d927e04b61f5a7d2f [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.401407 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b0cbf795354e869721f90b37c2e4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.369161 6125 tablet_service.cc:1467] Processing CreateTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 (DEFAULT_TABLE table=default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.402715 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4e66a9baddd47b9a2fee6ed6c21c741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.403342 6271 tablet_bootstrap.cc:654] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.405190 6271 log.cc:824] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:54.368988 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3148ce7d224b1c93fac811577beebf (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.406553 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3148ce7d224b1c93fac811577beebf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.423471 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because the tablet was not found. No further retry: Not found: Tablet not found: 1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:54.423710 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5e6bb9e200964e02a016ade01c96e5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.423974 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e4bcae3f092b4df78e04a2e940b69a05" } new_table_name: "default.Table_9372c7de9ede44248c53d6de2cb2125b" modify_external_catalogs: true
W20260928 10:43:54.424362 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e6bb9e200964e02a016ade01c96e5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.424552 6126 tablet_service.cc:1467] Processing CreateTablet for tablet fabde6f461124805b216a8003023b38c (DEFAULT_TABLE table=default.Table_eababfe873544cceba9fecbeea0342a4 [id=fab19738f8114aa1b33a248981b40eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.425053 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fabde6f461124805b216a8003023b38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.425593 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6e3f4789b89c428293b198f8c6f4f354" } new_table_name: "default.Table_e7636309bdaf45918561f2d8b59f434b" modify_external_catalogs: true
I20260928 10:43:54.425784 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f97383b0a19d4f55965d78b12989df04" } new_table_name: "default.Table_d0601ca0581042588ec7ddc232902ca5" modify_external_catalogs: true
I20260928 10:43:54.426705 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_010d6bc192ef407d927e04b61f5a7d2f" } new_table_name: "default.Table_078f2e9b9fff423ca3d37fc58a0169a8" modify_external_catalogs: true
I20260928 10:43:54.427809 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_887b7b8b4db941078430be23306434aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.428377 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_887b7b8b4db941078430be23306434aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.429508 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c2d0b4f64ee04fa2ae86673337e46cad" } new_table_name: "default.Table_f3a8de38e6724611959147a8c3b8d29b" modify_external_catalogs: true
W20260928 10:43:54.431026 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because the tablet was not found. No further retry: Not found: Tablet not found: 262c99c38fd84443a5d9440ec5c33d07
W20260928 10:43:54.431269 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because the tablet was not found. No further retry: Not found: Tablet not found: 262c99c38fd84443a5d9440ec5c33d07
W20260928 10:43:54.431442 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because the tablet was not found. No further retry: Not found: Tablet not found: 1dfc37b147e442c1956550e4c7c0dbd5
W20260928 10:43:54.431615 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f77b83fd29ff4176baf37d71738a9433 because the tablet was not found. No further retry: Not found: Tablet not found: f77b83fd29ff4176baf37d71738a9433
W20260928 10:43:54.431777 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet fa3a40da10504c60a793672dcb7b3510 because the tablet was not found. No further retry: Not found: Tablet not found: fa3a40da10504c60a793672dcb7b3510
W20260928 10:43:54.432091 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d4e66a9baddd47b9a2fee6ed6c21c741 because the tablet was not found. No further retry: Not found: Tablet not found: d4e66a9baddd47b9a2fee6ed6c21c741
W20260928 10:43:54.438418 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because the tablet was not found. No further retry: Not found: Tablet not found: 262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:54.438719 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3148ce7d224b1c93fac811577beebf (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.439155 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3148ce7d224b1c93fac811577beebf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.439178 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because the tablet was not found. No further retry: Not found: Tablet not found: 262c99c38fd84443a5d9440ec5c33d07
W20260928 10:43:54.440111 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d4e66a9baddd47b9a2fee6ed6c21c741 because the tablet was not found. No further retry: Not found: Tablet not found: d4e66a9baddd47b9a2fee6ed6c21c741
W20260928 10:43:54.441208 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f77b83fd29ff4176baf37d71738a9433 because the tablet was not found. No further retry: Not found: Tablet not found: f77b83fd29ff4176baf37d71738a9433
I20260928 10:43:54.441210 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3148ce7d224b1c93fac811577beebf (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.441414 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfc37b147e442c1956550e4c7c0dbd5 already in progress: creating tablet
I20260928 10:43:54.441624 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3148ce7d224b1c93fac811577beebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.442762 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_253d19ff130b4d7a9e2d555cb7649868" } modify_external_catalogs: true
I20260928 10:43:54.442965 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_253d19ff130b4d7a9e2d555cb7649868" } modify_external_catalogs: true
I20260928 10:43:54.448735 6273 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:54.453337 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de8537be5ea14223900fbc30ec773c03 has no consensus state
I20260928 10:43:54.474710 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.476213 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 47b0cbf795354e869721f90b37c2e4dd (DEFAULT_TABLE table=default.Table_010d6bc192ef407d927e04b61f5a7d2f [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.477597 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet fa3a40da10504c60a793672dcb7b3510 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa3a40da10504c60a793672dcb7b3510 already in progress: creating tablet
I20260928 10:43:54.478366 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b0cbf795354e869721f90b37c2e4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.481740 6273 tablet_bootstrap.cc:654] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.485924 6273 log.cc:824] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:54.490232 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet f77b83fd29ff4176baf37d71738a9433 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.490680 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d3148ce7d224b1c93fac811577beebf from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.492384 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7dd5cf3395ac42e695a8d6e296b714d2" } modify_external_catalogs: true
I20260928 10:43:54.492627 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7dd5cf3395ac42e695a8d6e296b714d2" } modify_external_catalogs: true
I20260928 10:43:54.494591 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 47b0cbf795354e869721f90b37c2e4dd from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.506337 6273 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.506299 6275 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.506685 6273 ts_tablet_manager.cc:1397] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.058s user 0.009s sys 0.007s
I20260928 10:43:54.507913 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d3148ce7d224b1c93fac811577beebf from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:54.510458 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0cf659188ff49a083f212715f8de77b consensus state has no leader
I20260928 10:43:54.510852 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet f0cf659188ff49a083f212715f8de77b from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:54.512135 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfc37b147e442c1956550e4c7c0dbd5 already in progress: creating tablet
W20260928 10:43:54.513460 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddabd402cd040f99dcf6221c01c19af consensus state has no leader
W20260928 10:43:54.513944 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d4e66a9baddd47b9a2fee6ed6c21c741 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4e66a9baddd47b9a2fee6ed6c21c741 already in progress: creating tablet
W20260928 10:43:54.514622 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 262c99c38fd84443a5d9440ec5c33d07 already in progress: creating tablet
W20260928 10:43:54.515164 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f77b83fd29ff4176baf37d71738a9433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f77b83fd29ff4176baf37d71738a9433 already in progress: creating tablet
W20260928 10:43:54.515743 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 262c99c38fd84443a5d9440ec5c33d07 already in progress: creating tablet
W20260928 10:43:54.515981 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47b0cbf795354e869721f90b37c2e4dd consensus state has no leader
W20260928 10:43:54.516287 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fa3a40da10504c60a793672dcb7b3510 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa3a40da10504c60a793672dcb7b3510 already in progress: creating tablet
W20260928 10:43:54.516849 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfc37b147e442c1956550e4c7c0dbd5 already in progress: creating tablet
I20260928 10:43:54.517444 6275 tablet_bootstrap.cc:654] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.517402 6273 raft_consensus.cc:348] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.517880 6273 raft_consensus.cc:374] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.517979 6273 raft_consensus.cc:729] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.518920 6275 log.cc:824] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:54.519307 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9372c7de9ede44248c53d6de2cb2125b" } modify_external_catalogs: true
I20260928 10:43:54.519557 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9372c7de9ede44248c53d6de2cb2125b" } modify_external_catalogs: true
I20260928 10:43:54.519999 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d91731b21b84051a5e0bb11ac43301b" } modify_external_catalogs: true
I20260928 10:43:54.520180 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d91731b21b84051a5e0bb11ac43301b" } modify_external_catalogs: true
I20260928 10:43:54.522301 6271 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.522660 6271 ts_tablet_manager.cc:1397] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.123s user 0.037s sys 0.074s
I20260928 10:43:54.526201 6273 consensus_queue.cc:260] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:54.529019 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da1e674095e74b49a276c6783d47f022 consensus state has no leader
I20260928 10:43:54.530194 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_80a60603440f492da273b0278ecaae0c" } modify_external_catalogs: true
I20260928 10:43:54.530442 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_80a60603440f492da273b0278ecaae0c" } modify_external_catalogs: true
I20260928 10:43:54.533150 6271 raft_consensus.cc:348] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.533631 6271 raft_consensus.cc:374] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.533725 6271 raft_consensus.cc:729] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.534407 6271 consensus_queue.cc:260] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.535769 6275 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:54.537729 5701 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet df640d6c9c2140e2809f5268fb8f7602
I20260928 10:43:54.540061 5696 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet c84cdc647449455e89629801303b4d0f
I20260928 10:43:54.542647 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 47b0cbf795354e869721f90b37c2e4dd
I20260928 10:43:54.543205 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 47b0cbf795354e869721f90b37c2e4dd deleted and replaced by tablet e36c690a640541e5ba33b67914656bbc
I20260928 10:43:54.544497 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.547101 6273 ts_tablet_manager.cc:1428] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.040s user 0.016s sys 0.000s
I20260928 10:43:54.547482 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:54.548478 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 47b0cbf795354e869721f90b37c2e4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0cbf795354e869721f90b37c2e4dd already in progress: creating tablet
W20260928 10:43:54.551697 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 47b0cbf795354e869721f90b37c2e4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0cbf795354e869721f90b37c2e4dd already in progress: creating tablet
I20260928 10:43:54.551828 6273 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.553550 6273 tablet_bootstrap.cc:654] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.554258 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4d3148ce7d224b1c93fac811577beebf
I20260928 10:43:54.554773 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 4d3148ce7d224b1c93fac811577beebf deleted and replaced by tablet f1f8e172c5bf406196574895e5e5e3c7
I20260928 10:43:54.556113 6271 ts_tablet_manager.cc:1428] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.033s user 0.012s sys 0.018s
I20260928 10:43:54.556098 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.556578 6271 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.557268 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:54.557956 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4d3148ce7d224b1c93fac811577beebf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3148ce7d224b1c93fac811577beebf already in progress: creating tablet
I20260928 10:43:54.558331 6271 tablet_bootstrap.cc:654] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:54.559222 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4d3148ce7d224b1c93fac811577beebf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3148ce7d224b1c93fac811577beebf already in progress: creating tablet
I20260928 10:43:54.560109 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f0cf659188ff49a083f212715f8de77b
I20260928 10:43:54.560524 5700 catalog_manager.cc:6565] ReplaceTablet: tablet f0cf659188ff49a083f212715f8de77b deleted and replaced by tablet 345245f9349a4031af5ff278a3da74f0
I20260928 10:43:54.561208 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.561316 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:54.562039 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f0cf659188ff49a083f212715f8de77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0cf659188ff49a083f212715f8de77b already in progress: creating tablet
W20260928 10:43:54.563001 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f0cf659188ff49a083f212715f8de77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0cf659188ff49a083f212715f8de77b already in progress: creating tablet
I20260928 10:43:54.565809 5695 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet de8537be5ea14223900fbc30ec773c03
I20260928 10:43:54.567643 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5573b1fc93a648d291a6d1889df5c167
I20260928 10:43:54.567991 5693 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet c201312b39994863a89d23dd92ee8e07
I20260928 10:43:54.568799 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.569204 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:54.569626 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5573b1fc93a648d291a6d1889df5c167 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5573b1fc93a648d291a6d1889df5c167 already in progress: creating tablet
W20260928 10:43:54.570674 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5573b1fc93a648d291a6d1889df5c167 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5573b1fc93a648d291a6d1889df5c167 already in progress: creating tablet
I20260928 10:43:54.571158 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_12f80400bdcb45c3af8e75a257a68f5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.571712 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12f80400bdcb45c3af8e75a257a68f5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.572831 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.573307 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.576686 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.576987 6270 tablet_replica.cc:330] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:54.577459 6270 raft_consensus.cc:2229] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.577903 6270 raft_consensus.cc:2258] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.579710 6270 ts_tablet_manager.cc:1905] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.545975 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.546538 6201 heartbeater.cc:503] Master 127.5.100.124:42487 was elected leader, sending a full tablet report...
W20260928 10:43:54.586375 5932 tablet.cc:2369] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:43:54.556180 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.562685 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.570272 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.587792 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet fabde6f461124805b216a8003023b38c (table default.Table_eababfe873544cceba9fecbeea0342a4 [id=fab19738f8114aa1b33a248981b40eaf]). Expected version 1 got 0
W20260928 10:43:54.588083 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 47b0cbf795354e869721f90b37c2e4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0cbf795354e869721f90b37c2e4dd already in progress: creating tablet
I20260928 10:43:54.588007 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 8738830fc8f8439fa60f561db9ce31d7 (DEFAULT_TABLE table=default.Table_80ef988f3a724028854fa4a167dd5f99 [id=6ad79f7a30a6466c9d2274314036a16f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.588352 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4d3148ce7d224b1c93fac811577beebf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3148ce7d224b1c93fac811577beebf already in progress: creating tablet
I20260928 10:43:54.588402 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8738830fc8f8439fa60f561db9ce31d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.588707 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f0cf659188ff49a083f212715f8de77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0cf659188ff49a083f212715f8de77b already in progress: creating tablet
W20260928 10:43:54.588975 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5573b1fc93a648d291a6d1889df5c167 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5573b1fc93a648d291a6d1889df5c167 already in progress: creating tablet
I20260928 10:43:54.589663 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 8738830fc8f8439fa60f561db9ce31d7 (DEFAULT_TABLE table=default.Table_80ef988f3a724028854fa4a167dd5f99 [id=6ad79f7a30a6466c9d2274314036a16f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.590081 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8738830fc8f8439fa60f561db9ce31d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.591146 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.591490 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8276c29e44b54fc78844e3ef1e2e828f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.594051 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.594560 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8276c29e44b54fc78844e3ef1e2e828f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.606032 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_29808fa3a9bd4528bca3a52d8bb08044"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.606855 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29808fa3a9bd4528bca3a52d8bb08044 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.609058 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e63aba8119994181a248e26edd0b1690"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.609586 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63aba8119994181a248e26edd0b1690 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.610550 6275 ts_tablet_manager.cc:1397] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.002s
I20260928 10:43:54.618216 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet fabde6f461124805b216a8003023b38c (table default.Table_eababfe873544cceba9fecbeea0342a4 [id=fab19738f8114aa1b33a248981b40eaf]). Expected version 1 got 0
I20260928 10:43:54.619341 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e (DEFAULT_TABLE table=default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.619813 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5fc914143e40cebf6603bbc1b3195e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.623278 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 345245f9349a4031af5ff278a3da74f0 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.623356 6132 tablet_service.cc:1467] Processing CreateTablet for tablet e36c690a640541e5ba33b67914656bbc (DEFAULT_TABLE table=default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.623708 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 345245f9349a4031af5ff278a3da74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.623772 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e36c690a640541e5ba33b67914656bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.626820 5853 tablet_service.cc:1467] Processing CreateTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.626820 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 345245f9349a4031af5ff278a3da74f0 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.627210 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f8e172c5bf406196574895e5e5e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.627239 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 345245f9349a4031af5ff278a3da74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.630515 6124 tablet_service.cc:1467] Processing CreateTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.630926 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f8e172c5bf406196574895e5e5e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.618470 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_d0601ca0581042588ec7ddc232902ca5 [id=28c06470dcb4424282b28a9692f26039]). Expected version 2 got 0
I20260928 10:43:54.631250 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]). Expected version 2 got 0
I20260928 10:43:54.635035 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.635577 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b90530f95ed4b73a57dedd4814f0236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.636129 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.636468 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.636680 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.636880 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.637099 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.637287 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.637472 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.637650 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.637818 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.639088 5521 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu with pid 5529
I20260928 10:43:54.639423 5860 tablet_service.cc:1467] Processing CreateTablet for tablet e36c690a640541e5ba33b67914656bbc (DEFAULT_TABLE table=default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.639839 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e36c690a640541e5ba33b67914656bbc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.648276 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f0cf659188ff49a083f212715f8de77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0cf659188ff49a083f212715f8de77b already in progress: creating tablet
I20260928 10:43:54.648890 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.651348 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5573b1fc93a648d291a6d1889df5c167 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5573b1fc93a648d291a6d1889df5c167 already in progress: creating tablet
W20260928 10:43:54.651633 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1dfc37b147e442c1956550e4c7c0dbd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfc37b147e442c1956550e4c7c0dbd5 already in progress: creating tablet
W20260928 10:43:54.651849 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f77b83fd29ff4176baf37d71738a9433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f77b83fd29ff4176baf37d71738a9433 already in progress: creating tablet
W20260928 10:43:54.652042 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fa3a40da10504c60a793672dcb7b3510 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa3a40da10504c60a793672dcb7b3510 already in progress: creating tablet
W20260928 10:43:54.652225 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 262c99c38fd84443a5d9440ec5c33d07 already in progress: creating tablet
W20260928 10:43:54.652374 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 47b0cbf795354e869721f90b37c2e4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0cbf795354e869721f90b37c2e4dd already in progress: creating tablet
W20260928 10:43:54.652526 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d4e66a9baddd47b9a2fee6ed6c21c741 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4e66a9baddd47b9a2fee6ed6c21c741 already in progress: creating tablet
W20260928 10:43:54.652717 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4d3148ce7d224b1c93fac811577beebf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3148ce7d224b1c93fac811577beebf already in progress: creating tablet
I20260928 10:43:54.652786 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b90530f95ed4b73a57dedd4814f0236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.654240 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_367b1884fe55426cab766c1ba5eef7de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.654157 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.654867 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_367b1884fe55426cab766c1ba5eef7de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:54.654944 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.658033 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0142f232a18d4ab68212ed932a55051c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.658665 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0142f232a18d4ab68212ed932a55051c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.654874 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_846bdb09abb244c0a6613e189f3c139d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.660344 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_846bdb09abb244c0a6613e189f3c139d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.663203 6273 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.663363 6273 ts_tablet_manager.cc:1397] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.112s user 0.022s sys 0.029s
I20260928 10:43:54.664491 6273 raft_consensus.cc:348] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.664733 6273 raft_consensus.cc:374] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.664824 6273 raft_consensus.cc:729] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.665297 6275 raft_consensus.cc:348] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.665841 6275 raft_consensus.cc:374] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.665964 6275 raft_consensus.cc:729] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.666975 6275 consensus_queue.cc:260] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.668741 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eababfe873544cceba9fecbeea0342a4" } new_table_name: "default.Table_81f66da1b0cf40238e750885aa4be575" modify_external_catalogs: true
I20260928 10:43:54.668959 6275 ts_tablet_manager.cc:1428] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.058s user 0.007s sys 0.006s
I20260928 10:43:54.669349 6275 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.670881 6275 tablet_bootstrap.cc:654] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.675751 6273 consensus_queue.cc:260] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.677511 6273 ts_tablet_manager.cc:1428] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260928 10:43:54.677784 6273 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.680133 6273 tablet_bootstrap.cc:654] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.681509 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.681784 6269 tablet_replica.cc:330] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:54.681919 5992 tablet_service.cc:1467] Processing CreateTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 (DEFAULT_TABLE table=default.Table_1098e4ad586f475b9f37c7e738c133ca [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.682144 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e (DEFAULT_TABLE table=default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.682317 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f8e172c5bf406196574895e5e5e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.682305 6269 raft_consensus.cc:2229] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.682497 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5fc914143e40cebf6603bbc1b3195e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.682746 6269 raft_consensus.cc:2258] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.684441 6269 ts_tablet_manager.cc:1905] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:54.684597 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fabde6f461124805b216a8003023b38c consensus state has no leader
I20260928 10:43:54.686970 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 345245f9349a4031af5ff278a3da74f0 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.687533 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e (DEFAULT_TABLE table=default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.689024 5994 tablet_service.cc:1467] Processing CreateTablet for tablet e36c690a640541e5ba33b67914656bbc (DEFAULT_TABLE table=default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.689949 5854 tablet_service.cc:1467] Processing CreateTablet for tablet fb061a69c1ea4464a1db06c8a20999ab (DEFAULT_TABLE table=default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9 [id=5131911d0ab54413ba5545cdd938f939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.690225 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.690325 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb061a69c1ea4464a1db06c8a20999ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.690606 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 345245f9349a4031af5ff278a3da74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.692054 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 8738830fc8f8439fa60f561db9ce31d7 (DEFAULT_TABLE table=default.Table_80ef988f3a724028854fa4a167dd5f99 [id=6ad79f7a30a6466c9d2274314036a16f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.694864 6136 tablet_service.cc:1467] Processing CreateTablet for tablet fb061a69c1ea4464a1db06c8a20999ab (DEFAULT_TABLE table=default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9 [id=5131911d0ab54413ba5545cdd938f939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.695354 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb061a69c1ea4464a1db06c8a20999ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.695336 5995 tablet_service.cc:1467] Processing CreateTablet for tablet fb061a69c1ea4464a1db06c8a20999ab (DEFAULT_TABLE table=default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9 [id=5131911d0ab54413ba5545cdd938f939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.696676 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.698599 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e36c690a640541e5ba33b67914656bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.698634 6271 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.698796 6271 ts_tablet_manager.cc:1397] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.142s user 0.017s sys 0.013s
I20260928 10:43:54.699891 6271 raft_consensus.cc:348] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.700127 6271 raft_consensus.cc:374] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.700215 6271 raft_consensus.cc:729] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.700475 6271 consensus_queue.cc:260] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.701013 6271 ts_tablet_manager.cc:1428] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:54.701346 6271 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.701826 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet f0cf659188ff49a083f212715f8de77b from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.702632 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8738830fc8f8439fa60f561db9ce31d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.707317 6269 ts_tablet_manager.cc:1918] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.707535 6269 log.cc:1196] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f0cf659188ff49a083f212715f8de77b
I20260928 10:43:54.707711 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb061a69c1ea4464a1db06c8a20999ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.707969 6269 ts_tablet_manager.cc:1939] T f0cf659188ff49a083f212715f8de77b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:54.707983 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5fc914143e40cebf6603bbc1b3195e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.708510 6271 tablet_bootstrap.cc:654] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.709720 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f0cf659188ff49a083f212715f8de77b (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:54.710278 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b90530f95ed4b73a57dedd4814f0236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.712801 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a933de31039460087d79d408857cc58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.713275 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_367b1884fe55426cab766c1ba5eef7de" } new_table_name: "default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2" modify_external_catalogs: true
W20260928 10:43:54.713721 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a933de31039460087d79d408857cc58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.715240 6275 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:54.715411 6275 ts_tablet_manager.cc:1397] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.006s
I20260928 10:43:54.715730 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_12f80400bdcb45c3af8e75a257a68f5e" } new_table_name: "default.Table_67cf9eac75a94f95a5dc8a009d27f6b3" modify_external_catalogs: true
I20260928 10:43:54.716471 6275 raft_consensus.cc:348] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.716697 6275 raft_consensus.cc:374] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.716782 6275 raft_consensus.cc:729] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.718681 6273 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.718736 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d0601ca0581042588ec7ddc232902ca5" } new_table_name: "default.Table_c7c975924ff54bd496add9760afaa6d8" modify_external_catalogs: true
I20260928 10:43:54.718967 6273 ts_tablet_manager.cc:1397] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260928 10:43:54.719800 6273 raft_consensus.cc:348] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:54.720100 6273 raft_consensus.cc:374] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.720216 6273 raft_consensus.cc:729] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.720562 6273 consensus_queue.cc:260] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:54.720945 6090 connection.cc:535] client connection to 127.5.100.126:39997 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 10:43:54.721596 6202 heartbeater.cc:644] Failed to heartbeat to 127.5.100.126:39997 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 10:43:54.722766 6273 ts_tablet_manager.cc:1428] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:54.723230 6273 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.723869 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8276c29e44b54fc78844e3ef1e2e828f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.728345 5930 heartbeater.cc:644] Failed to heartbeat to 127.5.100.126:39997 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.5.100.126:39997 (error 108)
I20260928 10:43:54.728605 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]). Expected version 2 got 0
I20260928 10:43:54.729177 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1184af35f5874ebcb03cf04c2291fa78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.729362 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet fabde6f461124805b216a8003023b38c (table default.Table_81f66da1b0cf40238e750885aa4be575 [id=fab19738f8114aa1b33a248981b40eaf]). Expected version 2 got 0
W20260928 10:43:54.729779 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1184af35f5874ebcb03cf04c2291fa78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:54.730407 5687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.100.126:39997 (error 108)
I20260928 10:43:54.732060 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 (DEFAULT_TABLE table=default.Table_0142f232a18d4ab68212ed932a55051c [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.732524 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6064f370434acb8fc02fda5b50ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.732595 6127 tablet_service.cc:1467] Processing CreateTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce (DEFAULT_TABLE table=default.Table_e63aba8119994181a248e26edd0b1690 [id=1d308dc2d8524d118ad5638a6dd12ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.732970 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a392670fdb5a4d4097c7edaf8f6642ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.733121 6002 tablet_service.cc:1467] Processing CreateTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce (DEFAULT_TABLE table=default.Table_e63aba8119994181a248e26edd0b1690 [id=1d308dc2d8524d118ad5638a6dd12ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.734786 6132 tablet_service.cc:1467] Processing CreateTablet for tablet f4064e4b82ce49a19849a550cc252976 (DEFAULT_TABLE table=default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.735150 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4064e4b82ce49a19849a550cc252976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.735313 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 72ace49431a24469bef73c596af089ae (DEFAULT_TABLE table=default.Table_12f80400bdcb45c3af8e75a257a68f5e [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.735662 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72ace49431a24469bef73c596af089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.739116 6133 tablet_service.cc:1467] Processing CreateTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 (DEFAULT_TABLE table=default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.739531 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f23ddb4368451d8c555e6e8dc52151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.742816 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 (DEFAULT_TABLE table=default.Table_367b1884fe55426cab766c1ba5eef7de [id=cd929aef5d0d45c5abd5c3c7a62e050c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.742893 6136 tablet_service.cc:1467] Processing CreateTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (DEFAULT_TABLE table=default.Table_846bdb09abb244c0a6613e189f3c139d [id=8e77f8894ad940afacf970068a7872b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.743264 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a89b64e0a7b43b589e7caf911836fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.743527 5860 tablet_service.cc:1467] Processing CreateTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (DEFAULT_TABLE table=default.Table_846bdb09abb244c0a6613e189f3c139d [id=8e77f8894ad940afacf970068a7872b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.743911 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.746852 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 (DEFAULT_TABLE table=default.Table_0142f232a18d4ab68212ed932a55051c [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.747283 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6064f370434acb8fc02fda5b50ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.747866 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a392670fdb5a4d4097c7edaf8f6642ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.747956 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b" } modify_external_catalogs: true
I20260928 10:43:54.748178 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5e6bb9e200964e02a016ade01c96e5ea" } modify_external_catalogs: true
I20260928 10:43:54.748250 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 72ace49431a24469bef73c596af089ae (DEFAULT_TABLE table=default.Table_12f80400bdcb45c3af8e75a257a68f5e [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.748373 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5e6bb9e200964e02a016ade01c96e5ea" } modify_external_catalogs: true
I20260928 10:43:54.748651 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72ace49431a24469bef73c596af089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.750209 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]). Expected version 2 got 0
I20260928 10:43:54.750829 5856 tablet_service.cc:1467] Processing CreateTablet for tablet f4064e4b82ce49a19849a550cc252976 (DEFAULT_TABLE table=default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.751276 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4064e4b82ce49a19849a550cc252976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.748183 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b" } modify_external_catalogs: true
I20260928 10:43:54.754812 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e63aba8119994181a248e26edd0b1690" } new_table_name: "default.Table_c0e8a69f307b48c1aaf3301e73250841" modify_external_catalogs: true
I20260928 10:43:54.754899 5999 tablet_service.cc:1467] Processing CreateTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 (DEFAULT_TABLE table=default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.754932 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 72ace49431a24469bef73c596af089ae (DEFAULT_TABLE table=default.Table_12f80400bdcb45c3af8e75a257a68f5e [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.755355 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72ace49431a24469bef73c596af089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.756618 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f23ddb4368451d8c555e6e8dc52151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.758844 5852 tablet_service.cc:1467] Processing CreateTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 (DEFAULT_TABLE table=default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.759255 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1f23ddb4368451d8c555e6e8dc52151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.760084 6273 tablet_bootstrap.cc:654] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.760052 5998 tablet_service.cc:1467] Processing CreateTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (DEFAULT_TABLE table=default.Table_846bdb09abb244c0a6613e189f3c139d [id=8e77f8894ad940afacf970068a7872b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.760459 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.762535 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 (DEFAULT_TABLE table=default.Table_367b1884fe55426cab766c1ba5eef7de [id=cd929aef5d0d45c5abd5c3c7a62e050c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.762938 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a89b64e0a7b43b589e7caf911836fb2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.764119 6068 heartbeater.cc:644] Failed to heartbeat to 127.5.100.126:39997 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.5.100.126:39997 (error 108)
I20260928 10:43:54.764837 6270 ts_tablet_manager.cc:1918] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.765103 5994 tablet_service.cc:1467] Processing CreateTablet for tablet f4064e4b82ce49a19849a550cc252976 (DEFAULT_TABLE table=default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.765486 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4064e4b82ce49a19849a550cc252976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.766425 5851 tablet_service.cc:1467] Processing CreateTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce (DEFAULT_TABLE table=default.Table_e63aba8119994181a248e26edd0b1690 [id=1d308dc2d8524d118ad5638a6dd12ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.767498 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f3a8de38e6724611959147a8c3b8d29b" } modify_external_catalogs: true
I20260928 10:43:54.767732 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f3a8de38e6724611959147a8c3b8d29b" } modify_external_catalogs: true
I20260928 10:43:54.767838 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a392670fdb5a4d4097c7edaf8f6642ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.770124 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81f66da1b0cf40238e750885aa4be575" } modify_external_catalogs: true
I20260928 10:43:54.770370 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81f66da1b0cf40238e750885aa4be575" } modify_external_catalogs: true
I20260928 10:43:54.761751 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 (DEFAULT_TABLE table=default.Table_367b1884fe55426cab766c1ba5eef7de [id=cd929aef5d0d45c5abd5c3c7a62e050c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:54.776402 6204 tablet.cc:2369] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 10:43:54.778225 6287 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:43:54.722208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.126:39997 (local address 127.5.100.67:35573)
0928 10:43:54.776708 (+ 54500us) negotiation.cc:107] Waiting for socket to connect
0928 10:43:54.776937 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54359,"threads_started":1}
W20260928 10:43:54.780403 6288 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:43:54.728957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.126:39997 (local address 127.5.100.65:46523)
0928 10:43:54.779228 (+ 50271us) negotiation.cc:107] Waiting for socket to connect
0928 10:43:54.779462 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":50126,"thread_start_us":49993,"threads_started":1}
I20260928 10:43:54.780607 6270 log.cc:1196] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:54.781390 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 (DEFAULT_TABLE table=default.Table_0142f232a18d4ab68212ed932a55051c [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.781838 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6064f370434acb8fc02fda5b50ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.786284 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a89b64e0a7b43b589e7caf911836fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.794963 6270 ts_tablet_manager.cc:1939] T 1dfc37b147e442c1956550e4c7c0dbd5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:54.797111 5687 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.126:39997, user_credentials={real_user=slave}} blocked reactor thread for 66697.5us
I20260928 10:43:54.797303 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.799305 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1dfc37b147e442c1956550e4c7c0dbd5 (table default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]) successfully deleted
W20260928 10:43:54.799590 5687 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997): Couldn't send request to peer a2eb817eda984ab99ec4704c47699846. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 10:43:54.800128 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddabd402cd040f99dcf6221c01c19af consensus state has no leader
W20260928 10:43:54.800459 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a89b64e0a7b43b589e7caf911836fb2 consensus state has no leader
W20260928 10:43:54.800683 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72ace49431a24469bef73c596af089ae consensus state has no leader
I20260928 10:43:54.800709 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 1dfc37b147e442c1956550e4c7c0dbd5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.800911 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet da1e674095e74b49a276c6783d47f022 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:54.810784 6070 tablet.cc:2369] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:43:54.814049 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b1f23ddb4368451d8c555e6e8dc52151
I20260928 10:43:54.814831 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 5573b1fc93a648d291a6d1889df5c167 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.815361 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 9b90530f95ed4b73a57dedd4814f0236 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.816144 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.717061 6275 consensus_queue.cc:260] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.816727 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5b5fc914143e40cebf6603bbc1b3195e
I20260928 10:43:54.816571 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.817113 6275 ts_tablet_manager.cc:1428] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.102s user 0.001s sys 0.001s
W20260928 10:43:54.817734 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a392670fdb5a4d4097c7edaf8f6642ce consensus state has no leader
I20260928 10:43:54.818606 6269 tablet_replica.cc:330] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:54.818800 6269 raft_consensus.cc:2229] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.818972 6269 raft_consensus.cc:2258] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:54.819747 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b1f23ddb4368451d8c555e6e8dc52151 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f23ddb4368451d8c555e6e8dc52151 already in progress: creating tablet
I20260928 10:43:54.820302 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.820564 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.820665 6269 ts_tablet_manager.cc:1905] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.820909 6275 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.822739 6275 tablet_bootstrap.cc:654] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.822937 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:54.823663 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5b5fc914143e40cebf6603bbc1b3195e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b5fc914143e40cebf6603bbc1b3195e already in progress: creating tablet
I20260928 10:43:54.824558 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet fabde6f461124805b216a8003023b38c
I20260928 10:43:54.825198 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9b90530f95ed4b73a57dedd4814f0236
I20260928 10:43:54.825482 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet fabde6f461124805b216a8003023b38c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.825608 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 9b90530f95ed4b73a57dedd4814f0236 deleted and replaced by tablet 1447a551d9264d18bd1eeabe31b513f1
I20260928 10:43:54.826318 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.827564 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet fabde6f461124805b216a8003023b38c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:54.828882 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fabde6f461124805b216a8003023b38c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fabde6f461124805b216a8003023b38c already in progress: creating tablet
I20260928 10:43:54.828830 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_078f2e9b9fff423ca3d37fc58a0169a8" } modify_external_catalogs: true
I20260928 10:43:54.829037 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_078f2e9b9fff423ca3d37fc58a0169a8" } modify_external_catalogs: true
I20260928 10:43:54.831866 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.832213 6272 tablet_replica.cc:330] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:54.832751 6272 raft_consensus.cc:2229] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.833168 6272 raft_consensus.cc:2258] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.835702 6273 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.835860 6273 ts_tablet_manager.cc:1397] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.113s user 0.018s sys 0.024s
I20260928 10:43:54.836663 6273 raft_consensus.cc:348] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.836934 6273 raft_consensus.cc:374] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.837028 6273 raft_consensus.cc:729] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.837117 6269 ts_tablet_manager.cc:1918] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.837265 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e36c690a640541e5ba33b67914656bbc
I20260928 10:43:54.837286 6269 log.cc:1196] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:54.837296 6273 consensus_queue.cc:260] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.838187 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.839804 6272 ts_tablet_manager.cc:1905] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.840473 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.841176 6273 ts_tablet_manager.cc:1428] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:43:54.842116 6273 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.842146 6271 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.843562 6271 ts_tablet_manager.cc:1397] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.141s user 0.006s sys 0.015s
I20260928 10:43:54.844215 6273 tablet_bootstrap.cc:654] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.844506 6271 raft_consensus.cc:348] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.844959 6271 raft_consensus.cc:374] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.845073 6271 raft_consensus.cc:729] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.845791 6271 consensus_queue.cc:260] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.846084 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.847504 6271 ts_tablet_manager.cc:1428] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:43:54.848685 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.849505 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.849967 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet fabde6f461124805b216a8003023b38c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.850217 6270 tablet_replica.cc:330] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:54.850634 6271 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.852106 6270 raft_consensus.cc:2229] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.852298 6270 raft_consensus.cc:2258] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.853075 6270 ts_tablet_manager.cc:1905] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.853682 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet da1e674095e74b49a276c6783d47f022
I20260928 10:43:54.854102 6271 tablet_bootstrap.cc:654] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.854434 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e674095e74b49a276c6783d47f022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.856313 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3340d0272c64421c93ea8d7d1495776c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.856508 6272 ts_tablet_manager.cc:1918] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.856683 6272 log.cc:1196] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/47b0cbf795354e869721f90b37c2e4dd
I20260928 10:43:54.856770 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6d8b6b9f7f18477e8cf57a7624940b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.856956 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3340d0272c64421c93ea8d7d1495776c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.857098 6272 ts_tablet_manager.cc:1939] T 47b0cbf795354e869721f90b37c2e4dd P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:43:54.857299 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d8b6b9f7f18477e8cf57a7624940b36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.859163 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.856323 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f3c978eb1427452db9394321922710b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.859632 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3c978eb1427452db9394321922710b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:54.860044 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9b90530f95ed4b73a57dedd4814f0236 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b90530f95ed4b73a57dedd4814f0236 already in progress: creating tablet
W20260928 10:43:54.860294 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b1f23ddb4368451d8c555e6e8dc52151 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f23ddb4368451d8c555e6e8dc52151 already in progress: creating tablet
I20260928 10:43:54.860806 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e674095e74b49a276c6783d47f022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.861101 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.861354 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:54.861941 6292 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:43:54.765933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.126:39997 (local address 127.5.100.66:53147)
0928 10:43:54.795738 (+ 29805us) negotiation.cc:107] Waiting for socket to connect
0928 10:43:54.796023 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":29640,"threads_started":1}
I20260928 10:43:54.862564 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e674095e74b49a276c6783d47f022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.862867 6269 ts_tablet_manager.cc:1939] T 262c99c38fd84443a5d9440ec5c33d07 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:54.864120 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 262c99c38fd84443a5d9440ec5c33d07 (table default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]) successfully deleted
I20260928 10:43:54.864063 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f8d6cdbe1618429ab578e328699eec31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.864341 6269 tablet_replica.cc:330] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:54.864511 6269 raft_consensus.cc:2229] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:43:54.864574 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8d6cdbe1618429ab578e328699eec31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.864689 6269 raft_consensus.cc:2258] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:54.864766 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5b5fc914143e40cebf6603bbc1b3195e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b5fc914143e40cebf6603bbc1b3195e already in progress: creating tablet
I20260928 10:43:54.864944 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:54.865001 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b1f23ddb4368451d8c555e6e8dc52151 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f23ddb4368451d8c555e6e8dc52151 already in progress: creating tablet
I20260928 10:43:54.866608 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b408b80f43024d9c9e4242fb52b068ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.866775 6269 ts_tablet_manager.cc:1905] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:54.867089 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b408b80f43024d9c9e4242fb52b068ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.867236 6273 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.867394 6273 ts_tablet_manager.cc:1397] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260928 10:43:54.868279 6273 raft_consensus.cc:348] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.868548 6273 raft_consensus.cc:374] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.868633 6273 raft_consensus.cc:729] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.868901 6273 consensus_queue.cc:260] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.869433 6273 ts_tablet_manager.cc:1428] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:54.869707 6273 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.871393 6273 tablet_bootstrap.cc:654] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.872398 6271 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.872534 6271 ts_tablet_manager.cc:1397] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260928 10:43:54.873266 6271 raft_consensus.cc:348] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.873517 6271 raft_consensus.cc:374] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.873606 6271 raft_consensus.cc:729] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.873840 6271 consensus_queue.cc:260] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.874394 6271 ts_tablet_manager.cc:1428] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:54.874524 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.874677 6271 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.876459 6271 tablet_bootstrap.cc:654] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.878839 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.880539 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 (DEFAULT_TABLE table=default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.880896 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8358dd69e3d24743a79c681e2316dfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.880887 5857 tablet_service.cc:1467] Processing CreateTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c (DEFAULT_TABLE table=default.Table_8a933de31039460087d79d408857cc58 [id=8ebad4d6e6d449348b25b5710471ae86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.881328 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6aa426fd7c5444ca7db936da87d2d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.881469 5990 tablet_service.cc:1467] Processing CreateTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c (DEFAULT_TABLE table=default.Table_8a933de31039460087d79d408857cc58 [id=8ebad4d6e6d449348b25b5710471ae86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.882994 6275 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:54.883148 6275 ts_tablet_manager.cc:1397] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.010s
I20260928 10:43:54.883334 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6aa426fd7c5444ca7db936da87d2d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.883862 6275 raft_consensus.cc:348] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.884088 6275 raft_consensus.cc:374] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.884150 6275 raft_consensus.cc:729] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.884352 6275 consensus_queue.cc:260] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.884852 6275 ts_tablet_manager.cc:1428] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:43:54.885130 6275 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.885522 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 (DEFAULT_TABLE table=default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.885910 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8358dd69e3d24743a79c681e2316dfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.886814 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.887223 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1447a551d9264d18bd1eeabe31b513f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.889376 6275 tablet_bootstrap.cc:654] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.891687 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1447a551d9264d18bd1eeabe31b513f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.900627 6272 tablet_replica.cc:330] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:54.902209 6272 raft_consensus.cc:2229] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.902774 6272 raft_consensus.cc:2258] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.904186 6272 ts_tablet_manager.cc:1905] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.907894 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 8276c29e44b54fc78844e3ef1e2e828f from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:54.911356 6269 ts_tablet_manager.cc:1918] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.911553 6269 log.cc:1196] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/fabde6f461124805b216a8003023b38c
I20260928 10:43:54.911917 6269 ts_tablet_manager.cc:1939] T fabde6f461124805b216a8003023b38c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:54.913021 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet fabde6f461124805b216a8003023b38c (table default.Table_81f66da1b0cf40238e750885aa4be575 [id=fab19738f8114aa1b33a248981b40eaf]) successfully deleted
I20260928 10:43:54.912863 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6b4b8b1dcbc04c1bb40006e132b83045"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.913656 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b4b8b1dcbc04c1bb40006e132b83045 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.914146 6275 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:54.914372 6275 ts_tablet_manager.cc:1397] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.005s
I20260928 10:43:54.915005 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_243547c2dbc148cb84fd15e3bde2e412"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:54.915330 6275 raft_consensus.cc:348] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.915571 6275 raft_consensus.cc:374] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:43:54.915699 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_243547c2dbc148cb84fd15e3bde2e412 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:54.915823 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9b90530f95ed4b73a57dedd4814f0236 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b90530f95ed4b73a57dedd4814f0236 already in progress: creating tablet
I20260928 10:43:54.916066 6275 raft_consensus.cc:729] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:43:54.916575 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e36c690a640541e5ba33b67914656bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36c690a640541e5ba33b67914656bbc already in progress: creating tablet
I20260928 10:43:54.916347 6275 consensus_queue.cc:260] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.916879 6269 tablet_replica.cc:330] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:54.917093 6269 raft_consensus.cc:2229] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.917259 6269 raft_consensus.cc:2258] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.918721 6271 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.918881 6271 ts_tablet_manager.cc:1397] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.003s
I20260928 10:43:54.919219 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c5d7ff21d3b44127bc2d5d7d7c5e34f9" } new_table_name: "default.Table_a50c6af88ced410e9224954bc1aaf5f3" modify_external_catalogs: true
I20260928 10:43:54.919615 6271 raft_consensus.cc:348] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.919852 6271 raft_consensus.cc:374] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.919921 6271 raft_consensus.cc:729] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.920779 6275 ts_tablet_manager.cc:1428] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 10:43:54.921193 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.921558 6271 consensus_queue.cc:260] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.923261 6271 ts_tablet_manager.cc:1428] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:54.923600 6271 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.925324 6271 tablet_bootstrap.cc:654] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.926219 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 (DEFAULT_TABLE table=default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.926642 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1447a551d9264d18bd1eeabe31b513f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.927024 6136 tablet_service.cc:1467] Processing CreateTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c (DEFAULT_TABLE table=default.Table_8a933de31039460087d79d408857cc58 [id=8ebad4d6e6d449348b25b5710471ae86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.927268 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.927352 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6aa426fd7c5444ca7db936da87d2d1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:54.927335 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9b90530f95ed4b73a57dedd4814f0236 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b90530f95ed4b73a57dedd4814f0236 already in progress: creating tablet
W20260928 10:43:54.927616 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e36c690a640541e5ba33b67914656bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36c690a640541e5ba33b67914656bbc already in progress: creating tablet
I20260928 10:43:54.930774 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 (DEFAULT_TABLE table=default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.931145 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8358dd69e3d24743a79c681e2316dfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.934386 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2dc104fef16a4222ba3db2b7f277b4bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:54.937122 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dc104fef16a4222ba3db2b7f277b4bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:54.939733 6269 ts_tablet_manager.cc:1905] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.940413 6275 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.941982 6275 tablet_bootstrap.cc:654] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.941937 5992 tablet_service.cc:1467] Processing CreateTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 (DEFAULT_TABLE table=default.Table_f8d6cdbe1618429ab578e328699eec31 [id=1ea87897a2684da8a50f4bba795e4c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.943681 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c97e247cfc4547558b59a4168fa7e3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.943192 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 (DEFAULT_TABLE table=default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.943994 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 (DEFAULT_TABLE table=default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.944300 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81c769b5324ca4a68134e30da7fda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.944406 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81c769b5324ca4a68134e30da7fda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.944505 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 2693b378215f425bb1c2e3e0963aac95 (DEFAULT_TABLE table=default.Table_f3c978eb1427452db9394321922710b9 [id=9bfa888c61bf433cab0fe7ef138106a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.944830 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2693b378215f425bb1c2e3e0963aac95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.945055 6272 ts_tablet_manager.cc:1918] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.945188 6272 log.cc:1196] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/da1e674095e74b49a276c6783d47f022
I20260928 10:43:54.945482 6272 ts_tablet_manager.cc:1939] T da1e674095e74b49a276c6783d47f022 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:54.947094 6272 tablet_replica.cc:330] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:54.947338 6272 raft_consensus.cc:2229] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.947571 6272 raft_consensus.cc:2258] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.948426 6272 ts_tablet_manager.cc:1905] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:54.951642 6273 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.951866 6273 ts_tablet_manager.cc:1397] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.082s user 0.015s sys 0.054s
I20260928 10:43:54.939170 5698 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_c7c975924ff54bd496add9760afaa6d8 [id=28c06470dcb4424282b28a9692f26039]). Expected version 3 got 0
I20260928 10:43:54.952503 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 (DEFAULT_TABLE table=default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.952680 6273 raft_consensus.cc:348] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.952906 6273 raft_consensus.cc:374] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.952924 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81c769b5324ca4a68134e30da7fda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.952978 6273 raft_consensus.cc:729] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.953182 6273 consensus_queue.cc:260] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.953750 6273 ts_tablet_manager.cc:1428] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:54.954079 6273 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.954576 6124 tablet_service.cc:1467] Processing CreateTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 (DEFAULT_TABLE table=default.Table_f8d6cdbe1618429ab578e328699eec31 [id=1ea87897a2684da8a50f4bba795e4c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.955041 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c97e247cfc4547558b59a4168fa7e3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.956568 6273 tablet_bootstrap.cc:654] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.952174 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]) successfully deleted
I20260928 10:43:54.965251 6273 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.965456 6273 ts_tablet_manager.cc:1397] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 10:43:54.966053 6269 ts_tablet_manager.cc:1918] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.966202 6269 log.cc:1196] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/fa3a40da10504c60a793672dcb7b3510
I20260928 10:43:54.966331 6273 raft_consensus.cc:348] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.966636 6269 ts_tablet_manager.cc:1939] T fa3a40da10504c60a793672dcb7b3510 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:54.966678 6273 raft_consensus.cc:374] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.966766 6273 raft_consensus.cc:729] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.967051 6273 consensus_queue.cc:260] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.968135 6272 ts_tablet_manager.cc:1918] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:54.968132 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet fa3a40da10504c60a793672dcb7b3510 (table default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]) successfully deleted
I20260928 10:43:54.968276 6272 log.cc:1196] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f77b83fd29ff4176baf37d71738a9433
I20260928 10:43:54.968367 6271 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:54.968349 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_c7c975924ff54bd496add9760afaa6d8 [id=28c06470dcb4424282b28a9692f26039]). Expected version 3 got 0
I20260928 10:43:54.968506 6271 ts_tablet_manager.cc:1397] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260928 10:43:54.968629 6272 ts_tablet_manager.cc:1939] T f77b83fd29ff4176baf37d71738a9433 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:54.969599 6273 ts_tablet_manager.cc:1428] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:43:54.970420 6271 raft_consensus.cc:348] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.970678 6273 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.970683 6271 raft_consensus.cc:374] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.970769 6271 raft_consensus.cc:729] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.972147 6273 tablet_bootstrap.cc:654] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.972093 6271 consensus_queue.cc:260] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:54.973115 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb061a69c1ea4464a1db06c8a20999ab consensus state has no leader
I20260928 10:43:54.973851 6271 ts_tablet_manager.cc:1428] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:43:54.974164 6271 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:54.975979 5851 tablet_service.cc:1467] Processing CreateTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 (DEFAULT_TABLE table=default.Table_f8d6cdbe1618429ab578e328699eec31 [id=1ea87897a2684da8a50f4bba795e4c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.976127 6271 tablet_bootstrap.cc:654] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.976676 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c97e247cfc4547558b59a4168fa7e3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.978611 6273 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:54.978742 6273 ts_tablet_manager.cc:1397] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.006s
I20260928 10:43:54.979126 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 2693b378215f425bb1c2e3e0963aac95 (DEFAULT_TABLE table=default.Table_f3c978eb1427452db9394321922710b9 [id=9bfa888c61bf433cab0fe7ef138106a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.979499 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2693b378215f425bb1c2e3e0963aac95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.979447 6273 raft_consensus.cc:348] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.979703 6273 raft_consensus.cc:374] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.979799 6273 raft_consensus.cc:729] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.980007 6273 consensus_queue.cc:260] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.980706 6273 ts_tablet_manager.cc:1428] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:54.980985 6273 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:54.981000 5990 tablet_service.cc:1467] Processing CreateTablet for tablet e76a54bfddc74a9e86285add7b97645b (DEFAULT_TABLE table=default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.981364 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76a54bfddc74a9e86285add7b97645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.982550 6273 tablet_bootstrap.cc:654] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:54.984524 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 2693b378215f425bb1c2e3e0963aac95 (DEFAULT_TABLE table=default.Table_f3c978eb1427452db9394321922710b9 [id=9bfa888c61bf433cab0fe7ef138106a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.984929 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2693b378215f425bb1c2e3e0963aac95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.987596 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f77b83fd29ff4176baf37d71738a9433 (table default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]) successfully deleted
I20260928 10:43:54.988049 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:54.989503 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:54.990581 6275 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:54.990749 6275 ts_tablet_manager.cc:1397] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.012s
I20260928 10:43:54.991482 6275 raft_consensus.cc:348] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.991724 6275 raft_consensus.cc:374] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:54.991796 6275 raft_consensus.cc:729] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:54.992038 6275 consensus_queue.cc:260] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.992255 6132 tablet_service.cc:1467] Processing CreateTablet for tablet e76a54bfddc74a9e86285add7b97645b (DEFAULT_TABLE table=default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.992559 6275 ts_tablet_manager.cc:1428] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:43:54.992636 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76a54bfddc74a9e86285add7b97645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.992877 6275 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:54.994637 6281 raft_consensus.cc:482] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:54.994922 6281 raft_consensus.cc:504] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:54.995101 5851 tablet_service.cc:1467] Processing CreateTablet for tablet e76a54bfddc74a9e86285add7b97645b (DEFAULT_TABLE table=default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:54.995463 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76a54bfddc74a9e86285add7b97645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:54.996119 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:54.996341 6272 tablet_replica.cc:330] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:54.996524 6272 raft_consensus.cc:2229] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:54.996668 6272 raft_consensus.cc:2258] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:54.996963 6281 leader_election.cc:288] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.001641 6275 tablet_bootstrap.cc:654] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.003453 6272 ts_tablet_manager.cc:1905] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.007889 6269 tablet_replica.cc:330] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.009467 6269 raft_consensus.cc:2229] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.010375 6269 raft_consensus.cc:2258] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:55.010907 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet da1e674095e74b49a276c6783d47f022 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1e674095e74b49a276c6783d47f022 already in progress: creating tablet
I20260928 10:43:55.012217 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_846bdb09abb244c0a6613e189f3c139d" } new_table_name: "default.Table_a8e8018f99c4497b87d378148987613d" modify_external_catalogs: true
I20260928 10:43:55.013734 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f8d6cdbe1618429ab578e328699eec31" } new_table_name: "default.Table_a284780715684b758a03e94f637924dd" modify_external_catalogs: true
I20260928 10:43:55.015148 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:55.015604 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 8276c29e44b54fc78844e3ef1e2e828f deleted and replaced by tablet 4c93507a0bf14c8383794b34ba1702fd
I20260928 10:43:55.017174 6272 ts_tablet_manager.cc:1918] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.017345 6272 log.cc:1196] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:55.017421 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a93b5310099348c4ac165e439bb01676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.017926 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:55.018069 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a93b5310099348c4ac165e439bb01676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.019832 6272 ts_tablet_manager.cc:1939] T 1dfc37b147e442c1956550e4c7c0dbd5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.022804 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.024628 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2" } modify_external_catalogs: true
I20260928 10:43:55.024858 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2" } modify_external_catalogs: true
I20260928 10:43:55.025498 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c7c975924ff54bd496add9760afaa6d8" } modify_external_catalogs: true
I20260928 10:43:55.025701 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c7c975924ff54bd496add9760afaa6d8" } modify_external_catalogs: true
I20260928 10:43:55.026250 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c0e8a69f307b48c1aaf3301e73250841" } new_table_name: "default.Table_8a8fc7cfa93d4b88a2320d8689645a43" modify_external_catalogs: true
I20260928 10:43:55.026364 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.027884 6270 ts_tablet_manager.cc:1918] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.028081 6270 log.cc:1196] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/fabde6f461124805b216a8003023b38c
I20260928 10:43:55.028492 6270 ts_tablet_manager.cc:1939] T fabde6f461124805b216a8003023b38c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.029606 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet fabde6f461124805b216a8003023b38c (table default.Table_81f66da1b0cf40238e750885aa4be575 [id=fab19738f8114aa1b33a248981b40eaf]) successfully deleted
I20260928 10:43:55.032444 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b7443d18644a44f4a9c85ff0f860f176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.033140 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7443d18644a44f4a9c85ff0f860f176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.035758 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 5a89b64e0a7b43b589e7caf911836fb2 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.036278 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_243547c2dbc148cb84fd15e3bde2e412" } new_table_name: "default.Table_b9d751ff716d42048d84fa159b5cdff7" modify_external_catalogs: true
W20260928 10:43:55.043128 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e36c690a640541e5ba33b67914656bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e36c690a640541e5ba33b67914656bbc already in progress: creating tablet
I20260928 10:43:55.043537 6270 tablet_replica.cc:330] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.043751 6270 raft_consensus.cc:2229] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.043938 6270 raft_consensus.cc:2258] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.044679 6270 ts_tablet_manager.cc:1905] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.046142 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.025547 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1dfc37b147e442c1956550e4c7c0dbd5 (table default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]) successfully deleted
I20260928 10:43:55.051319 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1e674095e74b49a276c6783d47f022" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:43:55.052582 5957 leader_election.cc:341] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:55.053691 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet fa3a40da10504c60a793672dcb7b3510 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.054329 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_29808fa3a9bd4528bca3a52d8bb08044" } modify_external_catalogs: true
I20260928 10:43:55.054533 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_29808fa3a9bd4528bca3a52d8bb08044" } modify_external_catalogs: true
W20260928 10:43:55.058094 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8276c29e44b54fc78844e3ef1e2e828f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8276c29e44b54fc78844e3ef1e2e828f already in progress: creating tablet
W20260928 10:43:55.066424 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4dee0748fe04da7b4e07bfdfdb8cb7e consensus state has no leader
I20260928 10:43:55.066779 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 262c99c38fd84443a5d9440ec5c33d07 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.067312 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_887b7b8b4db941078430be23306434aa" } modify_external_catalogs: true
I20260928 10:43:55.067504 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_887b7b8b4db941078430be23306434aa" } modify_external_catalogs: true
W20260928 10:43:55.068001 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c97e247cfc4547558b59a4168fa7e3b0 consensus state has no leader
I20260928 10:43:55.068320 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2dc104fef16a4222ba3db2b7f277b4bc" } modify_external_catalogs: true
I20260928 10:43:55.068468 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2dc104fef16a4222ba3db2b7f277b4bc" } modify_external_catalogs: true
I20260928 10:43:55.069460 6270 ts_tablet_manager.cc:1918] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:43:55.069545 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a392670fdb5a4d4097c7edaf8f6642ce consensus state has no leader
I20260928 10:43:55.069598 6270 log.cc:1196] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/da1e674095e74b49a276c6783d47f022
I20260928 10:43:55.069765 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet e36c690a640541e5ba33b67914656bbc from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.069983 6270 ts_tablet_manager.cc:1939] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.070737 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]) successfully deleted
I20260928 10:43:55.072885 6270 tablet_replica.cc:330] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.072820 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fc332e83c5a34833bb32f19aecd40642"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.073359 6270 raft_consensus.cc:2229] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:43:55.073391 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc332e83c5a34833bb32f19aecd40642 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.073616 6273 tablet_bootstrap.cc:492] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.073637 6270 raft_consensus.cc:2258] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.073799 6273 ts_tablet_manager.cc:1397] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.093s user 0.027s sys 0.057s
I20260928 10:43:55.074563 6270 ts_tablet_manager.cc:1905] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.074580 6273 raft_consensus.cc:348] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:55.074801 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1454e1e8bea746c0883c738ba8a293b9 has no consensus state
I20260928 10:43:55.074824 6273 raft_consensus.cc:374] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.074888 6273 raft_consensus.cc:729] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.075114 6273 consensus_queue.cc:260] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.075619 6273 ts_tablet_manager.cc:1428] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:55.076434 6273 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:55.079084 5955 leader_election.cc:341] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: da1e674095e74b49a276c6783d47f022
I20260928 10:43:55.079326 6273 tablet_bootstrap.cc:654] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.079303 5955 leader_election.cc:302] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:43:55.079650 5955 raft_consensus.cc:2670] T da1e674095e74b49a276c6783d47f022 P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:43:55.081171 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfc37b147e442c1956550e4c7c0dbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.086632 6270 ts_tablet_manager.cc:1918] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.086856 6270 log.cc:1196] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/5573b1fc93a648d291a6d1889df5c167
I20260928 10:43:55.087262 6270 ts_tablet_manager.cc:1939] T 5573b1fc93a648d291a6d1889df5c167 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.087263 6273 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.087399 6273 ts_tablet_manager.cc:1397] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260928 10:43:55.088349 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 5573b1fc93a648d291a6d1889df5c167 (table default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]) successfully deleted
I20260928 10:43:55.088340 6273 raft_consensus.cc:348] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.088564 6273 raft_consensus.cc:374] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.088663 6273 raft_consensus.cc:729] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.088919 6273 consensus_queue.cc:260] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:55.089143 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5b5fc914143e40cebf6603bbc1b3195e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b5fc914143e40cebf6603bbc1b3195e already in progress: creating tablet
I20260928 10:43:55.089524 6270 tablet_replica.cc:330] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.089737 6270 raft_consensus.cc:2229] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.089962 6270 raft_consensus.cc:2258] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.090417 6273 ts_tablet_manager.cc:1428] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:55.091354 6270 ts_tablet_manager.cc:1905] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.093070 6273 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.094605 6273 tablet_bootstrap.cc:654] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.094738 6275 tablet_bootstrap.cc:492] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.094893 6275 ts_tablet_manager.cc:1397] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.102s user 0.010s sys 0.021s
I20260928 10:43:55.095642 6275 raft_consensus.cc:348] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.095887 6275 raft_consensus.cc:374] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.095983 6275 raft_consensus.cc:729] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.096271 6275 consensus_queue.cc:260] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.097759 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7bf5036ca6bc40bd90328811c948501d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.098409 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bf5036ca6bc40bd90328811c948501d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.099190 6270 ts_tablet_manager.cc:1918] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.099315 6270 log.cc:1196] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f0cf659188ff49a083f212715f8de77b
I20260928 10:43:55.099910 6270 ts_tablet_manager.cc:1939] T f0cf659188ff49a083f212715f8de77b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.099745 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.099995 6275 ts_tablet_manager.cc:1428] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260928 10:43:55.100301 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.102063 6270 tablet_replica.cc:330] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.101964 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0f27ea4cc7c04295af25a51c164d3998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.102244 6270 raft_consensus.cc:2229] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.102396 6270 raft_consensus.cc:2258] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:55.102677 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f27ea4cc7c04295af25a51c164d3998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.103020 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f0cf659188ff49a083f212715f8de77b (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:55.103211 6270 ts_tablet_manager.cc:1905] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.104830 6275 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:55.105352 6269 ts_tablet_manager.cc:1905] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.106686 6275 tablet_bootstrap.cc:654] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.107659 5698 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dff642f6354d4a418329a385b20b2171
I20260928 10:43:55.109277 6270 ts_tablet_manager.cc:1918] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.109436 6270 log.cc:1196] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d4e66a9baddd47b9a2fee6ed6c21c741
I20260928 10:43:55.109802 6270 ts_tablet_manager.cc:1939] T d4e66a9baddd47b9a2fee6ed6c21c741 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.110980 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d4e66a9baddd47b9a2fee6ed6c21c741 (table default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]) successfully deleted
W20260928 10:43:55.111753 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8276c29e44b54fc78844e3ef1e2e828f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8276c29e44b54fc78844e3ef1e2e828f already in progress: creating tablet
I20260928 10:43:55.113082 6275 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.113276 6275 ts_tablet_manager.cc:1397] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260928 10:43:55.114146 6275 raft_consensus.cc:348] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.114427 6275 raft_consensus.cc:374] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.114543 6275 raft_consensus.cc:729] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.115741 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 41f6916daf024379a7dd0411e44ba6ca (DEFAULT_TABLE table=default.Table_b408b80f43024d9c9e4242fb52b068ba [id=0558f36d9f534cc9a044dcad2e835c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.116254 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f6916daf024379a7dd0411e44ba6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.116434 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 41f6916daf024379a7dd0411e44ba6ca (DEFAULT_TABLE table=default.Table_b408b80f43024d9c9e4242fb52b068ba [id=0558f36d9f534cc9a044dcad2e835c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.116869 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f6916daf024379a7dd0411e44ba6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.119247 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 (DEFAULT_TABLE table=default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.119714 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1454e1e8bea746c0883c738ba8a293b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.119869 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet f0cf659188ff49a083f212715f8de77b with delete_type TABLET_DATA_DELETED (replaced by tablet 345245f9349a4031af5ff278a3da74f0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.120333 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 41f6916daf024379a7dd0411e44ba6ca (DEFAULT_TABLE table=default.Table_b408b80f43024d9c9e4242fb52b068ba [id=0558f36d9f534cc9a044dcad2e835c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.120699 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f6916daf024379a7dd0411e44ba6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.122643 6272 tablet_replica.cc:330] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.122845 6272 raft_consensus.cc:2229] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.123086 6272 raft_consensus.cc:2258] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.125052 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 (DEFAULT_TABLE table=default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.125494 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1454e1e8bea746c0883c738ba8a293b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.132814 6271 tablet_bootstrap.cc:492] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.133074 6271 ts_tablet_manager.cc:1397] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.159s user 0.014s sys 0.017s
I20260928 10:43:55.134383 6271 raft_consensus.cc:348] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.134691 6271 raft_consensus.cc:374] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.134778 6271 raft_consensus.cc:729] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.135051 6271 consensus_queue.cc:260] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.135248 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_391fe28cf8c44817971a0e1ce4b4bed3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.135967 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_391fe28cf8c44817971a0e1ce4b4bed3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.136277 6269 ts_tablet_manager.cc:1918] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.136412 6269 log.cc:1196] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d4e66a9baddd47b9a2fee6ed6c21c741
I20260928 10:43:55.136857 6269 ts_tablet_manager.cc:1939] T d4e66a9baddd47b9a2fee6ed6c21c741 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.137840 6269 tablet_replica.cc:330] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.138062 6269 raft_consensus.cc:2229] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.138222 6269 raft_consensus.cc:2258] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.139976 6271 ts_tablet_manager.cc:1428] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 10:43:55.141185 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d4e66a9baddd47b9a2fee6ed6c21c741 (table default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]) successfully deleted
I20260928 10:43:55.143607 6271 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.145579 6271 tablet_bootstrap.cc:654] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.150835 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3ddabd402cd040f99dcf6221c01c19af
I20260928 10:43:55.151294 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 (DEFAULT_TABLE table=default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.151780 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1454e1e8bea746c0883c738ba8a293b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.152781 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ddabd402cd040f99dcf6221c01c19af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.152792 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ddabd402cd040f99dcf6221c01c19af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.152969 6273 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.153376 6273 ts_tablet_manager.cc:1397] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.047s
W20260928 10:43:55.153641 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3ddabd402cd040f99dcf6221c01c19af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddabd402cd040f99dcf6221c01c19af already in progress: creating tablet
I20260928 10:43:55.154039 6271 tablet_bootstrap.cc:492] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.154219 6271 ts_tablet_manager.cc:1397] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260928 10:43:55.154762 6273 raft_consensus.cc:348] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.155033 6273 raft_consensus.cc:374] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.155126 6273 raft_consensus.cc:729] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.155076 6271 raft_consensus.cc:348] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.155398 6271 raft_consensus.cc:374] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.155504 6271 raft_consensus.cc:729] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.155421 6273 consensus_queue.cc:260] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.155812 6271 consensus_queue.cc:260] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.156024 6273 ts_tablet_manager.cc:1428] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 10:43:55.156299 6273 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.157913 6273 tablet_bootstrap.cc:654] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.160060 6271 ts_tablet_manager.cc:1428] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260928 10:43:55.162990 6271 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.164171 6272 ts_tablet_manager.cc:1905] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.166446 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ddabd402cd040f99dcf6221c01c19af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.169312 6275 consensus_queue.cc:260] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.171617 6275 ts_tablet_manager.cc:1428] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.058s user 0.003s sys 0.000s
I20260928 10:43:55.173079 6275 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:55.174276 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet f77b83fd29ff4176baf37d71738a9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.174651 6270 tablet_replica.cc:330] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.174817 6270 raft_consensus.cc:2229] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.175004 6270 raft_consensus.cc:2258] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.175833 6270 ts_tablet_manager.cc:1905] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.177143 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.177400 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.181354 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a46a3766a754fdeb1a211cff00ce691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.182019 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a46a3766a754fdeb1a211cff00ce691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.182503 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0142f232a18d4ab68212ed932a55051c" } new_table_name: "default.Table_c3422798a8284a8d8217eecc3ba83c01" modify_external_catalogs: true
I20260928 10:43:55.183046 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:55.184160 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.185212 6269 ts_tablet_manager.cc:1905] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.186144 6276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:43:55.186411 6276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:43:55.187203 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.188174 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ddabd402cd040f99dcf6221c01c19af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.189050 6270 ts_tablet_manager.cc:1918] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.189184 6270 log.cc:1196] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f77b83fd29ff4176baf37d71738a9433
I20260928 10:43:55.189523 6270 ts_tablet_manager.cc:1939] T f77b83fd29ff4176baf37d71738a9433 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.191464 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.191784 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.192003 6272 ts_tablet_manager.cc:1918] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.192130 6272 log.cc:1196] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f0cf659188ff49a083f212715f8de77b
I20260928 10:43:55.192516 6272 ts_tablet_manager.cc:1939] T f0cf659188ff49a083f212715f8de77b P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.196650 6275 tablet_bootstrap.cc:654] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.200229 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f0cf659188ff49a083f212715f8de77b (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:55.200591 6272 tablet_replica.cc:330] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.200783 6272 raft_consensus.cc:2229] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.200953 6272 raft_consensus.cc:2258] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.201721 6272 ts_tablet_manager.cc:1905] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.206365 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f77b83fd29ff4176baf37d71738a9433 (table default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]) successfully deleted
I20260928 10:43:55.206589 6270 tablet_replica.cc:330] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:43:55.206733 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5a89b64e0a7b43b589e7caf911836fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a89b64e0a7b43b589e7caf911836fb2 already in progress: creating tablet
I20260928 10:43:55.206787 6270 raft_consensus.cc:2229] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.206950 6270 raft_consensus.cc:2258] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.208115 6271 tablet_bootstrap.cc:654] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.209257 6270 ts_tablet_manager.cc:1905] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.212462 6271 tablet_bootstrap.cc:492] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.213641 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f4064e4b82ce49a19849a550cc252976
I20260928 10:43:55.214285 6271 ts_tablet_manager.cc:1397] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260928 10:43:55.215093 6271 raft_consensus.cc:348] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.215333 6271 raft_consensus.cc:374] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:43:55.215378 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f6064f370434acb8fc02fda5b50ecf6 consensus state has no leader
I20260928 10:43:55.215407 6271 raft_consensus.cc:729] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.215653 6271 consensus_queue.cc:260] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.216248 6271 ts_tablet_manager.cc:1428] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:55.216333 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.216548 6271 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.217453 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.218286 6271 tablet_bootstrap.cc:654] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.218385 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1447a551d9264d18bd1eeabe31b513f1
I20260928 10:43:55.219388 6275 tablet_bootstrap.cc:492] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.219565 6275 ts_tablet_manager.cc:1397] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.003s
I20260928 10:43:55.219877 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.220348 6275 raft_consensus.cc:348] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.220587 6275 raft_consensus.cc:374] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.220687 6275 raft_consensus.cc:729] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.220732 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.221024 6269 ts_tablet_manager.cc:1918] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.220916 6275 consensus_queue.cc:260] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.221171 6269 log.cc:1196] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f77b83fd29ff4176baf37d71738a9433
I20260928 10:43:55.221487 6269 ts_tablet_manager.cc:1939] T f77b83fd29ff4176baf37d71738a9433 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.221472 6275 ts_tablet_manager.cc:1428] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:55.222925 6281 raft_consensus.cc:482] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.223109 6281 raft_consensus.cc:504] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.223728 6281 leader_election.cc:288] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.224174 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3148ce7d224b1c93fac811577beebf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:55.224534 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f77b83fd29ff4176baf37d71738a9433 (table default.Table_c4175231ab5b4e73a92512cf34c07bbb [id=3eceb69bb8f94e95acb15e3e5e475ba7]) successfully deleted
I20260928 10:43:55.224575 5884 raft_consensus.cc:2454] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:43:55.225077 5957 leader_election.cc:302] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:55.226003 6269 tablet_replica.cc:330] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.225865 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f411d60097904229877bc64f248a45c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.226195 6269 raft_consensus.cc:2229] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.226524 6273 tablet_bootstrap.cc:492] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:43:55.226562 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f411d60097904229877bc64f248a45c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.226678 6273 ts_tablet_manager.cc:1397] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.070s user 0.015s sys 0.040s
I20260928 10:43:55.226779 6269 raft_consensus.cc:2258] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.226926 6272 ts_tablet_manager.cc:1918] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.227496 6273 raft_consensus.cc:348] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.227721 6273 raft_consensus.cc:374] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.227798 6273 raft_consensus.cc:729] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.227079 6272 log.cc:1196] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/3ddabd402cd040f99dcf6221c01c19af
I20260928 10:43:55.228034 6273 consensus_queue.cc:260] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.228230 6272 ts_tablet_manager.cc:1939] T 3ddabd402cd040f99dcf6221c01c19af P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.230355 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3148ce7d224b1c93fac811577beebf with delete_type TABLET_DATA_DELETED (replaced by tablet f1f8e172c5bf406196574895e5e5e3c7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.230892 6273 ts_tablet_manager.cc:1428] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260928 10:43:55.231881 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8276c29e44b54fc78844e3ef1e2e828f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8276c29e44b54fc78844e3ef1e2e828f already in progress: creating tablet
I20260928 10:43:55.232100 6273 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.232101 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet da1e674095e74b49a276c6783d47f022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.233825 6273 tablet_bootstrap.cc:654] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.234158 6281 raft_consensus.cc:2781] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:55.234342 6281 raft_consensus.cc:482] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:55.234455 6281 raft_consensus.cc:3037] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:55.235044 6269 ts_tablet_manager.cc:1905] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.237831 6281 raft_consensus.cc:504] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.239050 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3148ce7d224b1c93fac811577beebf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:55.239281 5884 raft_consensus.cc:3037] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:55.240087 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.240419 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.242231 5884 raft_consensus.cc:2454] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:55.242841 5957 leader_election.cc:302] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:55.244629 6281 leader_election.cc:288] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.244850 6281 raft_consensus.cc:2781] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:55.245038 6281 raft_consensus.cc:686] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:55.245494 6281 consensus_queue.cc:237] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.248627 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3148ce7d224b1c93fac811577beebf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:55.249135 6155 raft_consensus.cc:3037] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:55.252664 6155 raft_consensus.cc:2454] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:55.255033 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3148ce7d224b1c93fac811577beebf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:55.255416 6156 raft_consensus.cc:2362] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1. Re-sending same reply.
I20260928 10:43:55.256017 5990 tablet_service.cc:1467] Processing CreateTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (DEFAULT_TABLE table=default.Table_fc332e83c5a34833bb32f19aecd40642 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.256069 5992 tablet_service.cc:1467] Processing CreateTablet for tablet a765989e9ba3467f811f5fd49b67cb36 (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.256511 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c53e9be06f4d1aa0fc7eaef2c10303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.256731 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 4c93507a0bf14c8383794b34ba1702fd (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.257138 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c93507a0bf14c8383794b34ba1702fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.258821 5998 tablet_service.cc:1467] Processing CreateTablet for tablet af258604238c4e39adac40c81d5a6f3f (DEFAULT_TABLE table=default.Table_a93b5310099348c4ac165e439bb01676 [id=bb501c74345744529c7acff050952d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.259198 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af258604238c4e39adac40c81d5a6f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.262769 6280 raft_consensus.cc:482] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.262913 5997 tablet_service.cc:1467] Processing CreateTablet for tablet d103af0b1cb24cda882cc2e3d95a558d (DEFAULT_TABLE table=default.Table_6b4b8b1dcbc04c1bb40006e132b83045 [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.262959 6280 raft_consensus.cc:504] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.264936 6280 leader_election.cc:288] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.267035 6269 ts_tablet_manager.cc:1918] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.267181 6269 log.cc:1196] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/47b0cbf795354e869721f90b37c2e4dd
I20260928 10:43:55.267479 6271 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.267542 6269 ts_tablet_manager.cc:1939] T 47b0cbf795354e869721f90b37c2e4dd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.267621 6271 ts_tablet_manager.cc:1397] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.051s user 0.017s sys 0.023s
I20260928 10:43:55.268043 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a765989e9ba3467f811f5fd49b67cb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.268388 6271 raft_consensus.cc:348] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.268616 6271 raft_consensus.cc:374] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.268774 6271 raft_consensus.cc:729] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.269021 6271 consensus_queue.cc:260] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.269536 6271 ts_tablet_manager.cc:1428] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:55.269801 6271 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.270393 6136 tablet_service.cc:1467] Processing CreateTablet for tablet af258604238c4e39adac40c81d5a6f3f (DEFAULT_TABLE table=default.Table_a93b5310099348c4ac165e439bb01676 [id=bb501c74345744529c7acff050952d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.270795 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af258604238c4e39adac40c81d5a6f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.271286 6271 tablet_bootstrap.cc:654] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.272287 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 47b0cbf795354e869721f90b37c2e4dd (table default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]) successfully deleted
I20260928 10:43:55.273554 5854 tablet_service.cc:1467] Processing CreateTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (DEFAULT_TABLE table=default.Table_fc332e83c5a34833bb32f19aecd40642 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.273973 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c53e9be06f4d1aa0fc7eaef2c10303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.274797 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 4c93507a0bf14c8383794b34ba1702fd (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.275197 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c93507a0bf14c8383794b34ba1702fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.278774 6127 tablet_service.cc:1467] Processing CreateTablet for tablet d103af0b1cb24cda882cc2e3d95a558d (DEFAULT_TABLE table=default.Table_6b4b8b1dcbc04c1bb40006e132b83045 [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.279163 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d103af0b1cb24cda882cc2e3d95a558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.279623 5853 tablet_service.cc:1467] Processing CreateTablet for tablet d103af0b1cb24cda882cc2e3d95a558d (DEFAULT_TABLE table=default.Table_6b4b8b1dcbc04c1bb40006e132b83045 [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.280004 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d103af0b1cb24cda882cc2e3d95a558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.282734 5857 tablet_service.cc:1467] Processing CreateTablet for tablet a765989e9ba3467f811f5fd49b67cb36 (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.283100 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a765989e9ba3467f811f5fd49b67cb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.283212 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet d4e66a9baddd47b9a2fee6ed6c21c741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.286527 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d103af0b1cb24cda882cc2e3d95a558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.286744 5851 tablet_service.cc:1467] Processing CreateTablet for tablet af258604238c4e39adac40c81d5a6f3f (DEFAULT_TABLE table=default.Table_a93b5310099348c4ac165e439bb01676 [id=bb501c74345744529c7acff050952d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.287135 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af258604238c4e39adac40c81d5a6f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.290917 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 4c93507a0bf14c8383794b34ba1702fd (DEFAULT_TABLE table=default.Table_98456711c31840d696f42f81c5e84139 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.291320 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c93507a0bf14c8383794b34ba1702fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.291360 5817 leader_election.cc:341] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:55.298141 6280 raft_consensus.cc:482] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.298364 6280 raft_consensus.cc:504] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.299048 6280 leader_election.cc:288] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.301568 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_df02222b4af8499b8e742bf0e39201f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.302366 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df02222b4af8499b8e742bf0e39201f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.307822 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddabd402cd040f99dcf6221c01c19af" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:55.312011 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1454e1e8bea746c0883c738ba8a293b9 (table default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1454e1e8bea746c0883c738ba8a293b9 consensus state has no leader
I20260928 10:43:55.312798 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a93b5310099348c4ac165e439bb01676" } new_table_name: "default.Table_8dd83453da8241328573575754a7f39a" modify_external_catalogs: true
I20260928 10:43:55.312994 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a933de31039460087d79d408857cc58" } new_table_name: "default.Table_2f6a862b6954477fbb331f27dcfebc98" modify_external_catalogs: true
I20260928 10:43:55.313710 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_03bf7117677a45beb1e041ba0288cfd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.314162 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f6064f370434acb8fc02fda5b50ecf6 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:55.314275 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03bf7117677a45beb1e041ba0288cfd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.314309 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1098e4ad586f475b9f37c7e738c133ca" } new_table_name: "default.Table_01e7025c16c843ffb7cf7d80038d6a72" modify_external_catalogs: true
I20260928 10:43:55.315685 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_380f9d6b2da74734a9f952fa3d06cd5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.316282 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_380f9d6b2da74734a9f952fa3d06cd5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:55.318684 5817 leader_election.cc:341] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260928 10:43:55.320768 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 (DEFAULT_TABLE table=default.Table_7bf5036ca6bc40bd90328811c948501d [id=489e2ce035cb42c3ad1ed5ced42dcdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.321221 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a0adec506e4ca9b10989f18d6c0c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.323043 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d (DEFAULT_TABLE table=default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.323217 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 98566f85241c42cf92f3e131318d6efb (DEFAULT_TABLE table=default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.323555 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a424286b6e4d32a2ceb67ed6cdc02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.323771 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98566f85241c42cf92f3e131318d6efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.323709 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 98566f85241c42cf92f3e131318d6efb (DEFAULT_TABLE table=default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.324110 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98566f85241c42cf92f3e131318d6efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.324144 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 (DEFAULT_TABLE table=default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.324476 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa9fb5b11944b1b38e07bd43891773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.324970 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (DEFAULT_TABLE table=default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.325317 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.326843 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d (DEFAULT_TABLE table=default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.326851 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 (DEFAULT_TABLE table=default.Table_7bf5036ca6bc40bd90328811c948501d [id=489e2ce035cb42c3ad1ed5ced42dcdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.327241 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a424286b6e4d32a2ceb67ed6cdc02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.329931 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 (DEFAULT_TABLE table=default.Table_7bf5036ca6bc40bd90328811c948501d [id=489e2ce035cb42c3ad1ed5ced42dcdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.330374 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a0adec506e4ca9b10989f18d6c0c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.330730 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a0adec506e4ca9b10989f18d6c0c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.330789 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 (DEFAULT_TABLE table=default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.331141 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa9fb5b11944b1b38e07bd43891773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.331881 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 98566f85241c42cf92f3e131318d6efb (DEFAULT_TABLE table=default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.332257 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98566f85241c42cf92f3e131318d6efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.334724 6269 tablet_replica.cc:330] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.334770 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (DEFAULT_TABLE table=default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.334800 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 (DEFAULT_TABLE table=default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.334951 6269 raft_consensus.cc:2229] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.335126 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.335132 6269 raft_consensus.cc:2258] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.335168 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa9fb5b11944b1b38e07bd43891773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.335637 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d (DEFAULT_TABLE table=default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.335983 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a424286b6e4d32a2ceb67ed6cdc02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.339349 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (DEFAULT_TABLE table=default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.339730 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.340871 6124 tablet_service.cc:1467] Processing CreateTablet for tablet a765989e9ba3467f811f5fd49b67cb36 (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.341275 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a765989e9ba3467f811f5fd49b67cb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.341667 6269 ts_tablet_manager.cc:1905] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.342624 6284 raft_consensus.cc:482] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.342803 6284 raft_consensus.cc:504] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.344635 6284 leader_election.cc:288] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:55.347951 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_98456711c31840d696f42f81c5e84139" } new_table_name: "default.Table_9aa09945c9a547a983bc42eb499b1d73" modify_external_catalogs: true
I20260928 10:43:55.350049 6132 tablet_service.cc:1467] Processing CreateTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (DEFAULT_TABLE table=default.Table_fc332e83c5a34833bb32f19aecd40642 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.350561 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c53e9be06f4d1aa0fc7eaef2c10303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.354014 6269 ts_tablet_manager.cc:1918] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.354188 6269 log.cc:1196] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:55.356742 6269 ts_tablet_manager.cc:1939] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:43:55.357219 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af258604238c4e39adac40c81d5a6f3f consensus state has no leader
W20260928 10:43:55.357745 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f8e172c5bf406196574895e5e5e3c7 consensus state has no leader
I20260928 10:43:55.359205 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9f6064f370434acb8fc02fda5b50ecf6
W20260928 10:43:55.359277 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6aa426fd7c5444ca7db936da87d2d1c consensus state has no leader
I20260928 10:43:55.359710 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 9f6064f370434acb8fc02fda5b50ecf6 deleted and replaced by tablet 780707959e0e48d6a83b22e6479a5884
I20260928 10:43:55.360112 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1dfc37b147e442c1956550e4c7c0dbd5 (table default.Table_a4faa2e31e8642de8d2efecf770ec4dc [id=e17ee396ee584184b8562e0fc974a8a7]) successfully deleted
I20260928 10:43:55.360301 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.360307 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7a91a1339c8f4317b1d8b13835d06f96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.360590 6269 tablet_replica.cc:330] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.360662 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.360771 6269 raft_consensus.cc:2229] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.360975 6269 raft_consensus.cc:2258] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:55.360951 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a91a1339c8f4317b1d8b13835d06f96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.362257 6269 ts_tablet_manager.cc:1905] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.363941 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 72ace49431a24469bef73c596af089ae from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.364241 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1184af35f5874ebcb03cf04c2291fa78" } modify_external_catalogs: true
I20260928 10:43:55.364444 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1184af35f5874ebcb03cf04c2291fa78" } modify_external_catalogs: true
I20260928 10:43:55.364818 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 8276c29e44b54fc78844e3ef1e2e828f from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.365507 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3125378c3102451e8ae203ce70aca7fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.366091 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3125378c3102451e8ae203ce70aca7fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.366707 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b9d751ff716d42048d84fa159b5cdff7" } modify_external_catalogs: true
I20260928 10:43:55.366907 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b9d751ff716d42048d84fa159b5cdff7" } modify_external_catalogs: true
I20260928 10:43:55.366990 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 8276c29e44b54fc78844e3ef1e2e828f from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.368259 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0bfbdb2023d34addb72137cd913ed484"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.368793 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bfbdb2023d34addb72137cd913ed484 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.366101 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e8976c2b98344aeca965fa829151ead5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.373432 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8976c2b98344aeca965fa829151ead5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.374284 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddabd402cd040f99dcf6221c01c19af" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:55.374891 6273 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.375069 6273 ts_tablet_manager.cc:1397] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.143s user 0.008s sys 0.007s
W20260928 10:43:55.375846 5818 leader_election.cc:341] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: Tablet not RUNNING: STOPPED
I20260928 10:43:55.376008 5818 leader_election.cc:302] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:43:55.376411 5818 raft_consensus.cc:2670] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:43:55.379164 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c93507a0bf14c8383794b34ba1702fd consensus state has no leader
I20260928 10:43:55.385625 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3340d0272c64421c93ea8d7d1495776c" } modify_external_catalogs: true
I20260928 10:43:55.385845 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3340d0272c64421c93ea8d7d1495776c" } modify_external_catalogs: true
I20260928 10:43:55.391990 6269 ts_tablet_manager.cc:1918] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.392143 6269 log.cc:1196] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/3ddabd402cd040f99dcf6221c01c19af
I20260928 10:43:55.392552 6269 ts_tablet_manager.cc:1939] T 3ddabd402cd040f99dcf6221c01c19af P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.393136 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8358dd69e3d24743a79c681e2316dfe1
I20260928 10:43:55.393437 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1454e1e8bea746c0883c738ba8a293b9
I20260928 10:43:55.395128 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.395928 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.396314 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 72ace49431a24469bef73c596af089ae
I20260928 10:43:55.396705 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 72ace49431a24469bef73c596af089ae deleted and replaced by tablet 16f7d561b10e46609f22ce17b323fb23
I20260928 10:43:55.397363 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.397464 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.399682 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.401944 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_c7c975924ff54bd496add9760afaa6d8 [id=28c06470dcb4424282b28a9692f26039]) successfully deleted
I20260928 10:43:55.402036 6269 tablet_replica.cc:330] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.401782 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.402400 6269 raft_consensus.cc:2229] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.402630 6269 raft_consensus.cc:2258] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:55.403967 5818 leader_election.cc:341] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 1dfc37b147e442c1956550e4c7c0dbd5
I20260928 10:43:55.404129 5818 leader_election.cc:302] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:43:55.404305 5818 raft_consensus.cc:2670] T 1dfc37b147e442c1956550e4c7c0dbd5 P ab770e77cb704ea38b5ca8cff97dc73b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:43:55.405066 6269 ts_tablet_manager.cc:1905] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.406013 6273 raft_consensus.cc:348] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.406327 6273 raft_consensus.cc:374] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.406420 6273 raft_consensus.cc:729] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.406703 6273 consensus_queue.cc:260] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.408541 6273 ts_tablet_manager.cc:1428] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260928 10:43:55.408826 6273 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.410566 6273 tablet_bootstrap.cc:654] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.417698 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.126:39997
--webserver_interface=127.5.100.126
--webserver_port=38451
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 10:43:55.418432 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_10c71f17ff0344b3b76588ee83bbbf40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.419070 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10c71f17ff0344b3b76588ee83bbbf40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.419761 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a46a3766a754fdeb1a211cff00ce691" } modify_external_catalogs: true
I20260928 10:43:55.419945 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a46a3766a754fdeb1a211cff00ce691" } modify_external_catalogs: true
I20260928 10:43:55.420396 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6ca5badf760942e8a75d210cb272a622"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.420883 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ca5badf760942e8a75d210cb272a622 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.421761 6272 tablet_replica.cc:330] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.421944 6272 raft_consensus.cc:2229] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.422125 6272 raft_consensus.cc:2258] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.422542 6275 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:55.423456 6272 ts_tablet_manager.cc:1905] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.423662 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_c7c975924ff54bd496add9760afaa6d8 [id=28c06470dcb4424282b28a9692f26039]) successfully deleted
I20260928 10:43:55.424118 6275 tablet_bootstrap.cc:654] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.428490 6270 ts_tablet_manager.cc:1918] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.428660 6270 log.cc:1196] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/3ddabd402cd040f99dcf6221c01c19af
I20260928 10:43:55.429031 6270 ts_tablet_manager.cc:1939] T 3ddabd402cd040f99dcf6221c01c19af P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:55.429354 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5a89b64e0a7b43b589e7caf911836fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a89b64e0a7b43b589e7caf911836fb2 already in progress: creating tablet
I20260928 10:43:55.430336 6270 tablet_replica.cc:330] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.430506 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:55.432627 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2f6a862b6954477fbb331f27dcfebc98" } modify_external_catalogs: true
I20260928 10:43:55.432706 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a284780715684b758a03e94f637924dd" } new_table_name: "default.Table_821b0a954156457ba6d505b3d82ec1cd" modify_external_catalogs: true
I20260928 10:43:55.434019 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2f6a862b6954477fbb331f27dcfebc98" } modify_external_catalogs: true
I20260928 10:43:55.435325 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 64a424286b6e4d32a2ceb67ed6cdc02d
I20260928 10:43:55.436743 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.438278 6272 ts_tablet_manager.cc:1918] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.438525 6272 log.cc:1196] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4d3148ce7d224b1c93fac811577beebf
I20260928 10:43:55.438983 6272 ts_tablet_manager.cc:1939] T 4d3148ce7d224b1c93fac811577beebf P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.440100 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4d3148ce7d224b1c93fac811577beebf (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
W20260928 10:43:55.440943 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f4064e4b82ce49a19849a550cc252976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4064e4b82ce49a19849a550cc252976 already in progress: creating tablet
I20260928 10:43:55.441823 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 3ddabd402cd040f99dcf6221c01c19af (table default.Table_c7c975924ff54bd496add9760afaa6d8 [id=28c06470dcb4424282b28a9692f26039]) successfully deleted
W20260928 10:43:55.441797 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1447a551d9264d18bd1eeabe31b513f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1447a551d9264d18bd1eeabe31b513f1 already in progress: creating tablet
I20260928 10:43:55.442116 6272 tablet_replica.cc:330] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:43:55.442097 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f4064e4b82ce49a19849a550cc252976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4064e4b82ce49a19849a550cc252976 already in progress: creating tablet
I20260928 10:43:55.442224 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.442296 6272 raft_consensus.cc:2229] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:43:55.442328 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1447a551d9264d18bd1eeabe31b513f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1447a551d9264d18bd1eeabe31b513f1 already in progress: creating tablet
I20260928 10:43:55.442451 6272 raft_consensus.cc:2258] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.442655 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.443037 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.443357 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.443665 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.443933 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.443957 6272 ts_tablet_manager.cc:1905] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.444054 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.444252 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:55.445008 6090 leader_election.cc:341] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: d4e66a9baddd47b9a2fee6ed6c21c741
W20260928 10:43:55.445749 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c97e247cfc4547558b59a4168fa7e3b0 consensus state has no leader
I20260928 10:43:55.451634 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 64a424286b6e4d32a2ceb67ed6cdc02d from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.451990 6269 ts_tablet_manager.cc:1918] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.452184 6269 log.cc:1196] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/5573b1fc93a648d291a6d1889df5c167
I20260928 10:43:55.452531 6269 ts_tablet_manager.cc:1939] T 5573b1fc93a648d291a6d1889df5c167 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.455037 6280 raft_consensus.cc:482] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.455227 6280 raft_consensus.cc:504] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.455879 6280 leader_election.cc:288] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.456077 6275 tablet_bootstrap.cc:492] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.456262 6275 ts_tablet_manager.cc:1397] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260928 10:43:55.456488 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:55.457367 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.457672 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.457705 6275 raft_consensus.cc:348] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.457930 6275 raft_consensus.cc:374] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.458009 6275 raft_consensus.cc:729] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:43:55.458048 5818 leader_election.cc:341] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: da1e674095e74b49a276c6783d47f022
I20260928 10:43:55.458287 6275 consensus_queue.cc:260] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.459195 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.459589 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 (DEFAULT_TABLE table=default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.460027 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0aee4f49a44bb7bf19b28d96040e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.461709 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 42b522152aa44e45969f37e3f65de554 (DEFAULT_TABLE table=default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.462212 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b522152aa44e45969f37e3f65de554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.462989 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet fabde6f461124805b216a8003023b38c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.463595 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 (DEFAULT_TABLE table=default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.463984 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0aee4f49a44bb7bf19b28d96040e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.464421 6272 ts_tablet_manager.cc:1918] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.464628 6272 log.cc:1196] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d4e66a9baddd47b9a2fee6ed6c21c741
I20260928 10:43:55.465020 6272 ts_tablet_manager.cc:1939] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.465718 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d4e66a9baddd47b9a2fee6ed6c21c741 (table default.Table_926e12e8c90f4df993842f8c9537f9f0 [id=24278289701d4eeebd470d4ea107a0a8]) successfully deleted
I20260928 10:43:55.466437 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6fe4271349432db8efda609d85d611 (DEFAULT_TABLE table=default.Table_380f9d6b2da74734a9f952fa3d06cd5e [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.466868 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6fe4271349432db8efda609d85d611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.468029 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 42b522152aa44e45969f37e3f65de554 (DEFAULT_TABLE table=default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.468369 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b522152aa44e45969f37e3f65de554. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.468483 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9f6064f370434acb8fc02fda5b50ecf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6064f370434acb8fc02fda5b50ecf6 already in progress: creating tablet
W20260928 10:43:55.469348 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8358dd69e3d24743a79c681e2316dfe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8358dd69e3d24743a79c681e2316dfe1 already in progress: creating tablet
W20260928 10:43:55.470029 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 72ace49431a24469bef73c596af089ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72ace49431a24469bef73c596af089ae already in progress: creating tablet
W20260928 10:43:55.470549 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1454e1e8bea746c0883c738ba8a293b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1454e1e8bea746c0883c738ba8a293b9 already in progress: creating tablet
I20260928 10:43:55.470469 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6fe4271349432db8efda609d85d611 (DEFAULT_TABLE table=default.Table_380f9d6b2da74734a9f952fa3d06cd5e [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.471071 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6fe4271349432db8efda609d85d611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.471611 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 780707959e0e48d6a83b22e6479a5884 (DEFAULT_TABLE table=default.Table_c3422798a8284a8d8217eecc3ba83c01 [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.471861 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0f81c769b5324ca4a68134e30da7fda1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81c769b5324ca4a68134e30da7fda1 already in progress: creating tablet
I20260928 10:43:55.472100 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780707959e0e48d6a83b22e6479a5884. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.472558 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e6aa426fd7c5444ca7db936da87d2d1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aa426fd7c5444ca7db936da87d2d1c already in progress: creating tablet
W20260928 10:43:55.474120 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 64a424286b6e4d32a2ceb67ed6cdc02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a424286b6e4d32a2ceb67ed6cdc02d already in progress: creating tablet
I20260928 10:43:55.474429 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 780707959e0e48d6a83b22e6479a5884 (DEFAULT_TABLE table=default.Table_c3422798a8284a8d8217eecc3ba83c01 [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.474637 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 (DEFAULT_TABLE table=default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.474803 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780707959e0e48d6a83b22e6479a5884. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.474861 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fabde6f461124805b216a8003023b38c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fabde6f461124805b216a8003023b38c already in progress: creating tablet
I20260928 10:43:55.474992 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0aee4f49a44bb7bf19b28d96040e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.478665 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.479251 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6fe4271349432db8efda609d85d611 (DEFAULT_TABLE table=default.Table_380f9d6b2da74734a9f952fa3d06cd5e [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.479298 6091 leader_election.cc:341] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d4e66a9baddd47b9a2fee6ed6c21c741
I20260928 10:43:55.479640 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6fe4271349432db8efda609d85d611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.479579 6091 leader_election.cc:302] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:43:55.480072 6091 raft_consensus.cc:2670] T d4e66a9baddd47b9a2fee6ed6c21c741 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:43:55.481127 5817 leader_election.cc:341] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: da1e674095e74b49a276c6783d47f022
I20260928 10:43:55.481261 5817 leader_election.cc:302] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:55.481647 6280 raft_consensus.cc:2726] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:55.482939 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 42b522152aa44e45969f37e3f65de554 (DEFAULT_TABLE table=default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.483323 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b522152aa44e45969f37e3f65de554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.484794 6275 ts_tablet_manager.cc:1428] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260928 10:43:55.486217 6269 tablet_replica.cc:330] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.486392 6269 raft_consensus.cc:2229] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.486595 6269 raft_consensus.cc:2258] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.486658 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 5573b1fc93a648d291a6d1889df5c167 (table default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]) successfully deleted
I20260928 10:43:55.487322 6269 ts_tablet_manager.cc:1905] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.493829 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet fabde6f461124805b216a8003023b38c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.494222 6272 tablet_replica.cc:330] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.494387 6272 raft_consensus.cc:2229] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.494601 6272 raft_consensus.cc:2258] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.495267 6272 ts_tablet_manager.cc:1905] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.501557 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 780707959e0e48d6a83b22e6479a5884 (DEFAULT_TABLE table=default.Table_c3422798a8284a8d8217eecc3ba83c01 [id=7af448c554a042ab877113eb284d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.501947 6272 ts_tablet_manager.cc:1918] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.502091 6272 log.cc:1196] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/fabde6f461124805b216a8003023b38c
I20260928 10:43:55.502259 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780707959e0e48d6a83b22e6479a5884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.502866 6275 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:55.504751 6275 tablet_bootstrap.cc:654] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.502461 6272 ts_tablet_manager.cc:1939] T fabde6f461124805b216a8003023b38c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.507160 6270 raft_consensus.cc:2229] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:43:55.507685 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet fabde6f461124805b216a8003023b38c (table default.Table_81f66da1b0cf40238e750885aa4be575 [id=fab19738f8114aa1b33a248981b40eaf]) successfully deleted
I20260928 10:43:55.508281 6270 pending_rounds.cc:62] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:43:55.508466 6270 pending_rounds.cc:68] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265795567734784 op_type: NO_OP noop_request { }
I20260928 10:43:55.508719 6270 raft_consensus.cc:2866] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:43:55.508852 6270 raft_consensus.cc:2258] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.509213 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.510082 6270 ts_tablet_manager.cc:1905] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.514401 6271 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.514623 6271 ts_tablet_manager.cc:1397] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.245s user 0.053s sys 0.057s
I20260928 10:43:55.514401 6132 tablet_service.cc:1467] Processing CreateTablet for tablet f57cd5585604424d92b8ce2522085567 (DEFAULT_TABLE table=default.Table_6ca5badf760942e8a75d210cb272a622 [id=6c9610724d3341d193cf34cdee8780b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.515089 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57cd5585604424d92b8ce2522085567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.515441 6271 raft_consensus.cc:348] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.515695 6271 raft_consensus.cc:374] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.515779 6271 raft_consensus.cc:729] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.515914 6269 ts_tablet_manager.cc:1918] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.516074 6269 log.cc:1196] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4d3148ce7d224b1c93fac811577beebf
I20260928 10:43:55.516167 6271 consensus_queue.cc:260] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.516450 6269 ts_tablet_manager.cc:1939] T 4d3148ce7d224b1c93fac811577beebf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:55.517565 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4d3148ce7d224b1c93fac811577beebf (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
W20260928 10:43:55.518162 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5a89b64e0a7b43b589e7caf911836fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a89b64e0a7b43b589e7caf911836fb2 already in progress: creating tablet
I20260928 10:43:55.519112 5992 tablet_service.cc:1467] Processing CreateTablet for tablet f57cd5585604424d92b8ce2522085567 (DEFAULT_TABLE table=default.Table_6ca5badf760942e8a75d210cb272a622 [id=6c9610724d3341d193cf34cdee8780b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.519598 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57cd5585604424d92b8ce2522085567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.520999 6271 ts_tablet_manager.cc:1428] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 10:43:55.520951 6126 tablet_service.cc:1467] Processing CreateTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 (DEFAULT_TABLE table=default.Table_3125378c3102451e8ae203ce70aca7fa [id=d8bb5aee4ea44ee3b1eb058e062c389d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.521334 6271 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.521673 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9361a96fdc44d7ac38a1d0d812eac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.523015 6271 tablet_bootstrap.cc:654] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.525189 6275 tablet_bootstrap.cc:492] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.525360 6275 ts_tablet_manager.cc:1397] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260928 10:43:55.526338 6275 raft_consensus.cc:348] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.526662 6275 raft_consensus.cc:374] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.526780 6275 raft_consensus.cc:729] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.528761 5851 tablet_service.cc:1467] Processing CreateTablet for tablet f57cd5585604424d92b8ce2522085567 (DEFAULT_TABLE table=default.Table_6ca5badf760942e8a75d210cb272a622 [id=6c9610724d3341d193cf34cdee8780b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.529269 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57cd5585604424d92b8ce2522085567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.529767 6270 ts_tablet_manager.cc:1918] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:43:55.534714 6275 consensus_queue.cc:260] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.536300 5851 tablet_service.cc:1467] Processing CreateTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 (DEFAULT_TABLE table=default.Table_3125378c3102451e8ae203ce70aca7fa [id=d8bb5aee4ea44ee3b1eb058e062c389d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.536715 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9361a96fdc44d7ac38a1d0d812eac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.536966 6275 ts_tablet_manager.cc:1428] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20260928 10:43:55.536979 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f4064e4b82ce49a19849a550cc252976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4064e4b82ce49a19849a550cc252976 already in progress: creating tablet
I20260928 10:43:55.530010 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.534453 5998 tablet_service.cc:1467] Processing CreateTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 (DEFAULT_TABLE table=default.Table_3125378c3102451e8ae203ce70aca7fa [id=d8bb5aee4ea44ee3b1eb058e062c389d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.537252 6270 log.cc:1196] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4d3148ce7d224b1c93fac811577beebf
I20260928 10:43:55.537557 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9361a96fdc44d7ac38a1d0d812eac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.537734 6270 ts_tablet_manager.cc:1939] T 4d3148ce7d224b1c93fac811577beebf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.538882 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4d3148ce7d224b1c93fac811577beebf (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
W20260928 10:43:55.539551 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9f6064f370434acb8fc02fda5b50ecf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6064f370434acb8fc02fda5b50ecf6 already in progress: creating tablet
I20260928 10:43:55.540040 6273 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:43:55.540091 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8358dd69e3d24743a79c681e2316dfe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8358dd69e3d24743a79c681e2316dfe1 already in progress: creating tablet
I20260928 10:43:55.540189 6273 ts_tablet_manager.cc:1397] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.131s user 0.026s sys 0.033s
W20260928 10:43:55.540638 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1454e1e8bea746c0883c738ba8a293b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1454e1e8bea746c0883c738ba8a293b9 already in progress: creating tablet
I20260928 10:43:55.541011 6273 raft_consensus.cc:348] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:55.541185 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 72ace49431a24469bef73c596af089ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72ace49431a24469bef73c596af089ae already in progress: creating tablet
I20260928 10:43:55.541249 6273 raft_consensus.cc:374] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.541342 6273 raft_consensus.cc:729] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:43:55.541724 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0f81c769b5324ca4a68134e30da7fda1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81c769b5324ca4a68134e30da7fda1 already in progress: creating tablet
I20260928 10:43:55.541633 6273 consensus_queue.cc:260] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.541980 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3d035581da47abb64156066e53fa67 (DEFAULT_TABLE table=default.Table_e8976c2b98344aeca965fa829151ead5 [id=8c4d995731f94c088f6e4625446cee13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.542176 6273 ts_tablet_manager.cc:1428] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260928 10:43:55.542253 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 64a424286b6e4d32a2ceb67ed6cdc02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a424286b6e4d32a2ceb67ed6cdc02d already in progress: creating tablet
I20260928 10:43:55.542520 6273 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.544833 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.546593 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 68fe24b61d424274b407327f130bb020 (DEFAULT_TABLE table=default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.546810 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (DEFAULT_TABLE table=default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.547232 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8854c8a8e4024c6db4cb6b21d6ae021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.548629 6273 tablet_bootstrap.cc:654] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.550772 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 68fe24b61d424274b407327f130bb020 (DEFAULT_TABLE table=default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.551084 6270 tablet_replica.cc:330] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.551302 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 16f7d561b10e46609f22ce17b323fb23 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.551659 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f7d561b10e46609f22ce17b323fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.552214 6270 raft_consensus.cc:2229] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.552464 6270 raft_consensus.cc:2258] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.552449 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 16f7d561b10e46609f22ce17b323fb23 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.552883 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 0acf2685688e4e108bba66842acedbb9 (DEFAULT_TABLE table=default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.553130 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a40da10504c60a793672dcb7b3510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.553725 6270 ts_tablet_manager.cc:1905] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.554803 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 0acf2685688e4e108bba66842acedbb9 (DEFAULT_TABLE table=default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.555168 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0acf2685688e4e108bba66842acedbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.555580 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.555958 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8854c8a8e4024c6db4cb6b21d6ae021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.558677 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.558828 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (DEFAULT_TABLE table=default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.559090 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 68fe24b61d424274b407327f130bb020 (DEFAULT_TABLE table=default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.559228 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.559444 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fe24b61d424274b407327f130bb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.559756 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 16f7d561b10e46609f22ce17b323fb23 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.560066 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f7d561b10e46609f22ce17b323fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.560774 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3d035581da47abb64156066e53fa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.560779 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 0acf2685688e4e108bba66842acedbb9 (DEFAULT_TABLE table=default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.561149 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0acf2685688e4e108bba66842acedbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.563460 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fe24b61d424274b407327f130bb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.566990 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.567417 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8854c8a8e4024c6db4cb6b21d6ae021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.572613 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9aa09945c9a547a983bc42eb499b1d73" } new_table_name: "default.Table_513e423be442478eb2ff886b474898a8" modify_external_catalogs: true
I20260928 10:43:55.572988 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3125378c3102451e8ae203ce70aca7fa" } new_table_name: "default.Table_8d69020f569a4208a60acea45b7b2b0b" modify_external_catalogs: true
I20260928 10:43:55.573786 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f7d561b10e46609f22ce17b323fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.574066 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d4d54f17acbc4c6d9e9139a000472a59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.574426 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3d035581da47abb64156066e53fa67 (DEFAULT_TABLE table=default.Table_e8976c2b98344aeca965fa829151ead5 [id=8c4d995731f94c088f6e4625446cee13]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.574625 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4d54f17acbc4c6d9e9139a000472a59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.574816 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3d035581da47abb64156066e53fa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.575698 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 8276c29e44b54fc78844e3ef1e2e828f from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:55.577725 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e6aa426fd7c5444ca7db936da87d2d1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aa426fd7c5444ca7db936da87d2d1c already in progress: creating tablet
I20260928 10:43:55.578722 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0acf2685688e4e108bba66842acedbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.574090 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1696a82ccb5c45d9a154583fc88be5ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.579339 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1696a82ccb5c45d9a154583fc88be5ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.572729 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6ca5badf760942e8a75d210cb272a622" } new_table_name: "default.Table_333faec6e5864a4982d5c0743c880176" modify_external_catalogs: true
I20260928 10:43:55.583809 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.586284 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf9361a96fdc44d7ac38a1d0d812eac0 consensus state has no leader
I20260928 10:43:55.588665 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_401439ae18274d0b922ac1bb235ee300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.589218 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_401439ae18274d0b922ac1bb235ee300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.594606 6272 tablet_replica.cc:330] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.594897 6272 raft_consensus.cc:2229] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.595108 6272 raft_consensus.cc:2258] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.595570 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3d035581da47abb64156066e53fa67 (DEFAULT_TABLE table=default.Table_e8976c2b98344aeca965fa829151ead5 [id=8c4d995731f94c088f6e4625446cee13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.595695 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet e36c690a640541e5ba33b67914656bbc from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.596361 6272 ts_tablet_manager.cc:1905] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.596673 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_51182a736d85419b988e29c595a08051"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.596963 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (DEFAULT_TABLE table=default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.597183 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51182a736d85419b988e29c595a08051 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.598374 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6b4b8b1dcbc04c1bb40006e132b83045" } new_table_name: "default.Table_1afd47c3d1274725a90186611c2d3414" modify_external_catalogs: true
I20260928 10:43:55.601676 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.603719 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f411d60097904229877bc64f248a45c5" } modify_external_catalogs: true
I20260928 10:43:55.603960 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f411d60097904229877bc64f248a45c5" } modify_external_catalogs: true
I20260928 10:43:55.604571 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bd7053e67266490cba88d524556fed3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.605119 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd7053e67266490cba88d524556fed3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.605878 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3d035581da47abb64156066e53fa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.606722 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df02222b4af8499b8e742bf0e39201f0" } modify_external_catalogs: true
I20260928 10:43:55.606940 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df02222b4af8499b8e742bf0e39201f0" } modify_external_catalogs: true
I20260928 10:43:55.607604 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 345245f9349a4031af5ff278a3da74f0 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:55.610402 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f57cd5585604424d92b8ce2522085567 consensus state has no leader
I20260928 10:43:55.610884 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fe24b61d424274b407327f130bb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.620078 6272 ts_tablet_manager.cc:1918] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.620234 6272 log.cc:1196] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/fa3a40da10504c60a793672dcb7b3510
I20260928 10:43:55.620563 6272 ts_tablet_manager.cc:1939] T fa3a40da10504c60a793672dcb7b3510 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.621220 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet fa3a40da10504c60a793672dcb7b3510 (table default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]) successfully deleted
I20260928 10:43:55.622520 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_affa419abdd1427c95a8092f6e4b6337"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.623138 6275 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:43:55.623237 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_affa419abdd1427c95a8092f6e4b6337 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.624578 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_96174d1bf9934bcf8ca2a0000012d955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.624809 6275 tablet_bootstrap.cc:654] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.624840 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_30b367f1c2f348008ce1ac1ea284079d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.625064 6270 ts_tablet_manager.cc:1918] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.625214 6270 log.cc:1196] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/262c99c38fd84443a5d9440ec5c33d07
W20260928 10:43:55.625192 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96174d1bf9934bcf8ca2a0000012d955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:55.625466 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30b367f1c2f348008ce1ac1ea284079d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.625728 6269 tablet_replica.cc:330] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:43:55.625825 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1447a551d9264d18bd1eeabe31b513f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1447a551d9264d18bd1eeabe31b513f1 already in progress: creating tablet
I20260928 10:43:55.625939 6269 raft_consensus.cc:2229] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.626121 6269 raft_consensus.cc:2258] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.626984 6269 ts_tablet_manager.cc:1905] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.631557 6271 tablet_bootstrap.cc:492] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
W20260928 10:43:55.631665 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c93507a0bf14c8383794b34ba1702fd consensus state has no leader
I20260928 10:43:55.631740 6271 ts_tablet_manager.cc:1397] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.011s
I20260928 10:43:55.632503 6271 raft_consensus.cc:348] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.632769 6271 raft_consensus.cc:374] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.632855 6271 raft_consensus.cc:729] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.633109 6271 consensus_queue.cc:260] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.634533 6271 ts_tablet_manager.cc:1428] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:55.634848 6271 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.635402 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 42b522152aa44e45969f37e3f65de554 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.639599 6270 ts_tablet_manager.cc:1939] T 262c99c38fd84443a5d9440ec5c33d07 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.640776 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 262c99c38fd84443a5d9440ec5c33d07 (table default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]) successfully deleted
I20260928 10:43:55.641026 6275 tablet_bootstrap.cc:492] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.641229 6270 tablet_replica.cc:330] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.641239 6275 ts_tablet_manager.cc:1397] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.006s
I20260928 10:43:55.641525 6270 raft_consensus.cc:2229] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.641729 6270 raft_consensus.cc:2258] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.642017 6275 raft_consensus.cc:348] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.642270 6275 raft_consensus.cc:374] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.642354 6275 raft_consensus.cc:729] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.642679 6275 consensus_queue.cc:260] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.643280 6271 tablet_bootstrap.cc:654] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.644796 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fcec98a0395342cd9e7ec57bf2fdb801"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.645150 6275 ts_tablet_manager.cc:1428] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260928 10:43:55.643806 6270 ts_tablet_manager.cc:1905] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:55.645404 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcec98a0395342cd9e7ec57bf2fdb801 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.646544 6275 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:43:55.646713 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d103af0b1cb24cda882cc2e3d95a558d consensus state has no leader
I20260928 10:43:55.648036 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 47b0cbf795354e869721f90b37c2e4dd with delete_type TABLET_DATA_DELETED (replaced by tablet e36c690a640541e5ba33b67914656bbc) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.648363 6275 tablet_bootstrap.cc:654] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.649158 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a50c6af88ced410e9224954bc1aaf5f3" } modify_external_catalogs: true
I20260928 10:43:55.649391 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a50c6af88ced410e9224954bc1aaf5f3" } modify_external_catalogs: true
I20260928 10:43:55.653236 6270 ts_tablet_manager.cc:1918] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.656821 6275 tablet_bootstrap.cc:492] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:55.657011 6275 ts_tablet_manager.cc:1397] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260928 10:43:55.657881 6275 raft_consensus.cc:348] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.658187 6275 raft_consensus.cc:374] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.658298 6275 raft_consensus.cc:729] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.658576 6275 consensus_queue.cc:260] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.662253 6275 ts_tablet_manager.cc:1428] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:43:55.666671 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_60470bf7130b4650bf7042a36ed9fb00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.667367 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60470bf7130b4650bf7042a36ed9fb00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.667313 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_10c71f17ff0344b3b76588ee83bbbf40" } modify_external_catalogs: true
I20260928 10:43:55.667670 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_10c71f17ff0344b3b76588ee83bbbf40" } modify_external_catalogs: true
I20260928 10:43:55.670172 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.670562 6272 tablet_replica.cc:330] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.670612 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f3c978eb1427452db9394321922710b9" } new_table_name: "default.Table_51b6797b284b4bab9e23e290a53926fc" modify_external_catalogs: true
I20260928 10:43:55.670694 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51182a736d85419b988e29c595a08051" } modify_external_catalogs: true
I20260928 10:43:55.670746 6272 raft_consensus.cc:2229] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.670847 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51182a736d85419b988e29c595a08051" } modify_external_catalogs: true
I20260928 10:43:55.670933 6272 raft_consensus.cc:2258] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.671917 6272 ts_tablet_manager.cc:1905] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.672360 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 7dba507179ed44ce903111622ec1fb42 (DEFAULT_TABLE table=default.Table_d4d54f17acbc4c6d9e9139a000472a59 [id=4c0912577f204df2a369e5a7be835b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.672750 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dba507179ed44ce903111622ec1fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.673568 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 8854c8a8e4024c6db4cb6b21d6ae021f from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.674216 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 7dba507179ed44ce903111622ec1fb42 (DEFAULT_TABLE table=default.Table_d4d54f17acbc4c6d9e9139a000472a59 [id=4c0912577f204df2a369e5a7be835b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.674652 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dba507179ed44ce903111622ec1fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.677165 6275 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:55.678790 6275 tablet_bootstrap.cc:654] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.679075 6272 ts_tablet_manager.cc:1918] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.679207 6272 log.cc:1196] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:55.679567 6272 ts_tablet_manager.cc:1939] T 262c99c38fd84443a5d9440ec5c33d07 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.680501 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 262c99c38fd84443a5d9440ec5c33d07 (table default.Table_5a934a446a0444ffbb5abbb64cdb49ea [id=870d12c0e66444658241489b86452ddf]) successfully deleted
I20260928 10:43:55.681634 6273 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.681802 6273 ts_tablet_manager.cc:1397] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.139s user 0.010s sys 0.007s
I20260928 10:43:55.682618 6273 raft_consensus.cc:348] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.682860 6273 raft_consensus.cc:374] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.682936 6273 raft_consensus.cc:729] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.683202 6273 consensus_queue.cc:260] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.684232 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 5573b1fc93a648d291a6d1889df5c167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.684499 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 262c99c38fd84443a5d9440ec5c33d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:55.686703 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2693b378215f425bb1c2e3e0963aac95 consensus state has no leader
I20260928 10:43:55.688481 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 68e1b25f634e48008f5262aed44010da (DEFAULT_TABLE table=default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.688915 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e1b25f634e48008f5262aed44010da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.697440 6272 tablet_replica.cc:330] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:55.697747 6272 raft_consensus.cc:2229] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.697839 6128 tablet_service.cc:1467] Processing CreateTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e (DEFAULT_TABLE table=default.Table_affa419abdd1427c95a8092f6e4b6337 [id=1e94990c87d944c696ef7e171c5f09bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.697991 6272 raft_consensus.cc:2258] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.692605 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca (DEFAULT_TABLE table=default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.698284 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa971239a2b4ac6bc309dfbacdbe12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.692632 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8abd00f2742a29fdc79059332b91d (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.656822 6269 ts_tablet_manager.cc:1918] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.698796 6270 log.cc:1196] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/fa3a40da10504c60a793672dcb7b3510
I20260928 10:43:55.699168 6270 ts_tablet_manager.cc:1939] T fa3a40da10504c60a793672dcb7b3510 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.700196 6270 tablet_replica.cc:330] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.700356 6270 raft_consensus.cc:2229] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.700546 6270 raft_consensus.cc:2258] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.657765 6271 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.669068 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 7dba507179ed44ce903111622ec1fb42 (DEFAULT_TABLE table=default.Table_d4d54f17acbc4c6d9e9139a000472a59 [id=4c0912577f204df2a369e5a7be835b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.700837 6271 ts_tablet_manager.cc:1397] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.004s
I20260928 10:43:55.698454 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65905f0cb4154bdcb8ee6702c87d23ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.701087 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dba507179ed44ce903111622ec1fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.701653 6271 raft_consensus.cc:348] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.701952 6271 raft_consensus.cc:374] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.702023 6271 raft_consensus.cc:729] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.702244 6271 consensus_queue.cc:260] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.693624 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 68e1b25f634e48008f5262aed44010da (DEFAULT_TABLE table=default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.694041 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca (DEFAULT_TABLE table=default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.694340 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8abd00f2742a29fdc79059332b91d (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.696352 6000 tablet_service.cc:1467] Processing CreateTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e (DEFAULT_TABLE table=default.Table_affa419abdd1427c95a8092f6e4b6337 [id=1e94990c87d944c696ef7e171c5f09bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.696756 5999 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9c61d774437ea873fdc6e1c93486 (DEFAULT_TABLE table=default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.703338 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e1b25f634e48008f5262aed44010da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.703935 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet fa3a40da10504c60a793672dcb7b3510 (table default.Table_7d207595db5e40998a0639222018923a [id=15f9acc2a330443fbea63c78e8f40681]) successfully deleted
I20260928 10:43:55.706640 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8abd00f2742a29fdc79059332b91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.706895 6123 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9c61d774437ea873fdc6e1c93486 (DEFAULT_TABLE table=default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.707284 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9c61d774437ea873fdc6e1c93486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.707245 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:55.693024 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 68e1b25f634e48008f5262aed44010da (DEFAULT_TABLE table=default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.696348 5853 tablet_service.cc:1467] Processing CreateTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e (DEFAULT_TABLE table=default.Table_affa419abdd1427c95a8092f6e4b6337 [id=1e94990c87d944c696ef7e171c5f09bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.696734 5858 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9c61d774437ea873fdc6e1c93486 (DEFAULT_TABLE table=default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.711836 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e1b25f634e48008f5262aed44010da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.714151 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9c61d774437ea873fdc6e1c93486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.714619 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8abd00f2742a29fdc79059332b91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.714674 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa971239a2b4ac6bc309dfbacdbe12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.718084 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9c61d774437ea873fdc6e1c93486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.722985 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa971239a2b4ac6bc309dfbacdbe12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.726851 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65905f0cb4154bdcb8ee6702c87d23ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.727057 6272 ts_tablet_manager.cc:1905] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.734262 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.735347 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 42b522152aa44e45969f37e3f65de554
I20260928 10:43:55.735829 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 42b522152aa44e45969f37e3f65de554 deleted and replaced by tablet 5038afab3d7c413a97b6d1b401af0537
I20260928 10:43:55.737500 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet fb061a69c1ea4464a1db06c8a20999ab
I20260928 10:43:55.737969 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8854c8a8e4024c6db4cb6b21d6ae021f
I20260928 10:43:55.738081 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (replaced by tablet 5038afab3d7c413a97b6d1b401af0537) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.738366 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 8854c8a8e4024c6db4cb6b21d6ae021f deleted and replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d
I20260928 10:43:55.738725 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 65905f0cb4154bdcb8ee6702c87d23ca
I20260928 10:43:55.738971 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (replaced by tablet 5038afab3d7c413a97b6d1b401af0537) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.739143 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0acf2685688e4e108bba66842acedbb9
I20260928 10:43:55.739212 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.739341 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6c7a51b960f24a2fbc3f0e851c98b9f9
I20260928 10:43:55.740056 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 345245f9349a4031af5ff278a3da74f0
I20260928 10:43:55.740366 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 345245f9349a4031af5ff278a3da74f0 deleted and replaced by tablet 97e20784940a4647a220ad74e3e15f83
I20260928 10:43:55.740540 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.742681 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.742772 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.742972 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.743010 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.743026 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (replaced by tablet 5038afab3d7c413a97b6d1b401af0537) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.743193 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.743415 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.744002 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.744591 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.745280 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca (DEFAULT_TABLE table=default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.745700 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65905f0cb4154bdcb8ee6702c87d23ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.747062 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.747153 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.749831 5698 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5038afab3d7c413a97b6d1b401af0537
I20260928 10:43:55.750519 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8abd00f2742a29fdc79059332b91d (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.751019 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8abd00f2742a29fdc79059332b91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.698544 6273 ts_tablet_manager.cc:1428] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260928 10:43:55.760309 6273 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.761931 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.762418 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ea33fe07f324842823f5f69dcbeec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.762431 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:55.764097 6272 ts_tablet_manager.cc:1918] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.764429 6272 log.cc:1196] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/5573b1fc93a648d291a6d1889df5c167
I20260928 10:43:55.765031 6272 ts_tablet_manager.cc:1939] T 5573b1fc93a648d291a6d1889df5c167 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:55.767313 6271 ts_tablet_manager.cc:1428] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260928 10:43:55.767966 6271 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.769217 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 1677f971c9384d519f1ce94da1b7ef2a (DEFAULT_TABLE table=default.Table_30b367f1c2f348008ce1ac1ea284079d [id=688359adeeea4de79516ab81770bb710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.769610 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1677f971c9384d519f1ce94da1b7ef2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.771534 6136 tablet_service.cc:1467] Processing CreateTablet for tablet c4528bf643664da29496849c94e6dd2e (DEFAULT_TABLE table=default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.771574 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 5573b1fc93a648d291a6d1889df5c167 (table default.Table_5d91731b21b84051a5e0bb11ac43301b [id=6cc1c75c78e6494faf9264a3b45dca3f]) successfully deleted
I20260928 10:43:55.771741 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1677f971c9384d519f1ce94da1b7ef2a (DEFAULT_TABLE table=default.Table_30b367f1c2f348008ce1ac1ea284079d [id=688359adeeea4de79516ab81770bb710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.771922 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4528bf643664da29496849c94e6dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.772147 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1677f971c9384d519f1ce94da1b7ef2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.774364 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d (DEFAULT_TABLE table=default.Table_fcec98a0395342cd9e7ec57bf2fdb801 [id=8780ec83a2e047bb8d762c1bc472e96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.774755 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6f7476c814e0a9abf56b23c1e547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.776875 6280 raft_consensus.cc:482] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.777057 6280 raft_consensus.cc:504] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.777652 6271 tablet_bootstrap.cc:654] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.777709 6280 leader_election.cc:288] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:43:55.778218 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 262c99c38fd84443a5d9440ec5c33d07 because the tablet was not found. No further retry: Not found: Tablet not found: 262c99c38fd84443a5d9440ec5c33d07
I20260928 10:43:55.778442 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8276c29e44b54fc78844e3ef1e2e828f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:55.778546 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8276c29e44b54fc78844e3ef1e2e828f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:55.779184 6270 ts_tablet_manager.cc:1905] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:55.779413 5818 leader_election.cc:341] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:55.779680 5817 leader_election.cc:341] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:55.779789 5817 leader_election.cc:302] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:55.780131 6280 raft_consensus.cc:2726] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:55.780697 5851 tablet_service.cc:1467] Processing CreateTablet for tablet c4528bf643664da29496849c94e6dd2e (DEFAULT_TABLE table=default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.781075 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4528bf643664da29496849c94e6dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.784767 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d (DEFAULT_TABLE table=default.Table_fcec98a0395342cd9e7ec57bf2fdb801 [id=8780ec83a2e047bb8d762c1bc472e96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.785132 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6f7476c814e0a9abf56b23c1e547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.787031 6271 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.787175 6271 ts_tablet_manager.cc:1397] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
W20260928 10:43:55.787182 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fb061a69c1ea4464a1db06c8a20999ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb061a69c1ea4464a1db06c8a20999ab already in progress: creating tablet
W20260928 10:43:55.787866 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8854c8a8e4024c6db4cb6b21d6ae021f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8854c8a8e4024c6db4cb6b21d6ae021f already in progress: creating tablet
I20260928 10:43:55.787891 6271 raft_consensus.cc:348] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.788111 6271 raft_consensus.cc:374] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.788199 6271 raft_consensus.cc:729] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.788429 6271 consensus_queue.cc:260] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.789073 6271 ts_tablet_manager.cc:1428] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:55.789381 6271 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:43:55.790649 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0acf2685688e4e108bba66842acedbb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0acf2685688e4e108bba66842acedbb9 already in progress: creating tablet
I20260928 10:43:55.791008 6271 tablet_bootstrap.cc:654] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.791122 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:55.793107 6270 ts_tablet_manager.cc:1918] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.793236 6270 log.cc:1196] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/47b0cbf795354e869721f90b37c2e4dd
I20260928 10:43:55.793569 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:55.793612 6270 ts_tablet_manager.cc:1939] T 47b0cbf795354e869721f90b37c2e4dd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:55.794296 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 345245f9349a4031af5ff278a3da74f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345245f9349a4031af5ff278a3da74f0 already in progress: creating tablet
I20260928 10:43:55.796749 6270 tablet_replica.cc:330] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.796952 6270 raft_consensus.cc:2229] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.797608 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 97e20784940a4647a220ad74e3e15f83 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.797664 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fcec98a0395342cd9e7ec57bf2fdb801" } new_table_name: "default.Table_d567147d0d8c4ca4a12c66f2646477de" modify_external_catalogs: true
I20260928 10:43:55.798148 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e20784940a4647a220ad74e3e15f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.798933 6270 raft_consensus.cc:2258] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.802459 6270 ts_tablet_manager.cc:1905] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.802676 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.803125 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99202cf0cfac40b2aa54b10b4d96939d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.805166 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_19a3d99bd33d4f939d10a3b861a5a0cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.805814 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a3d99bd33d4f939d10a3b861a5a0cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:55.808323 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10f6f7476c814e0a9abf56b23c1e547d consensus state has no leader
I20260928 10:43:55.811110 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.812443 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.812760 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.813050 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.813232 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.813702 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.814335 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.815095 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.815109 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2a4469260e874ea99c6bafe3bee0a05d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.815495 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ea33fe07f324842823f5f69dcbeec2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.815688 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a4469260e874ea99c6bafe3bee0a05d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.817386 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.818030 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 65905f0cb4154bdcb8ee6702c87d23ca because the tablet was not found. No further retry: Not found: Tablet not found: 65905f0cb4154bdcb8ee6702c87d23ca
W20260928 10:43:55.818367 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 already in progress: creating tablet
I20260928 10:43:55.819653 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_380f9d6b2da74734a9f952fa3d06cd5e" } new_table_name: "default.Table_b6a8b78145f2494aa8b0e49415c15f9d" modify_external_catalogs: true
I20260928 10:43:55.820613 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0606bc40e4ad443f9425df4c28ca89bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.822553 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0606bc40e4ad443f9425df4c28ca89bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.822528 5992 tablet_service.cc:1467] Processing CreateTablet for tablet c4528bf643664da29496849c94e6dd2e (DEFAULT_TABLE table=default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.822944 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4528bf643664da29496849c94e6dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.825944 6271 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.826124 6271 ts_tablet_manager.cc:1397] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260928 10:43:55.826977 6271 raft_consensus.cc:348] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.827232 6271 raft_consensus.cc:374] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.827322 6271 raft_consensus.cc:729] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.827353 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 1677f971c9384d519f1ce94da1b7ef2a (DEFAULT_TABLE table=default.Table_30b367f1c2f348008ce1ac1ea284079d [id=688359adeeea4de79516ab81770bb710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.827731 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1677f971c9384d519f1ce94da1b7ef2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.827596 6271 consensus_queue.cc:260] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.833632 6271 ts_tablet_manager.cc:1428] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
W20260928 10:43:55.835232 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f6fe4271349432db8efda609d85d611 consensus state has no leader
I20260928 10:43:55.837682 6271 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.837766 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7a91a1339c8f4317b1d8b13835d06f96" } new_table_name: "default.Table_f4bc1e73b1804c52ad90b1c61738b77c" modify_external_catalogs: true
I20260928 10:43:55.838811 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 97e20784940a4647a220ad74e3e15f83 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.839846 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d (DEFAULT_TABLE table=default.Table_7a91a1339c8f4317b1d8b13835d06f96 [id=1d83f40c8ad34f4188d45dde57de2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.839977 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e20784940a4647a220ad74e3e15f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.842379 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e (DEFAULT_TABLE table=default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.842963 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427b96ce675d48629fcbf8bbcf6e500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.844008 6270 ts_tablet_manager.cc:1918] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:43:55.845875 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99202cf0cfac40b2aa54b10b4d96939d consensus state has no leader
I20260928 10:43:55.848140 6271 tablet_bootstrap.cc:654] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.850167 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99202cf0cfac40b2aa54b10b4d96939d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.850761 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8dd83453da8241328573575754a7f39a" } new_table_name: "default.Table_9af467c9f80a4119845169339a5d6994" modify_external_catalogs: true
I20260928 10:43:55.852870 6270 log.cc:1196] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e36c690a640541e5ba33b67914656bbc
I20260928 10:43:55.853304 6270 ts_tablet_manager.cc:1939] T e36c690a640541e5ba33b67914656bbc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.853344 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c2164ee9e1054e77849d3bcd8c58ccba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.854166 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2164ee9e1054e77849d3bcd8c58ccba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.855424 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e (DEFAULT_TABLE table=default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.856058 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 97e20784940a4647a220ad74e3e15f83 (DEFAULT_TABLE table=default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.860155 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99202cf0cfac40b2aa54b10b4d96939d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.860594 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427b96ce675d48629fcbf8bbcf6e500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.860497 6132 tablet_service.cc:1467] Processing CreateTablet for tablet ab1277e4c47141ea9480987eef715528 (DEFAULT_TABLE table=default.Table_0606bc40e4ad443f9425df4c28ca89bf [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:55.862416 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af258604238c4e39adac40c81d5a6f3f consensus state has no leader
I20260928 10:43:55.862339 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d (DEFAULT_TABLE table=default.Table_fcec98a0395342cd9e7ec57bf2fdb801 [id=8780ec83a2e047bb8d762c1bc472e96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.862846 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6f7476c814e0a9abf56b23c1e547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.863282 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab1277e4c47141ea9480987eef715528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.866638 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet a765989e9ba3467f811f5fd49b67cb36 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.871351 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_99c3d74372144df784a9e24934534a4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.871639 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_03aaae30a2054fa09078e7fd2d90d84b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.871944 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99c3d74372144df784a9e24934534a4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:55.872095 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03aaae30a2054fa09078e7fd2d90d84b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.873584 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 72ace49431a24469bef73c596af089ae from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:55.873903 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97e20784940a4647a220ad74e3e15f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.875440 5854 tablet_service.cc:1467] Processing CreateTablet for tablet ab1277e4c47141ea9480987eef715528 (DEFAULT_TABLE table=default.Table_0606bc40e4ad443f9425df4c28ca89bf [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.875831 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab1277e4c47141ea9480987eef715528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.877965 6281 raft_consensus.cc:482] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.878121 6281 raft_consensus.cc:504] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.879045 6281 leader_election.cc:288] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.879174 6281 raft_consensus.cc:482] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:55.879125 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 (DEFAULT_TABLE table=default.Table_2a4469260e874ea99c6bafe3bee0a05d [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.879297 6281 raft_consensus.cc:504] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.879492 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0563f8c31f7d43b3b703593dbc562ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.879758 6281 leader_election.cc:288] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:55.880131 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 (DEFAULT_TABLE table=default.Table_2a4469260e874ea99c6bafe3bee0a05d [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.880465 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0563f8c31f7d43b3b703593dbc562ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.881174 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3dee98906e7e474cb198741b880a15be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.881668 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dee98906e7e474cb198741b880a15be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.885092 6271 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.885416 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1f1c12917895471e83d800259d4e5e19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:55.885478 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_988cda94a8534a31a8c65d221e16833f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.885944 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f1c12917895471e83d800259d4e5e19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.886107 6271 ts_tablet_manager.cc:1397] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.001s
I20260928 10:43:55.887046 6271 raft_consensus.cc:348] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.887274 6271 raft_consensus.cc:374] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.887360 6271 raft_consensus.cc:729] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:43:55.885968 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_988cda94a8534a31a8c65d221e16833f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.887591 6271 consensus_queue.cc:260] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.888093 6271 ts_tablet_manager.cc:1428] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:55.888288 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ea33fe07f324842823f5f69dcbeec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.889492 6271 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.889561 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:55.889783 5884 raft_consensus.cc:2454] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:43:55.889917 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5fc914143e40cebf6603bbc1b3195e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:55.890799 5957 leader_election.cc:302] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:55.891000 6271 tablet_bootstrap.cc:654] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.891423 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_821b0a954156457ba6d505b3d82ec1cd" } new_table_name: "default.Table_77e918f53d394bb49798bb0ca568f95f" modify_external_catalogs: true
I20260928 10:43:55.891387 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4938837463c94e6787ec7868085a9b35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:55.891942 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4938837463c94e6787ec7868085a9b35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:55.891950 6281 raft_consensus.cc:2781] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:55.892036 6281 raft_consensus.cc:482] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:55.892159 6281 raft_consensus.cc:3037] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:55.698684 6269 log.cc:1196] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/da1e674095e74b49a276c6783d47f022
I20260928 10:43:55.894634 6269 ts_tablet_manager.cc:1939] T da1e674095e74b49a276c6783d47f022 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:43:55.894773 5957 leader_election.cc:341] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:55.895243 6281 raft_consensus.cc:504] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.896277 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:55.896472 5883 raft_consensus.cc:3037] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:55.897019 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet da1e674095e74b49a276c6783d47f022 (table default.Table_f3a8de38e6724611959147a8c3b8d29b [id=add157aeb5784ac8bcc1979e47e5a630]) successfully deleted
W20260928 10:43:55.897365 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9f6064f370434acb8fc02fda5b50ecf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6064f370434acb8fc02fda5b50ecf6 already in progress: creating tablet
W20260928 10:43:55.897682 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8358dd69e3d24743a79c681e2316dfe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8358dd69e3d24743a79c681e2316dfe1 already in progress: creating tablet
I20260928 10:43:55.899408 5883 raft_consensus.cc:2454] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:55.899922 5957 leader_election.cc:302] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:55.900803 6281 leader_election.cc:288] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:55.900858 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a765989e9ba3467f811f5fd49b67cb36
I20260928 10:43:55.901312 6281 raft_consensus.cc:2781] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:55.901688 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.901731 6281 raft_consensus.cc:686] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:55.902232 6281 consensus_queue.cc:237] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:55.902604 5698 catalog_manager.cc:6565] ReplaceTablet: tablet a765989e9ba3467f811f5fd49b67cb36 deleted and replaced by tablet 971f8344436f4e60ac0152e811efea8d
I20260928 10:43:55.903548 6273 tablet_bootstrap.cc:654] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:55.913338 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 72ace49431a24469bef73c596af089ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72ace49431a24469bef73c596af089ae already in progress: creating tablet
W20260928 10:43:55.913719 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1454e1e8bea746c0883c738ba8a293b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1454e1e8bea746c0883c738ba8a293b9 already in progress: creating tablet
W20260928 10:43:55.916671 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c97e247cfc4547558b59a4168fa7e3b0 consensus state has no leader
W20260928 10:43:55.917135 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 64a424286b6e4d32a2ceb67ed6cdc02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a424286b6e4d32a2ceb67ed6cdc02d already in progress: creating tablet
W20260928 10:43:55.918188 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0f81c769b5324ca4a68134e30da7fda1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81c769b5324ca4a68134e30da7fda1 already in progress: creating tablet
W20260928 10:43:55.918455 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e6aa426fd7c5444ca7db936da87d2d1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aa426fd7c5444ca7db936da87d2d1c already in progress: creating tablet
W20260928 10:43:55.923345 5687 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.126:39997, user_credentials={real_user=slave}} blocked reactor thread for 84834.2us
I20260928 10:43:55.924327 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 47b0cbf795354e869721f90b37c2e4dd (table default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]) successfully deleted
I20260928 10:43:55.924966 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e36c690a640541e5ba33b67914656bbc (table default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]) successfully deleted
W20260928 10:43:55.925449 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet fb061a69c1ea4464a1db06c8a20999ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb061a69c1ea4464a1db06c8a20999ab already in progress: creating tablet
W20260928 10:43:55.925805 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8854c8a8e4024c6db4cb6b21d6ae021f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8854c8a8e4024c6db4cb6b21d6ae021f already in progress: creating tablet
W20260928 10:43:55.926147 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 65905f0cb4154bdcb8ee6702c87d23ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65905f0cb4154bdcb8ee6702c87d23ca already in progress: creating tablet
W20260928 10:43:55.926395 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0acf2685688e4e108bba66842acedbb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0acf2685688e4e108bba66842acedbb9 already in progress: creating tablet
W20260928 10:43:55.926726 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 already in progress: creating tablet
W20260928 10:43:55.926966 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 345245f9349a4031af5ff278a3da74f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345245f9349a4031af5ff278a3da74f0 already in progress: creating tablet
I20260928 10:43:55.927649 6271 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.927834 6271 ts_tablet_manager.cc:1397] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260928 10:43:55.928216 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.928547 6270 tablet_replica.cc:330] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:55.928737 6270 raft_consensus.cc:2229] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.928858 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:55.928968 6270 raft_consensus.cc:2258] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.929181 6000 tablet_service.cc:1467] Processing CreateTablet for tablet ab1277e4c47141ea9480987eef715528 (DEFAULT_TABLE table=default.Table_0606bc40e4ad443f9425df4c28ca89bf [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.929370 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e (DEFAULT_TABLE table=default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.929605 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab1277e4c47141ea9480987eef715528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.930105 6270 ts_tablet_manager.cc:1905] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.930859 6269 tablet_replica.cc:330] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:55.931056 6269 raft_consensus.cc:2229] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:55.931244 6269 raft_consensus.cc:2258] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:55.932051 6269 ts_tablet_manager.cc:1905] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:55.934649 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427b96ce675d48629fcbf8bbcf6e500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.935648 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 (DEFAULT_TABLE table=default.Table_2a4469260e874ea99c6bafe3bee0a05d [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.935709 5857 tablet_service.cc:1467] Processing CreateTablet for tablet e40f72ff466e4befb74290fd39285119 (DEFAULT_TABLE table=default.Table_99c3d74372144df784a9e24934534a4a [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.936093 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0563f8c31f7d43b3b703593dbc562ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.936134 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f72ff466e4befb74290fd39285119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.938849 5854 tablet_service.cc:1467] Processing CreateTablet for tablet b2d841c2f9b844208173f982b9eb7818 (DEFAULT_TABLE table=default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.939294 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d841c2f9b844208173f982b9eb7818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.943784 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_03bf7117677a45beb1e041ba0288cfd8" } modify_external_catalogs: true
I20260928 10:43:55.944041 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_03bf7117677a45beb1e041ba0288cfd8" } modify_external_catalogs: true
I20260928 10:43:55.944612 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6d8b6b9f7f18477e8cf57a7624940b36" } modify_external_catalogs: true
I20260928 10:43:55.944681 6270 ts_tablet_manager.cc:1918] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:55.944806 6270 log.cc:1196] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/5b5fc914143e40cebf6603bbc1b3195e
I20260928 10:43:55.944824 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6d8b6b9f7f18477e8cf57a7624940b36" } modify_external_catalogs: true
I20260928 10:43:55.945175 6270 ts_tablet_manager.cc:1939] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:55.945360 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_391fe28cf8c44817971a0e1ce4b4bed3" } modify_external_catalogs: true
I20260928 10:43:55.945549 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_391fe28cf8c44817971a0e1ce4b4bed3" } modify_external_catalogs: true
I20260928 10:43:55.946888 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b6a8b78145f2494aa8b0e49415c15f9d" } modify_external_catalogs: true
I20260928 10:43:55.947117 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b6a8b78145f2494aa8b0e49415c15f9d" } modify_external_catalogs: true
I20260928 10:43:55.928732 6271 raft_consensus.cc:348] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.948341 6271 raft_consensus.cc:374] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.948454 6271 raft_consensus.cc:729] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.948784 6271 consensus_queue.cc:260] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.949431 6271 ts_tablet_manager.cc:1428] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260928 10:43:55.950848 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 971f8344436f4e60ac0152e811efea8d (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.951346 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971f8344436f4e60ac0152e811efea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.951912 6271 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.953596 6271 tablet_bootstrap.cc:654] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.956722 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3dee98906e7e474cb198741b880a15be" } modify_external_catalogs: true
I20260928 10:43:55.956926 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3dee98906e7e474cb198741b880a15be" } modify_external_catalogs: true
I20260928 10:43:55.956370 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 (DEFAULT_TABLE table=default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.959529 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a51d9a67e15479587ab2d5a492bb7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.962253 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0
I20260928 10:43:55.962320 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e76a54bfddc74a9e86285add7b97645b
I20260928 10:43:55.963152 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1f6fe4271349432db8efda609d85d611
I20260928 10:43:55.963815 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.964104 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.964105 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.964600 6271 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:55.964747 6271 ts_tablet_manager.cc:1397] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.006s
I20260928 10:43:55.964752 5857 tablet_service.cc:1467] Processing CreateTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 (DEFAULT_TABLE table=default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.965189 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4ed61f43d5d4a6fa21eb854dae895d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.965520 6271 raft_consensus.cc:348] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.965744 6271 raft_consensus.cc:374] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.965833 6271 raft_consensus.cc:729] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.966039 6271 consensus_queue.cc:260] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.967669 6271 ts_tablet_manager.cc:1428] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:55.968173 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 (DEFAULT_TABLE table=default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.968647 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75ccd6efe3854d65995b17a38d81eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.968735 6271 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:55.969969 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8b0aee4f49a44bb7bf19b28d96040e65
I20260928 10:43:55.970280 6271 tablet_bootstrap.cc:654] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:55.970955 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 75ccd6efe3854d65995b17a38d81eaa5
I20260928 10:43:55.971520 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 (DEFAULT_TABLE table=default.Table_988cda94a8534a31a8c65d221e16833f [id=387c96b6b1cd436381e2b8011d66aa74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.971889 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28eb4bef35cc413ebbdc177de1d7b057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.975606 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:55.975843 5699 catalog_manager.cc:5495] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:55.976703 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:55.976928 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:55.977712 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 971f8344436f4e60ac0152e811efea8d (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.980451 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:55.980902 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.982409 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 15931372e469401ab22422677bd90d1f (DEFAULT_TABLE table=default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.985785 6273 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:55.986433 6273 ts_tablet_manager.cc:1397] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.226s user 0.017s sys 0.021s
I20260928 10:43:55.986826 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.987186 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 (DEFAULT_TABLE table=default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.987380 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.987316 6273 raft_consensus.cc:348] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:55.987545 6273 raft_consensus.cc:374] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:55.987629 6273 raft_consensus.cc:729] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:55.987860 6273 consensus_queue.cc:260] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:55.991317 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a765989e9ba3467f811f5fd49b67cb36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a765989e9ba3467f811f5fd49b67cb36 already in progress: creating tablet
I20260928 10:43:55.991407 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 971f8344436f4e60ac0152e811efea8d (DEFAULT_TABLE table=default.Table_b7443d18644a44f4a9c85ff0f860f176 [id=8864e41fe4f24b709e61352c0b6d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.991838 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971f8344436f4e60ac0152e811efea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.992017 6273 ts_tablet_manager.cc:1428] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:43:55.992336 6273 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:55.992352 5994 tablet_service.cc:1467] Processing CreateTablet for tablet e40f72ff466e4befb74290fd39285119 (DEFAULT_TABLE table=default.Table_99c3d74372144df784a9e24934534a4a [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.992689 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f72ff466e4befb74290fd39285119. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:55.993604 5955 leader_election.cc:341] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:55.994025 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971f8344436f4e60ac0152e811efea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.987511 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 (DEFAULT_TABLE table=default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.994760 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 (DEFAULT_TABLE table=default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.995144 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a51d9a67e15479587ab2d5a492bb7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.998584 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.998857 5998 tablet_service.cc:1467] Processing CreateTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 (DEFAULT_TABLE table=default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:55.999317 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4ed61f43d5d4a6fa21eb854dae895d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.002606 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:56.002676 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.002974 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.003046 6126 tablet_service.cc:1467] Processing CreateTablet for tablet b2d841c2f9b844208173f982b9eb7818 (DEFAULT_TABLE table=default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.003198 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.003371 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.003777 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 (DEFAULT_TABLE table=default.Table_988cda94a8534a31a8c65d221e16833f [id=387c96b6b1cd436381e2b8011d66aa74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.003791 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 (DEFAULT_TABLE table=default.Table_988cda94a8534a31a8c65d221e16833f [id=387c96b6b1cd436381e2b8011d66aa74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.004101 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a51d9a67e15479587ab2d5a492bb7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.004285 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28eb4bef35cc413ebbdc177de1d7b057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:55.991426 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 5b5fc914143e40cebf6603bbc1b3195e (table default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]) successfully deleted
I20260928 10:43:56.006696 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:56.006942 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a765989e9ba3467f811f5fd49b67cb36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a765989e9ba3467f811f5fd49b67cb36 already in progress: creating tablet
I20260928 10:43:56.007042 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.007232 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d841c2f9b844208173f982b9eb7818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.007432 6270 tablet_replica.cc:330] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.007652 6270 raft_consensus.cc:2229] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.007848 6270 raft_consensus.cc:2258] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:56.008368 5955 leader_election.cc:341] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:56.008308 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 already in progress: creating tablet
I20260928 10:43:56.008805 5997 tablet_service.cc:1467] Processing CreateTablet for tablet b2d841c2f9b844208173f982b9eb7818 (DEFAULT_TABLE table=default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.009239 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d841c2f9b844208173f982b9eb7818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.010212 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8d69020f569a4208a60acea45b7b2b0b" } new_table_name: "default.Table_d317ef6e443b4c10b5972fe1ad8e93ea" modify_external_catalogs: true
I20260928 10:43:56.010849 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 (DEFAULT_TABLE table=default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.011744 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75ccd6efe3854d65995b17a38d81eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.014631 6131 tablet_service.cc:1467] Processing CreateTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 (DEFAULT_TABLE table=default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.015373 6128 tablet_service.cc:1467] Processing CreateTablet for tablet e40f72ff466e4befb74290fd39285119 (DEFAULT_TABLE table=default.Table_99c3d74372144df784a9e24934534a4a [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.016914 6270 ts_tablet_manager.cc:1905] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.018059 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:56.018524 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf9361a96fdc44d7ac38a1d0d812eac0 consensus state has no leader
I20260928 10:43:56.019371 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.020777 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 15931372e469401ab22422677bd90d1f (DEFAULT_TABLE table=default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.021224 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15931372e469401ab22422677bd90d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.022950 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8c92519ebd044d35b76f6f708668ae19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.023617 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c92519ebd044d35b76f6f708668ae19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.025054 6273 tablet_bootstrap.cc:654] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:56.028283 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1f6fe4271349432db8efda609d85d611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6fe4271349432db8efda609d85d611 already in progress: creating tablet
I20260928 10:43:56.029829 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_da2eddc06d92439aa78eb340961125f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.030441 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da2eddc06d92439aa78eb340961125f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.038342 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 15931372e469401ab22422677bd90d1f (DEFAULT_TABLE table=default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.039213 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a27210443a334e1791928f47d34cbbf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:56.039775 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15931372e469401ab22422677bd90d1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:56.039882 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a27210443a334e1791928f47d34cbbf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.038693 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.041136 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b408b80f43024d9c9e4242fb52b068ba" } new_table_name: "default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf" modify_external_catalogs: true
I20260928 10:43:56.051352 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fac6c2d4209f4b74a9bc4e0143a8df1b" } new_table_name: "default.Table_8dc2417a516c4b5684c3b3a640c11014" modify_external_catalogs: true
I20260928 10:43:56.051594 6280 raft_consensus.cc:482] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.051766 6280 raft_consensus.cc:504] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.052429 6280 leader_election.cc:288] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.053213 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:43:56.053810 5818 leader_election.cc:341] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.060794 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.061146 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:55.998785 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5fc914143e40cebf6603bbc1b3195e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:56.062839 5955 leader_election.cc:341] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.063019 5955 leader_election.cc:302] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:43:56.063179 5955 raft_consensus.cc:2670] T 5b5fc914143e40cebf6603bbc1b3195e P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:43:56.064276 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41f6916daf024379a7dd0411e44ba6ca consensus state has no leader
W20260928 10:43:56.066428 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98566f85241c42cf92f3e131318d6efb consensus state has no leader
I20260928 10:43:56.066912 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28eb4bef35cc413ebbdc177de1d7b057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.067207 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4ed61f43d5d4a6fa21eb854dae895d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.067559 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b7443d18644a44f4a9c85ff0f860f176" } new_table_name: "default.Table_64f2ffa93db34653b515aa6d668ed2a2" modify_external_catalogs: true
I20260928 10:43:56.068871 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:56.069621 5817 leader_election.cc:341] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.069764 5817 leader_election.cc:302] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.070178 6280 raft_consensus.cc:2726] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.070825 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f72ff466e4befb74290fd39285119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.072587 5854 tablet_service.cc:1467] Processing CreateTablet for tablet a380da90a76545dba647e0c1b3e05acd (DEFAULT_TABLE table=default.Table_da2eddc06d92439aa78eb340961125f9 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.073370 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a380da90a76545dba647e0c1b3e05acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.074164 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 118ae3f8af264a31b7c22403c4951bdf (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.075217 6119 tablet_service.cc:1467] Processing CreateTablet for tablet a380da90a76545dba647e0c1b3e05acd (DEFAULT_TABLE table=default.Table_da2eddc06d92439aa78eb340961125f9 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.077329 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118ae3f8af264a31b7c22403c4951bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.077687 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 118ae3f8af264a31b7c22403c4951bdf (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.083060 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0fcd40a19a704aa1986c1404e9d53824"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.083685 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fcd40a19a704aa1986c1404e9d53824 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.088680 5988 tablet_service.cc:1467] Processing CreateTablet for tablet a380da90a76545dba647e0c1b3e05acd (DEFAULT_TABLE table=default.Table_da2eddc06d92439aa78eb340961125f9 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.089195 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a380da90a76545dba647e0c1b3e05acd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:56.090703 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 971f8344436f4e60ac0152e811efea8d consensus state has no leader
W20260928 10:43:56.091926 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e76a54bfddc74a9e86285add7b97645b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e76a54bfddc74a9e86285add7b97645b already in progress: creating tablet
W20260928 10:43:56.092149 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 75ccd6efe3854d65995b17a38d81eaa5 because the tablet was not found. No further retry: Not found: Tablet not found: 75ccd6efe3854d65995b17a38d81eaa5
W20260928 10:43:56.092371 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8b0aee4f49a44bb7bf19b28d96040e65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b0aee4f49a44bb7bf19b28d96040e65 already in progress: creating tablet
I20260928 10:43:56.095412 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75ccd6efe3854d65995b17a38d81eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.084088 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 118ae3f8af264a31b7c22403c4951bdf (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.101997 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ffb3c8206e614404828699d3794028a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.102831 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffb3c8206e614404828699d3794028a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.104646 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a380da90a76545dba647e0c1b3e05acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.104877 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_51fa355050b247adafc45bb9f179041c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.105777 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51fa355050b247adafc45bb9f179041c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.109019 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118ae3f8af264a31b7c22403c4951bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.110967 6270 ts_tablet_manager.cc:1918] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.119138 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c3422798a8284a8d8217eecc3ba83c01" } new_table_name: "default.Table_9fa7750af87240efb9e52060219b345c" modify_external_catalogs: true
I20260928 10:43:56.120568 6270 log.cc:1196] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/fb061a69c1ea4464a1db06c8a20999ab
I20260928 10:43:56.120966 6270 ts_tablet_manager.cc:1939] T fb061a69c1ea4464a1db06c8a20999ab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:56.107167 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118ae3f8af264a31b7c22403c4951bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.122561 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d9a96605aae94e7c808991e537e19ff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.123176 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9a96605aae94e7c808991e537e19ff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.124516 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b760d137ae6348e4abddd913d0d12649"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.125119 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b760d137ae6348e4abddd913d0d12649 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.127115 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8fcb46f9ac644ae6898728957f1b58c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.127715 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fcb46f9ac644ae6898728957f1b58c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.127643 6271 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.129442 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15931372e469401ab22422677bd90d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.129601 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_855cceaf3f204f99b1cfe97f4506389f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.130182 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_855cceaf3f204f99b1cfe97f4506389f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.131491 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet fb061a69c1ea4464a1db06c8a20999ab (table default.Table_a50c6af88ced410e9224954bc1aaf5f3 [id=5131911d0ab54413ba5545cdd938f939]) successfully deleted
W20260928 10:43:56.132104 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 already in progress: creating tablet
W20260928 10:43:56.132679 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e76a54bfddc74a9e86285add7b97645b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e76a54bfddc74a9e86285add7b97645b already in progress: creating tablet
I20260928 10:43:56.134989 6271 ts_tablet_manager.cc:1397] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.166s user 0.008s sys 0.001s
W20260928 10:43:56.137012 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1f6fe4271349432db8efda609d85d611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6fe4271349432db8efda609d85d611 already in progress: creating tablet
I20260928 10:43:56.139081 6273 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.139266 6273 ts_tablet_manager.cc:1397] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.147s user 0.002s sys 0.005s
I20260928 10:43:56.140033 6273 raft_consensus.cc:348] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.140290 6273 raft_consensus.cc:374] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.140375 6273 raft_consensus.cc:729] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.140648 6273 consensus_queue.cc:260] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.150769 6269 ts_tablet_manager.cc:1918] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.150944 6269 log.cc:1196] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:56.151265 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 98566f85241c42cf92f3e131318d6efb from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.151348 6269 ts_tablet_manager.cc:1939] T 8276c29e44b54fc78844e3ef1e2e828f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.152647 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8276c29e44b54fc78844e3ef1e2e828f (table default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
W20260928 10:43:56.153381 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 already in progress: creating tablet
W20260928 10:43:56.153641 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8854c8a8e4024c6db4cb6b21d6ae021f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8854c8a8e4024c6db4cb6b21d6ae021f already in progress: creating tablet
W20260928 10:43:56.153985 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 345245f9349a4031af5ff278a3da74f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345245f9349a4031af5ff278a3da74f0 already in progress: creating tablet
W20260928 10:43:56.154194 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 65905f0cb4154bdcb8ee6702c87d23ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65905f0cb4154bdcb8ee6702c87d23ca already in progress: creating tablet
W20260928 10:43:56.154897 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0acf2685688e4e108bba66842acedbb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0acf2685688e4e108bba66842acedbb9 already in progress: creating tablet
W20260928 10:43:56.155277 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet fb061a69c1ea4464a1db06c8a20999ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb061a69c1ea4464a1db06c8a20999ab already in progress: creating tablet
W20260928 10:43:56.155970 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a765989e9ba3467f811f5fd49b67cb36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a765989e9ba3467f811f5fd49b67cb36 already in progress: creating tablet
I20260928 10:43:56.155995 6269 tablet_replica.cc:330] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.155970 6271 raft_consensus.cc:348] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:56.156193 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 already in progress: creating tablet
I20260928 10:43:56.156200 6269 raft_consensus.cc:2229] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.156241 6271 raft_consensus.cc:374] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.156309 6271 raft_consensus.cc:729] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.156365 6269 raft_consensus.cc:2258] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:56.157169 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8b0aee4f49a44bb7bf19b28d96040e65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b0aee4f49a44bb7bf19b28d96040e65 already in progress: creating tablet
I20260928 10:43:56.157234 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 2693b378215f425bb1c2e3e0963aac95 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:56.157871 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 75ccd6efe3854d65995b17a38d81eaa5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75ccd6efe3854d65995b17a38d81eaa5 already in progress: creating tablet
W20260928 10:43:56.156361 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1f6fe4271349432db8efda609d85d611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6fe4271349432db8efda609d85d611 already in progress: creating tablet
I20260928 10:43:56.158120 6270 tablet_replica.cc:330] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.158303 6270 raft_consensus.cc:2229] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.158526 6270 raft_consensus.cc:2258] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:56.158560 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e76a54bfddc74a9e86285add7b97645b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e76a54bfddc74a9e86285add7b97645b already in progress: creating tablet
W20260928 10:43:56.159168 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8b0aee4f49a44bb7bf19b28d96040e65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b0aee4f49a44bb7bf19b28d96040e65 already in progress: creating tablet
I20260928 10:43:56.160079 6269 ts_tablet_manager.cc:1905] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.162797 6273 ts_tablet_manager.cc:1428] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
W20260928 10:43:56.166652 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 780707959e0e48d6a83b22e6479a5884 consensus state has no leader
I20260928 10:43:56.168426 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0f27ea4cc7c04295af25a51c164d3998" } modify_external_catalogs: true
I20260928 10:43:56.168629 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0f27ea4cc7c04295af25a51c164d3998" } modify_external_catalogs: true
I20260928 10:43:56.168048 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1696a82ccb5c45d9a154583fc88be5ed" } modify_external_catalogs: true
I20260928 10:43:56.169034 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1696a82ccb5c45d9a154583fc88be5ed" } modify_external_catalogs: true
I20260928 10:43:56.170011 6273 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.170724 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f4bc1e73b1804c52ad90b1c61738b77c" } modify_external_catalogs: true
I20260928 10:43:56.170910 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f4bc1e73b1804c52ad90b1c61738b77c" } modify_external_catalogs: true
I20260928 10:43:56.171953 6273 tablet_bootstrap.cc:654] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.173959 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 2ea33fe07f324842823f5f69dcbeec2b from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.174615 6275 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.175525 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 5b5fc914143e40cebf6603bbc1b3195e from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.175631 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bd7053e67266490cba88d524556fed3e" } modify_external_catalogs: true
I20260928 10:43:56.175803 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bd7053e67266490cba88d524556fed3e" } modify_external_catalogs: true
I20260928 10:43:56.176430 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a8e8018f99c4497b87d378148987613d" } modify_external_catalogs: true
I20260928 10:43:56.176610 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a8e8018f99c4497b87d378148987613d" } modify_external_catalogs: true
I20260928 10:43:56.180126 6270 ts_tablet_manager.cc:1905] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.175313 6271 consensus_queue.cc:260] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.186434 6271 ts_tablet_manager.cc:1428] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.051s user 0.000s sys 0.002s
I20260928 10:43:56.188031 5883 raft_consensus.cc:1261] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:56.187909 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.188928 6344 consensus_queue.cc:1035] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:56.192222 6275 ts_tablet_manager.cc:1397] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.498s user 0.057s sys 0.083s
I20260928 10:43:56.204519 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.214255 6275 raft_consensus.cc:348] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.214768 6275 raft_consensus.cc:374] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.214913 6275 raft_consensus.cc:729] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.215505 6275 consensus_queue.cc:260] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.222942 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 4c93507a0bf14c8383794b34ba1702fd from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.225474 6273 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.225651 6273 ts_tablet_manager.cc:1397] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.005s
I20260928 10:43:56.226392 6273 raft_consensus.cc:348] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.226642 6273 raft_consensus.cc:374] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.226737 6273 raft_consensus.cc:729] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.226999 6273 consensus_queue.cc:260] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.232466 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 1e32961679ee47379dab4c62efc53d99 (DEFAULT_TABLE table=default.Table_a27210443a334e1791928f47d34cbbf4 [id=f2e30412da7045c0b0bd9bbea0976fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.232939 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e32961679ee47379dab4c62efc53d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.233789 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0606bc40e4ad443f9425df4c28ca89bf" } new_table_name: "default.Table_b6d141d94e74477ba22579aa9c058b06" modify_external_catalogs: true
I20260928 10:43:56.234874 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 1e32961679ee47379dab4c62efc53d99 (DEFAULT_TABLE table=default.Table_a27210443a334e1791928f47d34cbbf4 [id=f2e30412da7045c0b0bd9bbea0976fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.235440 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e32961679ee47379dab4c62efc53d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.239812 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1e32961679ee47379dab4c62efc53d99 (DEFAULT_TABLE table=default.Table_a27210443a334e1791928f47d34cbbf4 [id=f2e30412da7045c0b0bd9bbea0976fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.240314 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e32961679ee47379dab4c62efc53d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.242638 6354 mvcc.cc:205] Tried to move back new op lower bound from 7334265799366397952 to 7334265798260473856. Current Snapshot: MvccSnapshot[applied={T|T < 7334265799366397952}]
I20260928 10:43:56.244233 6273 ts_tablet_manager.cc:1428] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260928 10:43:56.247785 6273 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:56.248912 5955 consensus_peers.cc:487] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:43:56.249385 6350 mvcc.cc:205] Tried to move back new op lower bound from 7334265799366397952 to 7334265798260473856. Current Snapshot: MvccSnapshot[applied={T|T < 7334265799366397952}]
I20260928 10:43:56.252434 6271 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.264452 6275 ts_tablet_manager.cc:1428] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.072s user 0.007s sys 0.000s
I20260928 10:43:56.266664 6275 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.266695 6273 tablet_bootstrap.cc:654] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.268348 6358 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:43:56.271564 6275 tablet_bootstrap.cc:654] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.281641 6269 ts_tablet_manager.cc:1918] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.281823 6269 log.cc:1196] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/5b5fc914143e40cebf6603bbc1b3195e
I20260928 10:43:56.282261 6269 ts_tablet_manager.cc:1939] T 5b5fc914143e40cebf6603bbc1b3195e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.287096 6357 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:43:56.291483 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2693b378215f425bb1c2e3e0963aac95
I20260928 10:43:56.291563 6271 tablet_bootstrap.cc:654] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.291929 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 2693b378215f425bb1c2e3e0963aac95 deleted and replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6
I20260928 10:43:56.293007 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:56.294677 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:43:56.295001 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 2ea33fe07f324842823f5f69dcbeec2b deleted and replaced by tablet 1631d396362a4cffa1dec06d00894c63
I20260928 10:43:56.296214 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3b4e5f2925cf464daf58089d96121456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.296792 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b4e5f2925cf464daf58089d96121456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.297922 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 68e1b25f634e48008f5262aed44010da
I20260928 10:43:56.298494 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_43fb3b30d5f74e2b94775478beb88474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.299046 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43fb3b30d5f74e2b94775478beb88474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.300201 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 99202cf0cfac40b2aa54b10b4d96939d
I20260928 10:43:56.300988 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_99c3d74372144df784a9e24934534a4a" } new_table_name: "default.Table_c2552880d04743968cc2e72c5f916b37" modify_external_catalogs: true
I20260928 10:43:56.302248 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a19c9c61d774437ea873fdc6e1c93486
I20260928 10:43:56.302870 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_97cfcb43afbc4ecf879d65d4b6d55a60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.303411 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.304926 6271 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.305063 6271 ts_tablet_manager.cc:1397] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20260928 10:43:56.305827 6271 raft_consensus.cc:348] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.306066 6271 raft_consensus.cc:374] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.306160 6271 raft_consensus.cc:729] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.308712 6270 ts_tablet_manager.cc:1918] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.308882 6270 log.cc:1196] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/72ace49431a24469bef73c596af089ae
I20260928 10:43:56.309298 6270 ts_tablet_manager.cc:1939] T 72ace49431a24469bef73c596af089ae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:56.309789 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.310111 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.310374 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 72ace49431a24469bef73c596af089ae (table default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
I20260928 10:43:56.306391 6271 consensus_queue.cc:260] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.310982 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4ffa9fb5b11944b1b38e07bd43891773
I20260928 10:43:56.312634 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d4d54f17acbc4c6d9e9139a000472a59" } new_table_name: "default.Table_8b6de790cff44909b80e9ab812bb2d60" modify_external_catalogs: true
I20260928 10:43:56.315166 6271 ts_tablet_manager.cc:1428] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 10:43:56.315460 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.315864 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 98566f85241c42cf92f3e131318d6efb
I20260928 10:43:56.316282 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 98566f85241c42cf92f3e131318d6efb deleted and replaced by tablet 734c3196929d4814b77bce7938bf598e
I20260928 10:43:56.316591 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8fcb46f9ac644ae6898728957f1b58c5" } new_table_name: "default.Table_cbf12a51196c4a90bd8dde13cdc7dd52" modify_external_catalogs: true
I20260928 10:43:56.319083 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.319082 6271 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.319412 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_41b8356a51a841219348f8ad61d5740e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.320148 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b8356a51a841219348f8ad61d5740e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.320924 6271 tablet_bootstrap.cc:654] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.321815 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.322118 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.322434 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.323267 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.323786 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.324350 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.325045 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.325434 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.325707 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.325920 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.327010 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.328739 6275 tablet_bootstrap.cc:492] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.328704 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.329367 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:56.329543 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cf9361a96fdc44d7ac38a1d0d812eac0 (table default.Table_d317ef6e443b4c10b5972fe1ad8e93ea [id=d8bb5aee4ea44ee3b1eb058e062c389d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet cf9361a96fdc44d7ac38a1d0d812eac0 consensus state has no leader
I20260928 10:43:56.329668 6272 tablet_replica.cc:330] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.329835 6272 raft_consensus.cc:2229] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.330056 6272 raft_consensus.cc:2258] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.330958 6272 ts_tablet_manager.cc:1905] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:56.331755 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2693b378215f425bb1c2e3e0963aac95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2693b378215f425bb1c2e3e0963aac95 already in progress: creating tablet
W20260928 10:43:56.332136 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2ea33fe07f324842823f5f69dcbeec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ea33fe07f324842823f5f69dcbeec2b already in progress: creating tablet
I20260928 10:43:56.333474 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 5b5fc914143e40cebf6603bbc1b3195e (table default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]) successfully deleted
I20260928 10:43:56.334663 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.334918 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.335201 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.335464 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.335727 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:56.336190 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 75ccd6efe3854d65995b17a38d81eaa5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75ccd6efe3854d65995b17a38d81eaa5 already in progress: creating tablet
I20260928 10:43:56.337869 6273 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.338058 6273 ts_tablet_manager.cc:1397] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.015s
I20260928 10:43:56.338732 6272 ts_tablet_manager.cc:1918] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.338898 6272 log.cc:1196] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:56.338873 6273 raft_consensus.cc:348] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.339146 6273 raft_consensus.cc:374] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.339224 6273 raft_consensus.cc:729] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.339459 6272 ts_tablet_manager.cc:1939] T 8276c29e44b54fc78844e3ef1e2e828f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.339540 6269 tablet_replica.cc:330] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.329345 6275 ts_tablet_manager.cc:1397] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.000s
I20260928 10:43:56.341707 6275 raft_consensus.cc:348] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.343103 6275 raft_consensus.cc:374] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.343331 6275 raft_consensus.cc:729] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.343667 6275 consensus_queue.cc:260] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.344297 6275 ts_tablet_manager.cc:1428] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:43:56.344480 6269 raft_consensus.cc:2229] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.344694 6269 raft_consensus.cc:2258] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.345098 6273 consensus_queue.cc:260] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.345430 6270 tablet_replica.cc:330] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.345635 6273 ts_tablet_manager.cc:1428] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:43:56.344862 6275 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.345934 6273 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.347589 6270 raft_consensus.cc:2229] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.348588 6269 ts_tablet_manager.cc:1905] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.348887 6270 raft_consensus.cc:2258] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.349143 6273 tablet_bootstrap.cc:654] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.350016 6275 tablet_bootstrap.cc:654] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.352869 6344 raft_consensus.cc:482] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.352975 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8276c29e44b54fc78844e3ef1e2e828f (table default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:43:56.353063 6344 raft_consensus.cc:504] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:56.353277 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4ffa9fb5b11944b1b38e07bd43891773 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ffa9fb5b11944b1b38e07bd43891773 already in progress: creating tablet
W20260928 10:43:56.353471 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 98566f85241c42cf92f3e131318d6efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98566f85241c42cf92f3e131318d6efb already in progress: creating tablet
W20260928 10:43:56.353660 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a19c9c61d774437ea873fdc6e1c93486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9c61d774437ea873fdc6e1c93486 already in progress: creating tablet
I20260928 10:43:56.353780 6344 leader_election.cc:288] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:43:56.353838 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 99202cf0cfac40b2aa54b10b4d96939d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99202cf0cfac40b2aa54b10b4d96939d already in progress: creating tablet
W20260928 10:43:56.354089 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 68e1b25f634e48008f5262aed44010da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68e1b25f634e48008f5262aed44010da already in progress: creating tablet
I20260928 10:43:56.354948 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:56.355502 6155 raft_consensus.cc:2454] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:43:56.356547 5955 leader_election.cc:302] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:43:56.356935 6344 raft_consensus.cc:2781] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:56.357028 6344 raft_consensus.cc:482] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:56.357121 6344 raft_consensus.cc:3037] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.357246 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d4dee0748fe04da7b4e07bfdfdb8cb7e
I20260928 10:43:56.360462 6344 raft_consensus.cc:504] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.361193 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.362269 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.362679 6270 ts_tablet_manager.cc:1905] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.362783 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:56.363155 6344 leader_election.cc:288] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.363536 6155 raft_consensus.cc:3037] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.366338 6155 raft_consensus.cc:2454] T 8738830fc8f8439fa60f561db9ce31d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:56.366921 5955 leader_election.cc:302] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:43:56.367393 6344 raft_consensus.cc:2781] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:56.368958 6344 raft_consensus.cc:686] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:56.369275 6344 consensus_queue.cc:237] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.372958 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4c93507a0bf14c8383794b34ba1702fd
I20260928 10:43:56.373410 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 4c93507a0bf14c8383794b34ba1702fd deleted and replaced by tablet 0e9583b5637a428db383320d98a7a280
I20260928 10:43:56.373476 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:56.373665 5884 raft_consensus.cc:3037] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.373703 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:56.374800 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab1277e4c47141ea9480987eef715528 consensus state has no leader
I20260928 10:43:56.375723 6269 ts_tablet_manager.cc:1918] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.375839 6269 log.cc:1196] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/345245f9349a4031af5ff278a3da74f0
I20260928 10:43:56.376216 6269 ts_tablet_manager.cc:1939] T 345245f9349a4031af5ff278a3da74f0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.376072 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_36f44cef0950489584714a564fb6f52e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:56.376291 5884 raft_consensus.cc:2454] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:56.373395 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8738830fc8f8439fa60f561db9ce31d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:43:56.376644 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36f44cef0950489584714a564fb6f52e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.376727 5883 raft_consensus.cc:2362] T 8738830fc8f8439fa60f561db9ce31d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1. Re-sending same reply.
I20260928 10:43:56.378649 6273 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.378577 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8cafdf332e5d48c4a1f719cef76f2d70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:56.378772 6273 ts_tablet_manager.cc:1397] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.011s
W20260928 10:43:56.379076 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cafdf332e5d48c4a1f719cef76f2d70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.379443 6273 raft_consensus.cc:348] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.379650 6273 raft_consensus.cc:374] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.379730 6273 raft_consensus.cc:729] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:43:56.380488 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e40f72ff466e4befb74290fd39285119 consensus state has no leader
I20260928 10:43:56.380702 6273 consensus_queue.cc:260] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:56.381040 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dba507179ed44ce903111622ec1fb42 consensus state has no leader
I20260928 10:43:56.381281 5701 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822] alter complete (version 1)
I20260928 10:43:56.382421 6273 ts_tablet_manager.cc:1428] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:56.382704 6273 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.383946 6270 ts_tablet_manager.cc:1918] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.384092 6270 log.cc:1196] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9b90530f95ed4b73a57dedd4814f0236
I20260928 10:43:56.384255 6273 tablet_bootstrap.cc:654] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.384963 6270 ts_tablet_manager.cc:1939] T 9b90530f95ed4b73a57dedd4814f0236 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:56.385293 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 362ef9f9aa8641cca11c0a154882e1d4 has no consensus state
I20260928 10:43:56.386787 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_84731f32539b428ab9107d83eabb7553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.387319 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84731f32539b428ab9107d83eabb7553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.388350 6280 raft_consensus.cc:482] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.388480 6280 raft_consensus.cc:504] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.389086 6280 leader_election.cc:288] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:56.391592 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d6349536abdb4f5ea6addc8eb9a7811b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.392148 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6349536abdb4f5ea6addc8eb9a7811b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.394299 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2a4469260e874ea99c6bafe3bee0a05d" } new_table_name: "default.Table_f63b5fc9650c4300b6109a4bb30a6cef" modify_external_catalogs: true
I20260928 10:43:56.394850 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9b90530f95ed4b73a57dedd4814f0236 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
W20260928 10:43:56.395444 5818 leader_election.cc:341] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 9b90530f95ed4b73a57dedd4814f0236
W20260928 10:43:56.395519 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 99202cf0cfac40b2aa54b10b4d96939d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99202cf0cfac40b2aa54b10b4d96939d already in progress: creating tablet
W20260928 10:43:56.396106 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a19c9c61d774437ea873fdc6e1c93486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9c61d774437ea873fdc6e1c93486 already in progress: creating tablet
W20260928 10:43:56.396678 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4ffa9fb5b11944b1b38e07bd43891773 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ffa9fb5b11944b1b38e07bd43891773 already in progress: creating tablet
W20260928 10:43:56.397259 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 98566f85241c42cf92f3e131318d6efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98566f85241c42cf92f3e131318d6efb already in progress: creating tablet
W20260928 10:43:56.397888 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 68e1b25f634e48008f5262aed44010da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68e1b25f634e48008f5262aed44010da already in progress: creating tablet
W20260928 10:43:56.398494 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2693b378215f425bb1c2e3e0963aac95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2693b378215f425bb1c2e3e0963aac95 already in progress: creating tablet
I20260928 10:43:56.396265 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b90530f95ed4b73a57dedd4814f0236" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:56.399209 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2ea33fe07f324842823f5f69dcbeec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ea33fe07f324842823f5f69dcbeec2b already in progress: creating tablet
W20260928 10:43:56.399847 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4dee0748fe04da7b4e07bfdfdb8cb7e already in progress: creating tablet
I20260928 10:43:56.399755 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_41038208e21c49a59c2faa2bb583cb84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.400379 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41038208e21c49a59c2faa2bb583cb84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.401625 6273 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.401822 6273 ts_tablet_manager.cc:1397] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.009s
W20260928 10:43:56.402607 5817 leader_election.cc:341] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.402818 5817 leader_election.cc:302] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.403708 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 345245f9349a4031af5ff278a3da74f0 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:56.403797 6280 raft_consensus.cc:2726] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:43:56.403995 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2693b378215f425bb1c2e3e0963aac95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2693b378215f425bb1c2e3e0963aac95 already in progress: creating tablet
I20260928 10:43:56.402609 6273 raft_consensus.cc:348] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:56.404201 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2ea33fe07f324842823f5f69dcbeec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ea33fe07f324842823f5f69dcbeec2b already in progress: creating tablet
I20260928 10:43:56.404241 6273 raft_consensus.cc:374] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.404307 6273 raft_consensus.cc:729] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:43:56.404386 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 68e1b25f634e48008f5262aed44010da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68e1b25f634e48008f5262aed44010da already in progress: creating tablet
W20260928 10:43:56.404574 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 99202cf0cfac40b2aa54b10b4d96939d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99202cf0cfac40b2aa54b10b4d96939d already in progress: creating tablet
I20260928 10:43:56.404553 6273 consensus_queue.cc:260] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:56.404769 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a19c9c61d774437ea873fdc6e1c93486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9c61d774437ea873fdc6e1c93486 already in progress: creating tablet
W20260928 10:43:56.404987 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4ffa9fb5b11944b1b38e07bd43891773 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ffa9fb5b11944b1b38e07bd43891773 already in progress: creating tablet
W20260928 10:43:56.405198 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 98566f85241c42cf92f3e131318d6efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98566f85241c42cf92f3e131318d6efb already in progress: creating tablet
W20260928 10:43:56.405354 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4dee0748fe04da7b4e07bfdfdb8cb7e already in progress: creating tablet
I20260928 10:43:56.406073 6273 ts_tablet_manager.cc:1428] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:56.406108 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.406405 6273 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.408111 6273 tablet_bootstrap.cc:654] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.412623 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 1f6fe4271349432db8efda609d85d611 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.416087 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.417915 6275 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.418171 6275 ts_tablet_manager.cc:1397] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.004s
I20260928 10:43:56.419095 6275 raft_consensus.cc:348] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.419412 6275 raft_consensus.cc:374] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.419481 6275 raft_consensus.cc:729] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:43:56.422712 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4c93507a0bf14c8383794b34ba1702fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c93507a0bf14c8383794b34ba1702fd already in progress: creating tablet
I20260928 10:43:56.422725 6275 consensus_queue.cc:260] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.424417 6275 ts_tablet_manager.cc:1428] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:43:56.426011 6275 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.427873 6275 tablet_bootstrap.cc:654] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.428807 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.429101 6269 tablet_replica.cc:330] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.429311 6269 raft_consensus.cc:2229] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.429493 6269 raft_consensus.cc:2258] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:56.430073 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4c93507a0bf14c8383794b34ba1702fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c93507a0bf14c8383794b34ba1702fd already in progress: creating tablet
I20260928 10:43:56.431486 6269 ts_tablet_manager.cc:1905] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.437239 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4477137e2ca74ca1a294c034b3d60233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.437913 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4477137e2ca74ca1a294c034b3d60233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.441093 6275 tablet_bootstrap.cc:492] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.441269 6275 ts_tablet_manager.cc:1397] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260928 10:43:56.443393 6275 raft_consensus.cc:348] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.443691 6275 raft_consensus.cc:374] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.443784 6275 raft_consensus.cc:729] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:43:56.444429 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 76114.4us
I20260928 10:43:56.445281 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.448697 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.448988 6272 tablet_replica.cc:330] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.449179 6272 raft_consensus.cc:2229] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.449352 6272 raft_consensus.cc:2258] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.450246 6272 ts_tablet_manager.cc:1905] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:56.457391 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4dee0748fe04da7b4e07bfdfdb8cb7e already in progress: creating tablet
I20260928 10:43:56.457989 6272 ts_tablet_manager.cc:1918] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.458202 6272 log.cc:1196] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/345245f9349a4031af5ff278a3da74f0
I20260928 10:43:56.458650 6272 ts_tablet_manager.cc:1939] T 345245f9349a4031af5ff278a3da74f0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.460229 6275 consensus_queue.cc:260] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:56.458674 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4c93507a0bf14c8383794b34ba1702fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c93507a0bf14c8383794b34ba1702fd already in progress: creating tablet
I20260928 10:43:56.461730 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 345245f9349a4031af5ff278a3da74f0 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:56.465071 6271 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.465278 6271 ts_tablet_manager.cc:1397] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.147s user 0.002s sys 0.014s
I20260928 10:43:56.465902 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.466184 6271 raft_consensus.cc:348] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.466428 6271 raft_consensus.cc:374] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.466455 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.466553 6271 raft_consensus.cc:729] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.466813 6271 consensus_queue.cc:260] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.467020 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.467473 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.468487 6269 ts_tablet_manager.cc:1918] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:43:56.466979 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9b90530f95ed4b73a57dedd4814f0236 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b90530f95ed4b73a57dedd4814f0236 already in progress: creating tablet
I20260928 10:43:56.468837 6269 log.cc:1196] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e36c690a640541e5ba33b67914656bbc
I20260928 10:43:56.469377 6269 ts_tablet_manager.cc:1939] T e36c690a640541e5ba33b67914656bbc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.469426 6271 ts_tablet_manager.cc:1428] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:56.470705 6271 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.471863 6269 tablet_replica.cc:330] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.471958 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e36c690a640541e5ba33b67914656bbc (table default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]) successfully deleted
I20260928 10:43:56.472086 6269 raft_consensus.cc:2229] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.472265 6269 raft_consensus.cc:2258] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.472342 6271 tablet_bootstrap.cc:654] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.473066 6269 ts_tablet_manager.cc:1905] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.473409 6275 ts_tablet_manager.cc:1428] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.032s user 0.002s sys 0.001s
I20260928 10:43:56.474699 6275 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.476172 6275 tablet_bootstrap.cc:654] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.476701 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b90530f95ed4b73a57dedd4814f0236 with delete_type TABLET_DATA_DELETED (replaced by tablet 1447a551d9264d18bd1eeabe31b513f1) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.476972 6272 tablet_replica.cc:330] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.477128 6272 raft_consensus.cc:2229] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.477313 6272 raft_consensus.cc:2258] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.477849 6272 ts_tablet_manager.cc:1905] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.481875 6269 ts_tablet_manager.cc:1918] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.481999 6269 log.cc:1196] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9b90530f95ed4b73a57dedd4814f0236
I20260928 10:43:56.482321 6269 ts_tablet_manager.cc:1939] T 9b90530f95ed4b73a57dedd4814f0236 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.483500 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9b90530f95ed4b73a57dedd4814f0236 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
I20260928 10:43:56.483801 6269 tablet_replica.cc:330] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.483976 6269 raft_consensus.cc:2229] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.484124 6269 raft_consensus.cc:2258] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:56.484249 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0563f8c31f7d43b3b703593dbc562ad6 consensus state has no leader
I20260928 10:43:56.484526 6272 ts_tablet_manager.cc:1918] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.484614 6272 log.cc:1196] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9b90530f95ed4b73a57dedd4814f0236
I20260928 10:43:56.484894 6272 ts_tablet_manager.cc:1939] T 9b90530f95ed4b73a57dedd4814f0236 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.486810 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9b90530f95ed4b73a57dedd4814f0236 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
I20260928 10:43:56.493037 6273 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.493228 6273 ts_tablet_manager.cc:1397] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.087s user 0.040s sys 0.014s
I20260928 10:43:56.494748 6273 raft_consensus.cc:348] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.494789 5700 catalog_manager.cc:5495] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:56.495150 6273 raft_consensus.cc:374] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.495244 6273 raft_consensus.cc:729] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.496747 6273 consensus_queue.cc:260] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.497097 5994 tablet_service.cc:1467] Processing CreateTablet for tablet e25db69b15eb445792e6168f99304bf2 (DEFAULT_TABLE table=default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.497351 6273 ts_tablet_manager.cc:1428] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:43:56.497479 6269 ts_tablet_manager.cc:1905] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.497539 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25db69b15eb445792e6168f99304bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.497678 6275 tablet_bootstrap.cc:492] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.497828 6275 ts_tablet_manager.cc:1397] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260928 10:43:56.498546 6275 raft_consensus.cc:348] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.498777 6275 raft_consensus.cc:374] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.498844 6275 raft_consensus.cc:729] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.499106 6275 consensus_queue.cc:260] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.500877 6275 ts_tablet_manager.cc:1428] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:43:56.501907 6271 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.502065 6271 ts_tablet_manager.cc:1397] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260928 10:43:56.502863 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 (DEFAULT_TABLE table=default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.503113 6271 raft_consensus.cc:348] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.503276 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59bfe1f8050f47429ef80a19fdcd8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.503324 6271 raft_consensus.cc:374] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.503404 6271 raft_consensus.cc:729] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.503643 6271 consensus_queue.cc:260] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.504172 6269 ts_tablet_manager.cc:1918] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.504328 6269 log.cc:1196] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9f6064f370434acb8fc02fda5b50ecf6
I20260928 10:43:56.504727 6269 ts_tablet_manager.cc:1939] T 9f6064f370434acb8fc02fda5b50ecf6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.505702 6269 tablet_replica.cc:330] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.505877 6269 raft_consensus.cc:2229] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.506096 6269 raft_consensus.cc:2258] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.506207 6271 ts_tablet_manager.cc:1428] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 10:43:56.507230 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 733ca22794da4015bbe09ed6c374ad05 (DEFAULT_TABLE table=default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.507652 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ca22794da4015bbe09ed6c374ad05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.509130 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_19a3d99bd33d4f939d10a3b861a5a0cd" } modify_external_catalogs: true
I20260928 10:43:56.509346 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_19a3d99bd33d4f939d10a3b861a5a0cd" } modify_external_catalogs: true
I20260928 10:43:56.510881 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9af467c9f80a4119845169339a5d6994" } modify_external_catalogs: true
I20260928 10:43:56.511116 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9af467c9f80a4119845169339a5d6994" } modify_external_catalogs: true
I20260928 10:43:56.497099 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 (DEFAULT_TABLE table=default.Table_cbf12a51196c4a90bd8dde13cdc7dd52 [id=be4415ae9e774501a41f230cedd27be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.512269 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362ef9f9aa8641cca11c0a154882e1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.512913 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51b6797b284b4bab9e23e290a53926fc" } modify_external_catalogs: true
I20260928 10:43:56.513127 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51b6797b284b4bab9e23e290a53926fc" } modify_external_catalogs: true
I20260928 10:43:56.516853 6269 ts_tablet_manager.cc:1905] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.519817 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 (DEFAULT_TABLE table=default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.519821 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7636309bdaf45918561f2d8b59f434b" } modify_external_catalogs: true
I20260928 10:43:56.520068 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7636309bdaf45918561f2d8b59f434b" } modify_external_catalogs: true
I20260928 10:43:56.520287 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59bfe1f8050f47429ef80a19fdcd8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.518461 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9f6064f370434acb8fc02fda5b50ecf6 (table default.Table_9fa7750af87240efb9e52060219b345c [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
I20260928 10:43:56.522886 6280 raft_consensus.cc:482] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.523065 6280 raft_consensus.cc:504] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.523702 6280 leader_election.cc:288] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.524482 6130 tablet_service.cc:1467] Processing CreateTablet for tablet e25db69b15eb445792e6168f99304bf2 (DEFAULT_TABLE table=default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.524930 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25db69b15eb445792e6168f99304bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.526358 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 1454e1e8bea746c0883c738ba8a293b9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.526902 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 (DEFAULT_TABLE table=default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.527312 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59bfe1f8050f47429ef80a19fdcd8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.528900 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 317446124e354bbeaaef608d9e8852fd (DEFAULT_TABLE table=default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.529335 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 317446124e354bbeaaef608d9e8852fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.530812 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 733ca22794da4015bbe09ed6c374ad05 (DEFAULT_TABLE table=default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.531165 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ca22794da4015bbe09ed6c374ad05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.531901 6273 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.534152 6273 tablet_bootstrap.cc:654] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.534837 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 (DEFAULT_TABLE table=default.Table_cbf12a51196c4a90bd8dde13cdc7dd52 [id=be4415ae9e774501a41f230cedd27be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.535221 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362ef9f9aa8641cca11c0a154882e1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.538826 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 317446124e354bbeaaef608d9e8852fd (DEFAULT_TABLE table=default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.539214 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 317446124e354bbeaaef608d9e8852fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.542655 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet e36c690a640541e5ba33b67914656bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.543385 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 01433ce37b2c49cd858ea88877ca56da (DEFAULT_TABLE table=default.Table_0fcd40a19a704aa1986c1404e9d53824 [id=ba1f625ad33143bca567a8788d0d95b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.543823 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01433ce37b2c49cd858ea88877ca56da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.546921 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 92912af8cba4453a8e3422896d586855 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.547386 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92912af8cba4453a8e3422896d586855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.549917 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 427b96ce675d48629fcbf8bbcf6e500e
I20260928 10:43:56.550706 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dee0748fe04da7b4e07bfdfdb8cb7e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:56.550812 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet af258604238c4e39adac40c81d5a6f3f
I20260928 10:43:56.550974 6022 raft_consensus.cc:2454] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:43:56.551445 5701 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b6f36552ca554b60ae0d1cdacbc28af6
I20260928 10:43:56.552404 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dee0748fe04da7b4e07bfdfdb8cb7e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:56.553141 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 92912af8cba4453a8e3422896d586855 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.553330 5818 leader_election.cc:302] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
W20260928 10:43:56.553596 5817 leader_election.cc:341] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.553732 6280 raft_consensus.cc:2781] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:56.553699 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 01433ce37b2c49cd858ea88877ca56da (DEFAULT_TABLE table=default.Table_0fcd40a19a704aa1986c1404e9d53824 [id=ba1f625ad33143bca567a8788d0d95b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.553846 6280 raft_consensus.cc:482] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:56.553967 6280 raft_consensus.cc:3037] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.554726 6272 tablet_replica.cc:330] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.554927 6272 raft_consensus.cc:2229] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.555099 6272 raft_consensus.cc:2258] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.557293 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.558115 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.558341 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.561024 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.562199 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d567147d0d8c4ca4a12c66f2646477de" } modify_external_catalogs: true
I20260928 10:43:56.562423 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d567147d0d8c4ca4a12c66f2646477de" } modify_external_catalogs: true
I20260928 10:43:56.563403 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 97e20784940a4647a220ad74e3e15f83
I20260928 10:43:56.564376 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.564544 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.566673 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:56.568080 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 427b96ce675d48629fcbf8bbcf6e500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 427b96ce675d48629fcbf8bbcf6e500e already in progress: creating tablet
I20260928 10:43:56.568475 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet b1f23ddb4368451d8c555e6e8dc52151 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.567759 6270 tablet_replica.cc:330] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.569535 6270 raft_consensus.cc:2229] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.569734 6270 raft_consensus.cc:2258] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.570149 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.576174 5854 tablet_service.cc:1467] Processing CreateTablet for tablet e25db69b15eb445792e6168f99304bf2 (DEFAULT_TABLE table=default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.576597 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25db69b15eb445792e6168f99304bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.577153 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92912af8cba4453a8e3422896d586855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.577646 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01433ce37b2c49cd858ea88877ca56da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.578817 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 733ca22794da4015bbe09ed6c374ad05 (DEFAULT_TABLE table=default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.579176 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ca22794da4015bbe09ed6c374ad05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.583087 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 317446124e354bbeaaef608d9e8852fd (DEFAULT_TABLE table=default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.583197 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 01433ce37b2c49cd858ea88877ca56da (DEFAULT_TABLE table=default.Table_0fcd40a19a704aa1986c1404e9d53824 [id=ba1f625ad33143bca567a8788d0d95b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.576174 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 (DEFAULT_TABLE table=default.Table_cbf12a51196c4a90bd8dde13cdc7dd52 [id=be4415ae9e774501a41f230cedd27be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.583487 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 317446124e354bbeaaef608d9e8852fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.583670 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 92912af8cba4453a8e3422896d586855 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.583750 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362ef9f9aa8641cca11c0a154882e1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.584007 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92912af8cba4453a8e3422896d586855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.585685 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.585896 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.589519 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01433ce37b2c49cd858ea88877ca56da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.591908 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.593283 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.596414 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3b4e5f2925cf464daf58089d96121456" } new_table_name: "default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8" modify_external_catalogs: true
I20260928 10:43:56.596969 6126 tablet_service.cc:1467] Processing CreateTablet for tablet d40123712b17464e87023f69a6235640 (DEFAULT_TABLE table=default.Table_4477137e2ca74ca1a294c034b3d60233 [id=beb0af193f5f4677ad125facb05b7cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.597399 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40123712b17464e87023f69a6235640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.597613 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e3a352988f2142aa9bf121a9c6015d98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.598187 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3a352988f2142aa9bf121a9c6015d98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.599378 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e8976c2b98344aeca965fa829151ead5" } new_table_name: "default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99" modify_external_catalogs: true
I20260928 10:43:56.599639 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 10f6f7476c814e0a9abf56b23c1e547d
I20260928 10:43:56.600487 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4477137e2ca74ca1a294c034b3d60233" } new_table_name: "default.Table_666c3308a327438e82946bd8c06b0953" modify_external_catalogs: true
I20260928 10:43:56.600720 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.601641 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eb59fc6c47c8422a9bfa5c523ec590d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.602141 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb59fc6c47c8422a9bfa5c523ec590d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.603392 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_00012b0f0bd34c4bae0dd33bd461bc07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.603924 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00012b0f0bd34c4bae0dd33bd461bc07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.604372 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:56.607033 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d257233e5b934d619e2289a6df55d65a consensus state has no leader
I20260928 10:43:56.608588 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.610319 6272 ts_tablet_manager.cc:1905] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.610380 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet fb061a69c1ea4464a1db06c8a20999ab from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.614136 6273 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.614392 6273 ts_tablet_manager.cc:1397] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.007s
I20260928 10:43:56.615176 6270 ts_tablet_manager.cc:1905] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.615897 5859 tablet_service.cc:1467] Processing CreateTablet for tablet d40123712b17464e87023f69a6235640 (DEFAULT_TABLE table=default.Table_4477137e2ca74ca1a294c034b3d60233 [id=beb0af193f5f4677ad125facb05b7cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.616384 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40123712b17464e87023f69a6235640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.620709 5994 tablet_service.cc:1467] Processing CreateTablet for tablet d40123712b17464e87023f69a6235640 (DEFAULT_TABLE table=default.Table_4477137e2ca74ca1a294c034b3d60233 [id=beb0af193f5f4677ad125facb05b7cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.621243 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40123712b17464e87023f69a6235640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.623193 6270 ts_tablet_manager.cc:1918] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.623353 6270 log.cc:1196] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/b1f23ddb4368451d8c555e6e8dc52151
I20260928 10:43:56.623217 6273 raft_consensus.cc:348] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.623519 6273 raft_consensus.cc:374] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.623603 6273 raft_consensus.cc:729] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.623754 6270 ts_tablet_manager.cc:1939] T b1f23ddb4368451d8c555e6e8dc52151 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:56.623960 6273 consensus_queue.cc:260] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.624352 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet b1f23ddb4368451d8c555e6e8dc52151 (table default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]) successfully deleted
W20260928 10:43:56.625051 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 97e20784940a4647a220ad74e3e15f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97e20784940a4647a220ad74e3e15f83 already in progress: creating tablet
I20260928 10:43:56.625340 6270 tablet_replica.cc:330] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.625537 6270 raft_consensus.cc:2229] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.625705 6270 raft_consensus.cc:2258] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.626466 6270 ts_tablet_manager.cc:1905] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.630643 6280 raft_consensus.cc:504] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.631392 6280 leader_election.cc:288] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.634332 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dee0748fe04da7b4e07bfdfdb8cb7e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:56.635140 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dee0748fe04da7b4e07bfdfdb8cb7e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
W20260928 10:43:56.635748 5817 leader_election.cc:341] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:56.636227 5818 leader_election.cc:341] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: Tablet not RUNNING: STOPPED
I20260928 10:43:56.636363 5818 leader_election.cc:302] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.639003 6375 raft_consensus.cc:2726] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.639683 6273 ts_tablet_manager.cc:1428] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260928 10:43:56.641121 6272 ts_tablet_manager.cc:1918] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.641273 6272 log.cc:1196] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e36c690a640541e5ba33b67914656bbc
I20260928 10:43:56.641613 6272 ts_tablet_manager.cc:1939] T e36c690a640541e5ba33b67914656bbc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.642279 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e36c690a640541e5ba33b67914656bbc (table default.Table_078f2e9b9fff423ca3d37fc58a0169a8 [id=80ab3b5fc66e461a99572e7d712a9cc3]) successfully deleted
W20260928 10:43:56.642638 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 427b96ce675d48629fcbf8bbcf6e500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 427b96ce675d48629fcbf8bbcf6e500e already in progress: creating tablet
I20260928 10:43:56.642732 6273 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:56.642881 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet af258604238c4e39adac40c81d5a6f3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af258604238c4e39adac40c81d5a6f3f already in progress: creating tablet
W20260928 10:43:56.643111 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 97e20784940a4647a220ad74e3e15f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97e20784940a4647a220ad74e3e15f83 already in progress: creating tablet
W20260928 10:43:56.643327 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 10f6f7476c814e0a9abf56b23c1e547d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6f7476c814e0a9abf56b23c1e547d already in progress: creating tablet
I20260928 10:43:56.643623 6275 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.644529 6273 tablet_bootstrap.cc:654] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.647142 6269 ts_tablet_manager.cc:1918] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.647356 6269 log.cc:1196] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/fb061a69c1ea4464a1db06c8a20999ab
I20260928 10:43:56.647780 6269 ts_tablet_manager.cc:1939] T fb061a69c1ea4464a1db06c8a20999ab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.647948 6271 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.649600 6271 tablet_bootstrap.cc:654] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.651614 6269 tablet_replica.cc:330] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.651865 6269 raft_consensus.cc:2229] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.652063 6269 raft_consensus.cc:2258] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.653913 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet fb061a69c1ea4464a1db06c8a20999ab (table default.Table_a50c6af88ced410e9224954bc1aaf5f3 [id=5131911d0ab54413ba5545cdd938f939]) successfully deleted
W20260928 10:43:56.654201 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet af258604238c4e39adac40c81d5a6f3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af258604238c4e39adac40c81d5a6f3f already in progress: creating tablet
W20260928 10:43:56.654395 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 97e20784940a4647a220ad74e3e15f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97e20784940a4647a220ad74e3e15f83 already in progress: creating tablet
W20260928 10:43:56.654631 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 427b96ce675d48629fcbf8bbcf6e500e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 427b96ce675d48629fcbf8bbcf6e500e already in progress: creating tablet
I20260928 10:43:56.655268 6269 ts_tablet_manager.cc:1905] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.656754 6273 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.656913 6273 ts_tablet_manager.cc:1397] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260928 10:43:56.657044 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet e36c690a640541e5ba33b67914656bbc from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.657742 6273 raft_consensus.cc:348] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.658010 6273 raft_consensus.cc:374] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.658113 6273 raft_consensus.cc:729] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.658407 6273 consensus_queue.cc:260] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.662173 6273 ts_tablet_manager.cc:1428] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 10:43:56.662237 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 8358dd69e3d24743a79c681e2316dfe1 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.663309 6275 tablet_bootstrap.cc:654] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.664572 6273 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.671957 6271 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.672168 6271 ts_tablet_manager.cc:1397] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260928 10:43:56.672960 6271 raft_consensus.cc:348] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.673216 6271 raft_consensus.cc:374] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.673300 6271 raft_consensus.cc:729] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.674527 6273 tablet_bootstrap.cc:654] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.674758 6131 tablet_service.cc:1467] Processing CreateTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e (DEFAULT_TABLE table=default.Table_41038208e21c49a59c2faa2bb583cb84 [id=e00c83d4870444d3ab8051f21ece4c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.675207 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbd5d1ccd2e54f3884af3af327bb892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.676616 5859 tablet_service.cc:1467] Processing CreateTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e (DEFAULT_TABLE table=default.Table_41038208e21c49a59c2faa2bb583cb84 [id=e00c83d4870444d3ab8051f21ece4c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.677685 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbd5d1ccd2e54f3884af3af327bb892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.680008 6269 ts_tablet_manager.cc:1918] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.680189 6269 log.cc:1196] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d4dee0748fe04da7b4e07bfdfdb8cb7e
I20260928 10:43:56.680181 5996 tablet_service.cc:1467] Processing CreateTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e (DEFAULT_TABLE table=default.Table_41038208e21c49a59c2faa2bb583cb84 [id=e00c83d4870444d3ab8051f21ece4c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.680637 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbd5d1ccd2e54f3884af3af327bb892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.680678 6269 ts_tablet_manager.cc:1939] T d4dee0748fe04da7b4e07bfdfdb8cb7e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.682758 5856 tablet_service.cc:1467] Processing CreateTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.683260 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd13e6a9d8f04fa3abb8d22a80932dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.683231 6128 tablet_service.cc:1467] Processing CreateTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.683607 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd13e6a9d8f04fa3abb8d22a80932dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.687963 6273 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.688162 6273 ts_tablet_manager.cc:1397] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260928 10:43:56.689633 6273 raft_consensus.cc:348] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.689934 6273 raft_consensus.cc:374] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.690032 6273 raft_consensus.cc:729] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.690333 6273 consensus_queue.cc:260] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.691653 5994 tablet_service.cc:1467] Processing CreateTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.692165 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd13e6a9d8f04fa3abb8d22a80932dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.693548 6273 ts_tablet_manager.cc:1428] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:43:56.696835 6275 tablet_bootstrap.cc:492] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.697064 6275 ts_tablet_manager.cc:1397] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260928 10:43:56.697297 6273 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.697959 6275 raft_consensus.cc:348] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.698396 6275 raft_consensus.cc:374] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.698587 6275 raft_consensus.cc:729] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.698942 6275 consensus_queue.cc:260] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.698607 6131 tablet_service.cc:1467] Processing CreateTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (DEFAULT_TABLE table=default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.702771 5851 tablet_service.cc:1467] Processing CreateTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (DEFAULT_TABLE table=default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.703259 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d38c0ed54b45a89f8e1daefd5b67a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.703272 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d38c0ed54b45a89f8e1daefd5b67a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.703742 6271 consensus_queue.cc:260] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.704480 6273 tablet_bootstrap.cc:654] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.703486 6275 ts_tablet_manager.cc:1428] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:43:56.705979 6275 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.706744 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (table default.Table_a8e8018f99c4497b87d378148987613d [id=8e77f8894ad940afacf970068a7872b0]) successfully deleted
W20260928 10:43:56.707177 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 10f6f7476c814e0a9abf56b23c1e547d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6f7476c814e0a9abf56b23c1e547d already in progress: creating tablet
I20260928 10:43:56.709939 6275 tablet_bootstrap.cc:654] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.713153 5996 tablet_service.cc:1467] Processing CreateTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (DEFAULT_TABLE table=default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.715397 6273 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.715520 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d38c0ed54b45a89f8e1daefd5b67a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.715565 6273 ts_tablet_manager.cc:1397] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.004s
I20260928 10:43:56.717235 6273 raft_consensus.cc:348] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.717555 6273 raft_consensus.cc:374] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.717993 6273 raft_consensus.cc:729] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.718319 6273 consensus_queue.cc:260] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.721029 6271 ts_tablet_manager.cc:1428] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.049s user 0.000s sys 0.003s
I20260928 10:43:56.721318 6273 ts_tablet_manager.cc:1428] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:43:56.721648 6273 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.723872 6273 tablet_bootstrap.cc:654] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.715003 6270 ts_tablet_manager.cc:1918] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.726629 6270 log.cc:1196] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d4dee0748fe04da7b4e07bfdfdb8cb7e
I20260928 10:43:56.727020 6270 ts_tablet_manager.cc:1939] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:56.728304 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (table default.Table_a8e8018f99c4497b87d378148987613d [id=8e77f8894ad940afacf970068a7872b0]) successfully deleted
W20260928 10:43:56.729197 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet af258604238c4e39adac40c81d5a6f3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af258604238c4e39adac40c81d5a6f3f already in progress: creating tablet
W20260928 10:43:56.729926 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 10f6f7476c814e0a9abf56b23c1e547d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6f7476c814e0a9abf56b23c1e547d already in progress: creating tablet
I20260928 10:43:56.731261 6344 raft_consensus.cc:482] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.731418 6344 raft_consensus.cc:504] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.732007 6344 leader_election.cc:288] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:56.732929 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f6064f370434acb8fc02fda5b50ecf6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:56.733409 5957 leader_election.cc:341] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9f6064f370434acb8fc02fda5b50ecf6
W20260928 10:43:56.733909 5955 leader_election.cc:341] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.734036 5955 leader_election.cc:302] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:56.734712 6344 raft_consensus.cc:2726] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.735865 6271 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.738144 6271 tablet_bootstrap.cc:654] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.738894 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (DEFAULT_TABLE table=default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.739459 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48ccd7551f6a4fc8b41e70e94749e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.749447 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (DEFAULT_TABLE table=default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.750398 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48ccd7551f6a4fc8b41e70e94749e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.758880 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (DEFAULT_TABLE table=default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.759519 6273 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.759658 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48ccd7551f6a4fc8b41e70e94749e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.759738 6273 ts_tablet_manager.cc:1397] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.007s
I20260928 10:43:56.761097 6273 raft_consensus.cc:348] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.761468 6273 raft_consensus.cc:374] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.761552 6273 raft_consensus.cc:729] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.763675 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 87d5dd4e5b544262938b1822510d8b9f (DEFAULT_TABLE table=default.Table_84731f32539b428ab9107d83eabb7553 [id=76c248943ab94632a32893e69fce2205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.764199 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d5dd4e5b544262938b1822510d8b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.764338 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 87d5dd4e5b544262938b1822510d8b9f (DEFAULT_TABLE table=default.Table_84731f32539b428ab9107d83eabb7553 [id=76c248943ab94632a32893e69fce2205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.764755 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d5dd4e5b544262938b1822510d8b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.766145 6275 tablet_bootstrap.cc:492] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.766393 6275 ts_tablet_manager.cc:1397] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.002s
I20260928 10:43:56.767227 6275 raft_consensus.cc:348] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.767582 6275 raft_consensus.cc:374] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.767736 6275 raft_consensus.cc:729] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.768051 6275 consensus_queue.cc:260] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.775542 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 87d5dd4e5b544262938b1822510d8b9f (DEFAULT_TABLE table=default.Table_84731f32539b428ab9107d83eabb7553 [id=76c248943ab94632a32893e69fce2205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.775971 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d5dd4e5b544262938b1822510d8b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.777122 6273 consensus_queue.cc:260] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.779045 6273 ts_tablet_manager.cc:1428] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.019s user 0.001s sys 0.002s
I20260928 10:43:56.779361 6273 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.780759 6126 tablet_service.cc:1467] Processing CreateTablet for tablet d257233e5b934d619e2289a6df55d65a (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.781194 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d257233e5b934d619e2289a6df55d65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.781350 6273 tablet_bootstrap.cc:654] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:56.781535 6329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 10:43:56.782198 6329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:43:56.782310 6329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 10:43:56.784799 6275 ts_tablet_manager.cc:1428] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260928 10:43:56.786206 6275 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.788096 6275 tablet_bootstrap.cc:654] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.792418 6273 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.792570 6273 ts_tablet_manager.cc:1397] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260928 10:43:56.793298 6273 raft_consensus.cc:348] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.793514 6273 raft_consensus.cc:374] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.793593 6273 raft_consensus.cc:729] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.793821 6273 consensus_queue.cc:260] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.794296 6275 tablet_bootstrap.cc:492] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.794431 6275 ts_tablet_manager.cc:1397] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
W20260928 10:43:56.795413 6329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 10:43:56.795575 6329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:43:56.795686 6329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 10:43:56.795804 6329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 10:43:56.796253 6273 ts_tablet_manager.cc:1428] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:43:56.797235 5996 tablet_service.cc:1467] Processing CreateTablet for tablet d257233e5b934d619e2289a6df55d65a (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.797693 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d257233e5b934d619e2289a6df55d65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.797672 6126 tablet_service.cc:1467] Processing CreateTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c (DEFAULT_TABLE table=default.Table_36f44cef0950489584714a564fb6f52e [id=52bab93af95a4a3a8daa8e675154d7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.798081 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a0d63c6cbc4eebaf42dc7f969f243c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.798395 6273 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.800200 6273 tablet_bootstrap.cc:654] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.803344 5851 tablet_service.cc:1467] Processing CreateTablet for tablet d257233e5b934d619e2289a6df55d65a (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.803865 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d257233e5b934d619e2289a6df55d65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.805379 6275 raft_consensus.cc:348] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.805657 6275 raft_consensus.cc:374] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.805757 6275 raft_consensus.cc:729] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.806896 6275 consensus_queue.cc:260] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.810933 6275 ts_tablet_manager.cc:1428] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260928 10:43:56.813067 6275 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.814024 6344 raft_consensus.cc:482] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.814198 6344 raft_consensus.cc:504] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.814916 6344 leader_election.cc:288] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:56.814981 6273 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.815162 6273 ts_tablet_manager.cc:1397] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.010s
I20260928 10:43:56.816118 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:56.816125 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:56.816358 5883 raft_consensus.cc:2454] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:43:56.816679 5955 leader_election.cc:341] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.816910 5957 leader_election.cc:302] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.817131 6273 raft_consensus.cc:348] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.817281 6344 raft_consensus.cc:2781] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:56.817394 6273 raft_consensus.cc:374] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.817396 6344 raft_consensus.cc:482] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:56.817481 6273 raft_consensus.cc:729] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.817503 6344 raft_consensus.cc:3037] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.817718 6273 consensus_queue.cc:260] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.818250 6273 ts_tablet_manager.cc:1428] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 10:43:56.818583 6273 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.818833 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_69c7c49b76ee4bcea446b84a5b64dd69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.819428 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69c7c49b76ee4bcea446b84a5b64dd69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.820166 6273 tablet_bootstrap.cc:654] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.820148 6344 raft_consensus.cc:504] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.821583 6329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.126:39997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.100.126
--webserver_port=38451
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:43:56.821687 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_96e8a9a83ed748f7965066c48e25c57a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.822255 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96e8a9a83ed748f7965066c48e25c57a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.822907 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:56.823460 6329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260928 10:43:56.823505 5955 leader_election.cc:341] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.824241 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 97401498df144cc689066ea3033d68ef (DEFAULT_TABLE table=default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.824683 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97401498df144cc689066ea3033d68ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.824808 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 3168fb311ee64931bd326b043a397ea1 (DEFAULT_TABLE table=default.Table_41b8356a51a841219348f8ad61d5740e [id=a7c3de60394d49dfb609e35027411cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.825162 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3168fb311ee64931bd326b043a397ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.825860 6329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 10:43:56.826789 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9583b5637a428db383320d98a7a280 (DEFAULT_TABLE table=default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.827134 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9583b5637a428db383320d98a7a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.828986 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:56.829214 5883 raft_consensus.cc:3037] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:56.830770 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 1631d396362a4cffa1dec06d00894c63 (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.831197 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1631d396362a4cffa1dec06d00894c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.831894 5883 raft_consensus.cc:2454] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:56.832343 5957 leader_election.cc:302] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.832690 6281 raft_consensus.cc:2781] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:56.833668 6344 leader_election.cc:288] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:56.835798 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_32e8b879f27d4f2fa625629a00e8e969"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.836472 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32e8b879f27d4f2fa625629a00e8e969 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.836961 6271 tablet_bootstrap.cc:492] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.837107 6271 ts_tablet_manager.cc:1397] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.101s user 0.008s sys 0.001s
I20260928 10:43:56.837839 6271 raft_consensus.cc:348] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.838052 6271 raft_consensus.cc:374] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.838141 6271 raft_consensus.cc:729] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.838172 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_77e918f53d394bb49798bb0ca568f95f" } new_table_name: "default.Table_423a4f1dc8dd44c8a0a578be4f07c984" modify_external_catalogs: true
I20260928 10:43:56.839833 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 97401498df144cc689066ea3033d68ef (DEFAULT_TABLE table=default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.840279 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97401498df144cc689066ea3033d68ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.840335 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 3168fb311ee64931bd326b043a397ea1 (DEFAULT_TABLE table=default.Table_41b8356a51a841219348f8ad61d5740e [id=a7c3de60394d49dfb609e35027411cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.824241 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 734c3196929d4814b77bce7938bf598e (DEFAULT_TABLE table=default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.841012 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c3196929d4814b77bce7938bf598e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.842816 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1631d396362a4cffa1dec06d00894c63 (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.843171 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1631d396362a4cffa1dec06d00894c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.843927 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3168fb311ee64931bd326b043a397ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.846853 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 734c3196929d4814b77bce7938bf598e (DEFAULT_TABLE table=default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.847229 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c3196929d4814b77bce7938bf598e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.847779 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9583b5637a428db383320d98a7a280 (DEFAULT_TABLE table=default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.848042 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 734c3196929d4814b77bce7938bf598e (DEFAULT_TABLE table=default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.848202 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9583b5637a428db383320d98a7a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.848446 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c3196929d4814b77bce7938bf598e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.848783 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 1631d396362a4cffa1dec06d00894c63 (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.849131 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1631d396362a4cffa1dec06d00894c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.850750 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 3168fb311ee64931bd326b043a397ea1 (DEFAULT_TABLE table=default.Table_41b8356a51a841219348f8ad61d5740e [id=a7c3de60394d49dfb609e35027411cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.846832 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9583b5637a428db383320d98a7a280 (DEFAULT_TABLE table=default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.851123 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3168fb311ee64931bd326b043a397ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.851253 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9583b5637a428db383320d98a7a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.852285 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 97401498df144cc689066ea3033d68ef (DEFAULT_TABLE table=default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.852623 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97401498df144cc689066ea3033d68ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:56.856612 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a3d035581da47abb64156066e53fa67 consensus state has no leader
W20260928 10:43:56.856703 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d40123712b17464e87023f69a6235640 consensus state has no leader
I20260928 10:43:56.856773 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.857043 6270 tablet_replica.cc:330] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.857239 6270 raft_consensus.cc:2229] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.857450 6270 raft_consensus.cc:2258] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.858765 6270 ts_tablet_manager.cc:1905] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.859180 6271 consensus_queue.cc:260] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.861832 6281 raft_consensus.cc:686] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:56.862188 6281 consensus_queue.cc:237] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.869493 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.869823 6269 tablet_replica.cc:330] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.870042 6269 raft_consensus.cc:2229] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.870265 6269 raft_consensus.cc:2258] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.870697 6270 ts_tablet_manager.cc:1918] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.870836 6270 log.cc:1196] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9f6064f370434acb8fc02fda5b50ecf6
I20260928 10:43:56.871166 6269 ts_tablet_manager.cc:1905] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.871644 6270 ts_tablet_manager.cc:1939] T 9f6064f370434acb8fc02fda5b50ecf6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:56.871999 5856 tablet_service.cc:1467] Processing CreateTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c (DEFAULT_TABLE table=default.Table_36f44cef0950489584714a564fb6f52e [id=52bab93af95a4a3a8daa8e675154d7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.872231 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9f6064f370434acb8fc02fda5b50ecf6 (table default.Table_9fa7750af87240efb9e52060219b345c [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
I20260928 10:43:56.872464 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a0d63c6cbc4eebaf42dc7f969f243c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.878432 6269 ts_tablet_manager.cc:1918] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.878599 6269 log.cc:1196] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/b1f23ddb4368451d8c555e6e8dc52151
I20260928 10:43:56.880487 6355 raft_consensus.cc:482] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.880715 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_00fbff9d20b64e17a45b28933380b233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.881292 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00fbff9d20b64e17a45b28933380b233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.881465 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_63fa40ed403746539e45b1b98250d0c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.881945 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63fa40ed403746539e45b1b98250d0c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.882513 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_44607adb05b44b5cbd68b561ea8fae59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.882962 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44607adb05b44b5cbd68b561ea8fae59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.883261 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:56.880694 6355 raft_consensus.cc:504] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.884828 6269 ts_tablet_manager.cc:1939] T b1f23ddb4368451d8c555e6e8dc52151 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.884853 6355 leader_election.cc:288] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:43:56.885865 6090 leader_election.cc:341] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: fb061a69c1ea4464a1db06c8a20999ab
W20260928 10:43:56.886101 6091 leader_election.cc:341] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: fb061a69c1ea4464a1db06c8a20999ab
I20260928 10:43:56.886219 6091 leader_election.cc:302] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:56.886525 6355 raft_consensus.cc:2726] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.887703 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet fb061a69c1ea4464a1db06c8a20999ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.887985 6272 tablet_replica.cc:330] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.888029 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet b1f23ddb4368451d8c555e6e8dc52151 (table default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]) successfully deleted
I20260928 10:43:56.888165 6272 raft_consensus.cc:2229] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.888350 6272 raft_consensus.cc:2258] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.889271 6272 ts_tablet_manager.cc:1905] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.890417 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b5fc914143e40cebf6603bbc1b3195e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.893009 6271 ts_tablet_manager.cc:1428] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.056s user 0.002s sys 0.001s
I20260928 10:43:56.893339 6271 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.895565 6271 tablet_bootstrap.cc:654] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.896744 5996 tablet_service.cc:1467] Processing CreateTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c (DEFAULT_TABLE table=default.Table_36f44cef0950489584714a564fb6f52e [id=52bab93af95a4a3a8daa8e675154d7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.897161 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a0d63c6cbc4eebaf42dc7f969f243c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.897953 6272 ts_tablet_manager.cc:1918] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.898144 6272 log.cc:1196] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/fb061a69c1ea4464a1db06c8a20999ab
I20260928 10:43:56.898620 6272 ts_tablet_manager.cc:1939] T fb061a69c1ea4464a1db06c8a20999ab P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.899012 6280 raft_consensus.cc:482] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.899206 6280 raft_consensus.cc:504] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.899750 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet fb061a69c1ea4464a1db06c8a20999ab (table default.Table_a50c6af88ced410e9224954bc1aaf5f3 [id=5131911d0ab54413ba5545cdd938f939]) successfully deleted
I20260928 10:43:56.899893 6280 leader_election.cc:288] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.900486 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4064e4b82ce49a19849a550cc252976" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:43:56.900993 5818 leader_election.cc:341] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.901218 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4064e4b82ce49a19849a550cc252976" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:56.901782 6272 tablet_replica.cc:330] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.902020 6272 raft_consensus.cc:2229] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.902230 6272 raft_consensus.cc:2258] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.903131 6272 ts_tablet_manager.cc:1905] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.903566 6275 tablet_bootstrap.cc:654] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.904881 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
W20260928 10:43:56.905112 5817 leader_election.cc:341] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.905241 5817 leader_election.cc:302] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.906730 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_988cda94a8534a31a8c65d221e16833f" } new_table_name: "default.Table_31cadc2943274de99ca4c78618ea19fd" modify_external_catalogs: true
I20260928 10:43:56.906917 5695 catalog_manager.cc:5495] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:56.907446 5695 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:56.908390 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4fe535242cc142b386b28842193045ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:56.908970 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fe535242cc142b386b28842193045ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.908460 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_333faec6e5864a4982d5c0743c880176" } modify_external_catalogs: true
I20260928 10:43:56.909574 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_333faec6e5864a4982d5c0743c880176" } modify_external_catalogs: true
I20260928 10:43:56.909775 6128 tablet_service.cc:1467] Processing CreateTablet for tablet c2f078ae6d2b498d8c5af90afba887ad (DEFAULT_TABLE table=default.Table_e3a352988f2142aa9bf121a9c6015d98 [id=d97832b104544da6b36061c55120b204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.910220 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f078ae6d2b498d8c5af90afba887ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.910290 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d317ef6e443b4c10b5972fe1ad8e93ea" } modify_external_catalogs: true
I20260928 10:43:56.910440 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d317ef6e443b4c10b5972fe1ad8e93ea" } modify_external_catalogs: true
I20260928 10:43:56.911921 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_43fb3b30d5f74e2b94775478beb88474" } modify_external_catalogs: true
I20260928 10:43:56.912084 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_43fb3b30d5f74e2b94775478beb88474" } modify_external_catalogs: true
I20260928 10:43:56.912563 5996 tablet_service.cc:1467] Processing CreateTablet for tablet c2f078ae6d2b498d8c5af90afba887ad (DEFAULT_TABLE table=default.Table_e3a352988f2142aa9bf121a9c6015d98 [id=d97832b104544da6b36061c55120b204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.913040 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f078ae6d2b498d8c5af90afba887ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.913174 6280 raft_consensus.cc:2726] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.914614 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.914860 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.915256 5857 tablet_service.cc:1467] Processing CreateTablet for tablet c2f078ae6d2b498d8c5af90afba887ad (DEFAULT_TABLE table=default.Table_e3a352988f2142aa9bf121a9c6015d98 [id=d97832b104544da6b36061c55120b204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:56.915431 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.915814 6269 tablet_replica.cc:330] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.916051 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.916208 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.916340 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f078ae6d2b498d8c5af90afba887ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:56.916829 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:56.917519 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c97e247cfc4547558b59a4168fa7e3b0 consensus state has no leader
I20260928 10:43:56.917812 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 75ccd6efe3854d65995b17a38d81eaa5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.918409 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d9a96605aae94e7c808991e537e19ff4" } modify_external_catalogs: true
I20260928 10:43:56.918653 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d9a96605aae94e7c808991e537e19ff4" } modify_external_catalogs: true
I20260928 10:43:56.919100 6271 tablet_bootstrap.cc:492] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:56.919297 6271 ts_tablet_manager.cc:1397] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.004s
I20260928 10:43:56.920040 6269 raft_consensus.cc:2229] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.920262 6269 raft_consensus.cc:2258] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.920599 6271 raft_consensus.cc:348] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.920889 6271 raft_consensus.cc:374] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.920977 6271 raft_consensus.cc:729] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.921164 6269 ts_tablet_manager.cc:1905] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.921197 6271 consensus_queue.cc:260] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.921670 6271 ts_tablet_manager.cc:1428] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:56.924532 6273 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.924675 6273 ts_tablet_manager.cc:1397] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.011s
I20260928 10:43:56.925470 6273 raft_consensus.cc:348] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.925720 6273 raft_consensus.cc:374] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.925797 6273 raft_consensus.cc:729] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.926002 6273 consensus_queue.cc:260] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.929186 6273 ts_tablet_manager.cc:1428] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:43:56.929811 6272 ts_tablet_manager.cc:1918] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.929997 6272 log.cc:1196] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/5b5fc914143e40cebf6603bbc1b3195e
I20260928 10:43:56.930383 6272 ts_tablet_manager.cc:1939] T 5b5fc914143e40cebf6603bbc1b3195e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.931162 6273 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.931533 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 5b5fc914143e40cebf6603bbc1b3195e (table default.Table_5e6bb9e200964e02a016ade01c96e5ea [id=61b3d602c1864f2bb6d52f14fbeda19a]) successfully deleted
I20260928 10:43:56.932224 6271 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:56.933470 6273 tablet_bootstrap.cc:654] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.933796 6271 tablet_bootstrap.cc:654] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.935392 6275 tablet_bootstrap.cc:492] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:56.935590 6275 ts_tablet_manager.cc:1397] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.123s user 0.006s sys 0.003s
I20260928 10:43:56.936326 6275 raft_consensus.cc:348] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.936594 6275 raft_consensus.cc:374] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.936671 6275 raft_consensus.cc:729] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.936975 6275 consensus_queue.cc:260] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.937704 6275 ts_tablet_manager.cc:1428] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:56.940595 6275 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:56.942682 6273 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.942889 6273 ts_tablet_manager.cc:1397] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
W20260928 10:43:56.942448 6395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:56.943733 6273 raft_consensus.cc:348] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.944013 6273 raft_consensus.cc:374] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.944078 6273 raft_consensus.cc:729] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:56.944378 6273 consensus_queue.cc:260] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.946676 6273 ts_tablet_manager.cc:1428] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:43:56.948094 6273 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:56.950947 6275 tablet_bootstrap.cc:654] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.952121 6273 tablet_bootstrap.cc:654] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.955426 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 118ae3f8af264a31b7c22403c4951bdf from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:56.957062 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:56.955770 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ffb3c8206e614404828699d3794028a2" } modify_external_catalogs: true
I20260928 10:43:56.957448 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ffb3c8206e614404828699d3794028a2" } modify_external_catalogs: true
I20260928 10:43:56.956396 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_36f44cef0950489584714a564fb6f52e" } new_table_name: "default.Table_60251724bf62411b81c9c535aaf6a52e" modify_external_catalogs: true
W20260928 10:43:56.960533 6396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:56.965494 6269 ts_tablet_manager.cc:1918] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.965713 6269 log.cc:1196] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f4064e4b82ce49a19849a550cc252976
I20260928 10:43:56.966145 6269 ts_tablet_manager.cc:1939] T f4064e4b82ce49a19849a550cc252976 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:56.967362 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f4064e4b82ce49a19849a550cc252976 (table default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]) successfully deleted
I20260928 10:43:56.968736 6280 raft_consensus.cc:482] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.968935 6280 raft_consensus.cc:504] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.969671 6280 leader_election.cc:288] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:43:56.970909 5818 leader_election.cc:341] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 72ace49431a24469bef73c596af089ae
I20260928 10:43:56.971771 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72ace49431a24469bef73c596af089ae" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:56.972415 5817 leader_election.cc:341] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:56.972566 5817 leader_election.cc:302] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:56.972950 6280 raft_consensus.cc:2726] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.973268 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet b1f23ddb4368451d8c555e6e8dc52151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:54 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:56.973554 6272 tablet_replica.cc:330] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:56.973726 6272 raft_consensus.cc:2229] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.973927 6272 raft_consensus.cc:2258] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.974887 6272 ts_tablet_manager.cc:1905] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:56.979305 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28eb4bef35cc413ebbdc177de1d7b057 consensus state has no leader
I20260928 10:43:56.982096 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5c182ed527ae4f3eaabdf4eedd17650c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:56.982446 6273 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:56.982620 6273 ts_tablet_manager.cc:1397] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.012s
I20260928 10:43:56.983152 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:56.983551 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c182ed527ae4f3eaabdf4eedd17650c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:56.983626 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.983748 6273 raft_consensus.cc:348] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.983963 6273 raft_consensus.cc:374] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:56.984061 6273 raft_consensus.cc:729] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:43:56.984364 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9f6064f370434acb8fc02fda5b50ecf6 because the tablet was not found. No further retry: Not found: Tablet not found: 9f6064f370434acb8fc02fda5b50ecf6
I20260928 10:43:56.984293 6273 consensus_queue.cc:260] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:56.986137 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 345245f9349a4031af5ff278a3da74f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 97e20784940a4647a220ad74e3e15f83) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:56.986368 6270 tablet_replica.cc:330] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:56.987393 6270 raft_consensus.cc:2229] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.987587 6270 raft_consensus.cc:2258] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.987658 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
I20260928 10:43:56.987920 6273 ts_tablet_manager.cc:1428] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:43:56.988128 6355 raft_consensus.cc:482] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.988279 6355 raft_consensus.cc:504] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.989149 6355 leader_election.cc:288] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:56.989439 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:56.989468 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f8e172c5bf406196574895e5e5e3c7" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:56.989954 6281 raft_consensus.cc:482] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:56.990018 6270 ts_tablet_manager.cc:1905] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:56.990116 6281 raft_consensus.cc:504] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:56.990679 6281 leader_election.cc:288] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:56.991541 6273 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:56.991582 5957 leader_election.cc:341] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:56.991652 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
W20260928 10:43:56.991946 5955 leader_election.cc:341] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:56.992069 5955 leader_election.cc:302] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:56.992477 6272 ts_tablet_manager.cc:1918] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:56.992558 6281 raft_consensus.cc:2726] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.992600 6272 log.cc:1196] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/b1f23ddb4368451d8c555e6e8dc52151
I20260928 10:43:56.992966 6272 ts_tablet_manager.cc:1939] T b1f23ddb4368451d8c555e6e8dc52151 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:56.993503 6273 tablet_bootstrap.cc:654] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:56.993920 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet b1f23ddb4368451d8c555e6e8dc52151 (table default.Table_4bead06dc94a4736a4f3ae46ccd7fc8b [id=c636ee99af5a4e63b0b4756c5bcc74eb]) successfully deleted
I20260928 10:43:56.994314 6269 tablet_replica.cc:330] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:56.994513 6269 raft_consensus.cc:2229] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:56.994702 6269 raft_consensus.cc:2258] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:56.995389 6090 leader_election.cc:302] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:56.995817 6355 raft_consensus.cc:2726] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:56.996814 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 8276c29e44b54fc78844e3ef1e2e828f with delete_type TABLET_DATA_DELETED (replaced by tablet 4c93507a0bf14c8383794b34ba1702fd) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.002233 6270 ts_tablet_manager.cc:1918] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.002449 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f57cd5585604424d92b8ce2522085567
I20260928 10:43:57.002574 6270 log.cc:1196] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/345245f9349a4031af5ff278a3da74f0
I20260928 10:43:57.002332 6271 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.002971 6271 ts_tablet_manager.cc:1397] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.071s user 0.018s sys 0.026s
I20260928 10:43:57.003520 6269 ts_tablet_manager.cc:1905] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.003607 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.003858 6271 raft_consensus.cc:348] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.004101 6271 raft_consensus.cc:374] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.004189 6271 raft_consensus.cc:729] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.002976 6270 ts_tablet_manager.cc:1939] T 345245f9349a4031af5ff278a3da74f0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.004441 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.004449 6271 consensus_queue.cc:260] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.005745 6271 ts_tablet_manager.cc:1428] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260928 10:43:57.005779 6403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:43:57.006027 6271 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.006254 6270 tablet_replica.cc:330] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.006513 6270 raft_consensus.cc:2229] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.006723 6270 raft_consensus.cc:2258] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.007776 6329 server_base.cc:1034] running on GCE node
I20260928 10:43:57.008229 6271 tablet_bootstrap.cc:654] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.008292 6275 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.008471 6275 ts_tablet_manager.cc:1397] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.068s user 0.009s sys 0.009s
I20260928 10:43:57.009076 6329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:43:57.009262 6275 raft_consensus.cc:348] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.009513 6275 raft_consensus.cc:374] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.009614 6275 raft_consensus.cc:729] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.009837 6275 consensus_queue.cc:260] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.010352 6275 ts_tablet_manager.cc:1428] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.010694 6275 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.012485 6275 tablet_bootstrap.cc:654] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.016984 6271 tablet_bootstrap.cc:492] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.017187 6271 ts_tablet_manager.cc:1397] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260928 10:43:57.017421 6329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:43:57.017586 6273 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.017752 6273 ts_tablet_manager.cc:1397] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.012s
I20260928 10:43:57.019025 6271 raft_consensus.cc:348] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.019055 6273 raft_consensus.cc:348] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.019289 6271 raft_consensus.cc:374] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.019320 6273 raft_consensus.cc:374] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.019373 6271 raft_consensus.cc:729] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.019409 6273 raft_consensus.cc:729] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.021100 6273 consensus_queue.cc:260] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.021968 6275 tablet_bootstrap.cc:492] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.022192 6275 ts_tablet_manager.cc:1397] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20260928 10:43:57.023061 6275 raft_consensus.cc:348] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.023387 6275 raft_consensus.cc:374] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.023515 6275 raft_consensus.cc:729] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.023824 6275 consensus_queue.cc:260] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.024451 6275 ts_tablet_manager.cc:1428] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:57.024884 6275 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.025159 6273 ts_tablet_manager.cc:1428] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 10:43:57.025759 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:57.026525 6273 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.026775 6275 tablet_bootstrap.cc:654] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.028175 6273 tablet_bootstrap.cc:654] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.029383 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:57.030309 6269 ts_tablet_manager.cc:1918] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.030452 6269 log.cc:1196] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:57.030994 6269 ts_tablet_manager.cc:1939] T 5a89b64e0a7b43b589e7caf911836fb2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.031873 6269 tablet_replica.cc:330] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.032114 6269 raft_consensus.cc:2229] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.032284 6269 raft_consensus.cc:2258] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.032289 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 5a89b64e0a7b43b589e7caf911836fb2 (table default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2 [id=cd929aef5d0d45c5abd5c3c7a62e050c]) successfully deleted
I20260928 10:43:57.019642 6271 consensus_queue.cc:260] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.033160 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.033196 6329 hybrid_clock.cc:648] HybridClock initialized: now 1790592237032976 us; error 184 us; skew 500 ppm
I20260928 10:43:57.033576 6269 ts_tablet_manager.cc:1905] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.033675 6329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:43:57.036429 6271 ts_tablet_manager.cc:1428] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.019s user 0.001s sys 0.002s
I20260928 10:43:57.039785 6271 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.040800 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.041844 6271 tablet_bootstrap.cc:654] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.043471 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cf9361a96fdc44d7ac38a1d0d812eac0
I20260928 10:43:57.044420 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.045432 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.048516 6272 tablet_replica.cc:330] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.048564 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.048750 6272 raft_consensus.cc:2229] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.048928 6272 raft_consensus.cc:2258] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.049119 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.049937 6272 ts_tablet_manager.cc:1905] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.051566 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a89b64e0a7b43b589e7caf911836fb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.052076 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.052646 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 345245f9349a4031af5ff278a3da74f0 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:43:57.054553 6269 ts_tablet_manager.cc:1918] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.054725 6269 log.cc:1196] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1447a551d9264d18bd1eeabe31b513f1
I20260928 10:43:57.055145 6269 ts_tablet_manager.cc:1939] T 1447a551d9264d18bd1eeabe31b513f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.058516 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1447a551d9264d18bd1eeabe31b513f1 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
I20260928 10:43:57.058756 6269 tablet_replica.cc:330] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.058982 6269 raft_consensus.cc:2229] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.059182 6269 raft_consensus.cc:2258] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.060806 6269 ts_tablet_manager.cc:1905] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.060796 6155 raft_consensus.cc:3037] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:57.065382 6272 ts_tablet_manager.cc:1918] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.070202 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.071247 6272 log.cc:1196] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:57.071768 6272 ts_tablet_manager.cc:1939] T 5a89b64e0a7b43b589e7caf911836fb2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.073947 6269 ts_tablet_manager.cc:1918] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.073984 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 97401498df144cc689066ea3033d68ef
I20260928 10:43:57.074095 6269 log.cc:1196] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/72ace49431a24469bef73c596af089ae
I20260928 10:43:57.075063 6270 ts_tablet_manager.cc:1905] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.079207 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.080847 6271 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.081000 6271 ts_tablet_manager.cc:1397] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260928 10:43:57.082144 6270 ts_tablet_manager.cc:1918] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.082135 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eb59fc6c47c8422a9bfa5c523ec590d4" } new_table_name: "default.Table_922ff47b37674ce099a7cab4c39b7167" modify_external_catalogs: true
I20260928 10:43:57.082348 6270 log.cc:1196] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8276c29e44b54fc78844e3ef1e2e828f
I20260928 10:43:57.082789 6270 ts_tablet_manager.cc:1939] T 8276c29e44b54fc78844e3ef1e2e828f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.084069 6270 tablet_replica.cc:330] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.084296 6270 raft_consensus.cc:2229] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.084537 6270 raft_consensus.cc:2258] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.084779 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 68e1b25f634e48008f5262aed44010da from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.081770 6271 raft_consensus.cc:348] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.084967 6271 raft_consensus.cc:374] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.085080 6271 raft_consensus.cc:729] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.085327 6271 consensus_queue.cc:260] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.085462 6270 ts_tablet_manager.cc:1905] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.089576 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_32e8b879f27d4f2fa625629a00e8e969" } new_table_name: "default.Table_e690f55d690b46358de9c97d59e9644b" modify_external_catalogs: true
I20260928 10:43:57.090878 6271 ts_tablet_manager.cc:1428] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260928 10:43:57.091532 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4f6a4e302e974b1eb5f7a129221e1d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.091681 6281 raft_consensus.cc:482] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.091814 6281 raft_consensus.cc:504] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:57.092113 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f6a4e302e974b1eb5f7a129221e1d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.092231 6269 ts_tablet_manager.cc:1939] T 72ace49431a24469bef73c596af089ae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.092350 6281 leader_election.cc:288] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:43:57.093307 5957 leader_election.cc:341] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:57.093694 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 72ace49431a24469bef73c596af089ae (table default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
W20260928 10:43:57.095608 5955 leader_election.cc:341] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:57.095754 5955 leader_election.cc:302] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:57.096235 6281 raft_consensus.cc:2726] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:43:57.096779 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b1f23ddb4368451d8c555e6e8dc52151 because the tablet was not found. No further retry: Not found: Tablet not found: b1f23ddb4368451d8c555e6e8dc52151
I20260928 10:43:57.097046 6269 tablet_replica.cc:330] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.098336 6269 raft_consensus.cc:2229] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.098429 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.098572 6269 raft_consensus.cc:2258] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.099932 6269 ts_tablet_manager.cc:1905] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.099951 6271 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:43:57.101532 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f57cd5585604424d92b8ce2522085567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57cd5585604424d92b8ce2522085567 already in progress: creating tablet
I20260928 10:43:57.102793 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 5a89b64e0a7b43b589e7caf911836fb2 (table default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2 [id=cd929aef5d0d45c5abd5c3c7a62e050c]) successfully deleted
I20260928 10:43:57.103662 6270 ts_tablet_manager.cc:1918] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:43:57.103698 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cf9361a96fdc44d7ac38a1d0d812eac0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9361a96fdc44d7ac38a1d0d812eac0 already in progress: creating tablet
W20260928 10:43:57.103986 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 97401498df144cc689066ea3033d68ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97401498df144cc689066ea3033d68ef already in progress: creating tablet
I20260928 10:43:57.104229 6275 tablet_bootstrap.cc:492] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.104405 6275 ts_tablet_manager.cc:1397] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.023s
I20260928 10:43:57.105198 6270 log.cc:1196] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f4064e4b82ce49a19849a550cc252976
I20260928 10:43:57.105222 6275 raft_consensus.cc:348] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.105465 6275 raft_consensus.cc:374] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.105556 6275 raft_consensus.cc:729] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:43:57.105911 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9a0d63c6cbc4eebaf42dc7f969f243c consensus state has no leader
I20260928 10:43:57.105818 6275 consensus_queue.cc:260] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.106022 6270 ts_tablet_manager.cc:1939] T f4064e4b82ce49a19849a550cc252976 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.106509 6275 ts_tablet_manager.cc:1428] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.106827 6275 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.104002 6271 tablet_bootstrap.cc:654] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.111131 6275 tablet_bootstrap.cc:654] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.111526 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.111776 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.112527 6270 tablet_replica.cc:330] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.113075 6270 raft_consensus.cc:2229] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.113770 6270 raft_consensus.cc:2258] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.114312 6273 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.114566 6273 ts_tablet_manager.cc:1397] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.088s user 0.008s sys 0.023s
I20260928 10:43:57.115634 6270 ts_tablet_manager.cc:1905] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:57.115759 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82b3afe074194023ba788094a2a6b81c has no consensus state
I20260928 10:43:57.116073 6273 raft_consensus.cc:348] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.116333 6273 raft_consensus.cc:374] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.116446 6273 raft_consensus.cc:729] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.116710 6273 consensus_queue.cc:260] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.119621 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_18107c18586f46468e64191ca0006cc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.119871 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (DEFAULT_TABLE table=default.Table_69c7c49b76ee4bcea446b84a5b64dd69 [id=92f40b0873ca472db40650520fdfa06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.120139 5854 tablet_service.cc:1467] Processing CreateTablet for tablet dfd9b4092b1242b8a60974c445a2789a (DEFAULT_TABLE table=default.Table_32e8b879f27d4f2fa625629a00e8e969 [id=1fc32d0deb66442db0f46fe989de0d55]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:57.120246 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18107c18586f46468e64191ca0006cc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.120323 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.120687 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 82b3afe074194023ba788094a2a6b81c (DEFAULT_TABLE table=default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.119621 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cd7575bfe86d47dcaa4965e2c3745c9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.121031 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b3afe074194023ba788094a2a6b81c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.121287 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd7575bfe86d47dcaa4965e2c3745c9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.123229 5853 tablet_service.cc:1467] Processing CreateTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 (DEFAULT_TABLE table=default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.123642 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2635c7c47ba4383b6b0f07cd3b42f74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.125795 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfd9b4092b1242b8a60974c445a2789a consensus state has no leader
I20260928 10:43:57.126147 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a22814f9f7c4a3aa9bc76471f973c53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.119871 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 43d5479a2ce44c20a9437720820f3cec (DEFAULT_TABLE table=default.Table_96e8a9a83ed748f7965066c48e25c57a [id=1594b568b0ff4e288800f014304d6757]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:57.126840 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a22814f9f7c4a3aa9bc76471f973c53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.127218 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 43d5479a2ce44c20a9437720820f3cec (DEFAULT_TABLE table=default.Table_96e8a9a83ed748f7965066c48e25c57a [id=1594b568b0ff4e288800f014304d6757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.127645 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d5479a2ce44c20a9437720820f3cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.129098 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_41038208e21c49a59c2faa2bb583cb84" } new_table_name: "default.Table_dd487bf423e44aa3b7c72ea54b5f2283" modify_external_catalogs: true
I20260928 10:43:57.129845 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd9b4092b1242b8a60974c445a2789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.134580 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d5479a2ce44c20a9437720820f3cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.137979 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3b7a6c48055c4508aa41c0b85d5c1f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.138798 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b7a6c48055c4508aa41c0b85d5c1f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.139133 6271 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.139338 6271 ts_tablet_manager.cc:1397] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.002s
I20260928 10:43:57.140201 6271 raft_consensus.cc:348] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.140478 6271 raft_consensus.cc:374] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.140559 6271 raft_consensus.cc:729] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.140834 6271 consensus_queue.cc:260] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.142074 6275 tablet_bootstrap.cc:492] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.142400 6275 ts_tablet_manager.cc:1397] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20260928 10:43:57.142810 6126 tablet_service.cc:1467] Processing CreateTablet for tablet dfd9b4092b1242b8a60974c445a2789a (DEFAULT_TABLE table=default.Table_32e8b879f27d4f2fa625629a00e8e969 [id=1fc32d0deb66442db0f46fe989de0d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.143355 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd9b4092b1242b8a60974c445a2789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.143237 6275 raft_consensus.cc:348] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.144277 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (DEFAULT_TABLE table=default.Table_69c7c49b76ee4bcea446b84a5b64dd69 [id=92f40b0873ca472db40650520fdfa06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.110577 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8276c29e44b54fc78844e3ef1e2e828f (table default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:43:57.145143 6275 raft_consensus.cc:374] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.145282 6275 raft_consensus.cc:729] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.145725 6128 tablet_service.cc:1467] Processing CreateTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 (DEFAULT_TABLE table=default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.145617 6275 consensus_queue.cc:260] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.146708 6275 ts_tablet_manager.cc:1428] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:57.147022 6271 ts_tablet_manager.cc:1428] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:43:57.147281 6275 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.147636 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.148831 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2635c7c47ba4383b6b0f07cd3b42f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.151132 6273 ts_tablet_manager.cc:1428] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 10:43:57.151433 6271 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.152648 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 82b3afe074194023ba788094a2a6b81c (DEFAULT_TABLE table=default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.153084 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b3afe074194023ba788094a2a6b81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.154662 6355 raft_consensus.cc:482] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.154836 6355 raft_consensus.cc:504] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.155458 6355 leader_election.cc:288] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:57.155700 6275 tablet_bootstrap.cc:654] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.155771 6273 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.156869 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.158674 6271 tablet_bootstrap.cc:654] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.160522 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e04f84d5cc324c5195b178466810f64e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.160912 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a392670fdb5a4d4097c7edaf8f6642ce" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:43:57.161144 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e04f84d5cc324c5195b178466810f64e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.161314 5883 raft_consensus.cc:2379] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:43:57.163072 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.163559 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.164631 6273 tablet_bootstrap.cc:654] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.164880 6091 leader_election.cc:302] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:57.165315 6355 raft_consensus.cc:3037] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:57.168102 6270 ts_tablet_manager.cc:1918] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.168229 6270 log.cc:1196] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/5a89b64e0a7b43b589e7caf911836fb2
I20260928 10:43:57.168586 6270 ts_tablet_manager.cc:1939] T 5a89b64e0a7b43b589e7caf911836fb2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.168957 6355 raft_consensus.cc:2726] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.174396 6275 tablet_bootstrap.cc:492] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.174573 6275 ts_tablet_manager.cc:1397] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.001s
I20260928 10:43:57.175276 6275 raft_consensus.cc:348] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.175487 6275 raft_consensus.cc:374] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.175580 6275 raft_consensus.cc:729] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.175765 6275 consensus_queue.cc:260] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.176630 6275 ts_tablet_manager.cc:1428] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:57.176877 6275 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.178401 6275 tablet_bootstrap.cc:654] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.179371 6273 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:43:57.162192 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f57cd5585604424d92b8ce2522085567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57cd5585604424d92b8ce2522085567 already in progress: creating tablet
I20260928 10:43:57.179569 6273 ts_tablet_manager.cc:1397] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20260928 10:43:57.179845 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f4064e4b82ce49a19849a550cc252976 (table default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]) successfully deleted
I20260928 10:43:57.181233 6273 raft_consensus.cc:348] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.181480 6273 raft_consensus.cc:374] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.181563 6273 raft_consensus.cc:729] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.181843 6273 consensus_queue.cc:260] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.182662 6270 tablet_replica.cc:330] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.183108 6270 raft_consensus.cc:2229] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.183825 6270 raft_consensus.cc:2258] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.182016 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 5a89b64e0a7b43b589e7caf911836fb2 (table default.Table_f9c569cbf8fa4405abfb4b2b12bdc4f2 [id=cd929aef5d0d45c5abd5c3c7a62e050c]) successfully deleted
W20260928 10:43:57.185074 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cf9361a96fdc44d7ac38a1d0d812eac0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9361a96fdc44d7ac38a1d0d812eac0 already in progress: creating tablet
I20260928 10:43:57.185148 6270 ts_tablet_manager.cc:1905] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.185791 6273 ts_tablet_manager.cc:1428] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
W20260928 10:43:57.186324 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 97401498df144cc689066ea3033d68ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97401498df144cc689066ea3033d68ef already in progress: creating tablet
I20260928 10:43:57.189098 6273 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.190109 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 43d5479a2ce44c20a9437720820f3cec (DEFAULT_TABLE table=default.Table_96e8a9a83ed748f7965066c48e25c57a [id=1594b568b0ff4e288800f014304d6757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.190519 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d5479a2ce44c20a9437720820f3cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.193084 6269 ts_tablet_manager.cc:1918] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.193226 6269 log.cc:1196] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8358dd69e3d24743a79c681e2316dfe1
I20260928 10:43:57.193565 6269 ts_tablet_manager.cc:1939] T 8358dd69e3d24743a79c681e2316dfe1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.194630 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8358dd69e3d24743a79c681e2316dfe1 (table default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]) successfully deleted
I20260928 10:43:57.196182 6273 tablet_bootstrap.cc:654] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.198683 5990 tablet_service.cc:1467] Processing CreateTablet for tablet dfd9b4092b1242b8a60974c445a2789a (DEFAULT_TABLE table=default.Table_32e8b879f27d4f2fa625629a00e8e969 [id=1fc32d0deb66442db0f46fe989de0d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.199231 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfd9b4092b1242b8a60974c445a2789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.201476 6270 ts_tablet_manager.cc:1918] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.201646 6270 log.cc:1196] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8358dd69e3d24743a79c681e2316dfe1
I20260928 10:43:57.202034 6270 ts_tablet_manager.cc:1939] T 8358dd69e3d24743a79c681e2316dfe1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.204214 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (DEFAULT_TABLE table=default.Table_69c7c49b76ee4bcea446b84a5b64dd69 [id=92f40b0873ca472db40650520fdfa06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.204370 6269 tablet_replica.cc:330] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.204595 6269 raft_consensus.cc:2229] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.204634 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.204793 6269 raft_consensus.cc:2258] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.207211 6269 ts_tablet_manager.cc:1905] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.207386 5998 tablet_service.cc:1467] Processing CreateTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 (DEFAULT_TABLE table=default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.207882 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2635c7c47ba4383b6b0f07cd3b42f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.214794 6273 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.214974 6273 ts_tablet_manager.cc:1397] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20260928 10:43:57.215828 6273 raft_consensus.cc:348] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.216130 6273 raft_consensus.cc:374] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.216221 6273 raft_consensus.cc:729] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.216496 6273 consensus_queue.cc:260] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.219920 6273 ts_tablet_manager.cc:1428] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:43:57.222309 6156 raft_consensus.cc:1261] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:57.223162 6281 consensus_queue.cc:1035] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:57.221822 5883 raft_consensus.cc:1261] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:57.221238 6273 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.225165 6281 consensus_queue.cc:1035] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:57.234441 6273 tablet_bootstrap.cc:654] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:57.234966 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbd5d1ccd2e54f3884af3af327bb892e consensus state has no leader
I20260928 10:43:57.235435 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5d1843f7fdad49b58bf61b192e5f37bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.236063 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d1843f7fdad49b58bf61b192e5f37bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.237926 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a8fc7cfa93d4b88a2320d8689645a43" } new_table_name: "default.Table_1c13a45c9a2248a9a00aea0ca2a8af55" modify_external_catalogs: true
I20260928 10:43:57.238690 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 118ae3f8af264a31b7c22403c4951bdf
I20260928 10:43:57.239180 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 118ae3f8af264a31b7c22403c4951bdf deleted and replaced by tablet 3c957158dbd949e88554e70fe6146089
I20260928 10:43:57.239530 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3e98e3a878de4461bb9ad47b99d2ffc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.240186 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e98e3a878de4461bb9ad47b99d2ffc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.241394 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:43:57.241446 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.242938 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.244364 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 317446124e354bbeaaef608d9e8852fd
I20260928 10:43:57.244956 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.245668 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.245849 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_44607adb05b44b5cbd68b561ea8fae59" } modify_external_catalogs: true
I20260928 10:43:57.246097 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_44607adb05b44b5cbd68b561ea8fae59" } modify_external_catalogs: true
I20260928 10:43:57.246907 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8dc2417a516c4b5684c3b3a640c11014" } modify_external_catalogs: true
I20260928 10:43:57.247095 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8dc2417a516c4b5684c3b3a640c11014" } modify_external_catalogs: true
I20260928 10:43:57.256254 6273 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.256491 6273 ts_tablet_manager.cc:1397] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
I20260928 10:43:57.257332 6273 raft_consensus.cc:348] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.257616 6273 raft_consensus.cc:374] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.257683 6273 raft_consensus.cc:729] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.259609 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.259663 6269 ts_tablet_manager.cc:1918] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.259802 6269 log.cc:1196] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:57.261370 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.263163 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 82b3afe074194023ba788094a2a6b81c (DEFAULT_TABLE table=default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.263916 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b3afe074194023ba788094a2a6b81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.263985 6416 mvcc.cc:205] Tried to move back new op lower bound from 7334265803648589824 to 7334265802190692352. Current Snapshot: MvccSnapshot[applied={T|T < 7334265803648589824}]
I20260928 10:43:57.266829 6269 ts_tablet_manager.cc:1939] T e6aa426fd7c5444ca7db936da87d2d1c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.267941 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e6aa426fd7c5444ca7db936da87d2d1c (table default.Table_2f6a862b6954477fbb331f27dcfebc98 [id=8ebad4d6e6d449348b25b5710471ae86]) successfully deleted
I20260928 10:43:57.271783 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.272910 6273 consensus_queue.cc:260] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.273476 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.273806 6270 tablet_replica.cc:330] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.274010 6270 raft_consensus.cc:2229] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.274199 6270 raft_consensus.cc:2258] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.274979 6270 ts_tablet_manager.cc:1905] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.275162 6273 ts_tablet_manager.cc:1428] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.019s user 0.001s sys 0.002s
I20260928 10:43:57.277180 6273 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.278103 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.278355 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.278743 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.278800 6269 tablet_replica.cc:330] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.279011 6269 raft_consensus.cc:2229] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.279182 6269 raft_consensus.cc:2258] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.281071 6270 ts_tablet_manager.cc:1918] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.281198 6270 log.cc:1196] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:57.281679 6270 ts_tablet_manager.cc:1939] T e6aa426fd7c5444ca7db936da87d2d1c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:57.282594 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 118ae3f8af264a31b7c22403c4951bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 118ae3f8af264a31b7c22403c4951bdf already in progress: creating tablet
I20260928 10:43:57.282796 6269 ts_tablet_manager.cc:1905] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:57.283048 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 59bfe1f8050f47429ef80a19fdcd8198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59bfe1f8050f47429ef80a19fdcd8198 already in progress: creating tablet
W20260928 10:43:57.283331 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 317446124e354bbeaaef608d9e8852fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 317446124e354bbeaaef608d9e8852fd already in progress: creating tablet
I20260928 10:43:57.285315 6431 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:57.285389 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8358dd69e3d24743a79c681e2316dfe1 (table default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]) successfully deleted
I20260928 10:43:57.287318 6273 tablet_bootstrap.cc:654] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.287524 6430 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:57.291383 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:57.291631 6390 consensus_queue.cc:1035] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:57.293695 6429 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:57.295218 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0bfbdb2023d34addb72137cd913ed484" } modify_external_catalogs: true
I20260928 10:43:57.295524 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0bfbdb2023d34addb72137cd913ed484" } modify_external_catalogs: true
I20260928 10:43:57.293587 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e6aa426fd7c5444ca7db936da87d2d1c (table default.Table_2f6a862b6954477fbb331f27dcfebc98 [id=8ebad4d6e6d449348b25b5710471ae86]) successfully deleted
W20260928 10:43:57.300187 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 59bfe1f8050f47429ef80a19fdcd8198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59bfe1f8050f47429ef80a19fdcd8198 already in progress: creating tablet
W20260928 10:43:57.300678 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 317446124e354bbeaaef608d9e8852fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 317446124e354bbeaaef608d9e8852fd already in progress: creating tablet
W20260928 10:43:57.300974 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 118ae3f8af264a31b7c22403c4951bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 118ae3f8af264a31b7c22403c4951bdf already in progress: creating tablet
I20260928 10:43:57.301247 5668 master_runner.cc:186] Error getting master registration for 127.5.100.126:39997: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection refused (error 111),
I20260928 10:43:57.301399 5668 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 10:43:57.303510 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]). Expected version 1 got 0
I20260928 10:43:57.303742 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_8a8fc7cfa93d4b88a2320d8689645a43 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 2 got 0
I20260928 10:43:57.306586 6275 tablet_bootstrap.cc:492] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.306790 6275 ts_tablet_manager.cc:1397] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.130s user 0.017s sys 0.019s
I20260928 10:43:57.308459 6275 raft_consensus.cc:348] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.308720 6275 raft_consensus.cc:374] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.308804 6275 raft_consensus.cc:729] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.309067 6275 consensus_queue.cc:260] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.309589 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e3a352988f2142aa9bf121a9c6015d98" } new_table_name: "default.Table_e1ac09d1496a4872a1200c7b5a277c41" modify_external_catalogs: true
I20260928 10:43:57.310941 6275 ts_tablet_manager.cc:1428] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:43:57.317570 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_91702b0277c943068af0c1f3ac3b6604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.318346 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91702b0277c943068af0c1f3ac3b6604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.327654 6271 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.327823 6271 ts_tablet_manager.cc:1397] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.176s user 0.041s sys 0.050s
I20260928 10:43:57.328699 6275 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.328585 6271 raft_consensus.cc:348] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:57.328806 6271 raft_consensus.cc:374] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.328899 6271 raft_consensus.cc:729] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.329141 6271 consensus_queue.cc:260] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:57.329798 6271 ts_tablet_manager.cc:1428] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.330085 6271 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.330310 6275 tablet_bootstrap.cc:654] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.332221 6271 tablet_bootstrap.cc:654] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:57.337515 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 82b3afe074194023ba788094a2a6b81c (table default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82b3afe074194023ba788094a2a6b81c consensus state has no leader
I20260928 10:43:57.327548 6269 ts_tablet_manager.cc:1918] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.341709 6269 log.cc:1196] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:57.342163 6269 ts_tablet_manager.cc:1939] T 0f81c769b5324ca4a68134e30da7fda1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.343514 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0f81c769b5324ca4a68134e30da7fda1 (table default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]) successfully deleted
I20260928 10:43:57.343665 6269 tablet_replica.cc:330] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.343844 6269 raft_consensus.cc:2229] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:43:57.343849 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f57cd5585604424d92b8ce2522085567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57cd5585604424d92b8ce2522085567 already in progress: creating tablet
I20260928 10:43:57.344043 6269 raft_consensus.cc:2258] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.344466 6344 consensus_queue.cc:1035] T 8738830fc8f8439fa60f561db9ce31d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:43:57.346086 6269 ts_tablet_manager.cc:1905] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.348817 6329 webserver.cc:460] Webserver started at http://127.5.100.126:38451/ using document root <none> and password file <none>
I20260928 10:43:57.350265 6329 fs_manager.cc:359] Metadata directory not provided
I20260928 10:43:57.351553 6329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:43:57.355274 6430 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:43:57.355633 6269 ts_tablet_manager.cc:1918] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.355800 6269 log.cc:1196] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e76a54bfddc74a9e86285add7b97645b
I20260928 10:43:57.356216 6269 ts_tablet_manager.cc:1939] T e76a54bfddc74a9e86285add7b97645b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.363174 6275 tablet_bootstrap.cc:492] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.363423 6275 ts_tablet_manager.cc:1397] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.006s
I20260928 10:43:57.364187 6275 raft_consensus.cc:348] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.364531 6275 raft_consensus.cc:374] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.364694 6275 raft_consensus.cc:729] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.364866 6271 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.365058 6271 ts_tablet_manager.cc:1397] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.005s
I20260928 10:43:57.365095 6273 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.365252 6273 ts_tablet_manager.cc:1397] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.001s
I20260928 10:43:57.365098 6275 consensus_queue.cc:260] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.365990 6275 ts_tablet_manager.cc:1428] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.365878 6271 raft_consensus.cc:348] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.366029 6273 raft_consensus.cc:348] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.366238 6271 raft_consensus.cc:374] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.366310 6273 raft_consensus.cc:374] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.366326 6271 raft_consensus.cc:729] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.366421 6273 raft_consensus.cc:729] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.366639 6271 consensus_queue.cc:260] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.366711 6273 consensus_queue.cc:260] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.367201 6271 ts_tablet_manager.cc:1428] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.367326 6273 ts_tablet_manager.cc:1428] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 10:43:57.367552 6271 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.367619 6273 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.369300 6273 tablet_bootstrap.cc:654] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.370136 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_01e7025c16c843ffb7cf7d80038d6a72 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 1 got 0
I20260928 10:43:57.371119 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0fcd40a19a704aa1986c1404e9d53824" } new_table_name: "default.Table_c54e444afb3043c0adbaeafa7e6edb1c" modify_external_catalogs: true
I20260928 10:43:57.373016 6271 tablet_bootstrap.cc:654] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.373265 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3b7a6c48055c4508aa41c0b85d5c1f6e" } new_table_name: "default.Table_8a054ca5f8f14a83aa001fe1b81ef734" modify_external_catalogs: true
I20260928 10:43:57.374540 5693 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 30e1ed34a8c24eb4828454f539a96df8
I20260928 10:43:57.374747 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet af258604238c4e39adac40c81d5a6f3f from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.375101 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 734c3196929d4814b77bce7938bf598e
I20260928 10:43:57.375578 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 72ace49431a24469bef73c596af089ae from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.376032 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet e40f72ff466e4befb74290fd39285119 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.376693 6329 fs_manager.cc:709] Time spent opening directory manager: real 0.022s user 0.009s sys 0.001s
I20260928 10:43:57.379942 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet f9a0d63c6cbc4eebaf42dc7f969f243c from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.383009 6273 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.383181 6273 ts_tablet_manager.cc:1397] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.000s
I20260928 10:43:57.383878 6273 raft_consensus.cc:348] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:57.384116 6273 raft_consensus.cc:374] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.384684 6273 raft_consensus.cc:729] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.384725 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.385013 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.385015 6273 consensus_queue.cc:260] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:57.386722 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e76a54bfddc74a9e86285add7b97645b (table default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]) successfully deleted
I20260928 10:43:57.387748 6280 raft_consensus.cc:482] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.387887 6280 raft_consensus.cc:504] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.388525 6280 leader_election.cc:288] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:57.388661 6280 raft_consensus.cc:482] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.388787 6280 raft_consensus.cc:504] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.389228 6280 leader_election.cc:288] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:57.389488 6440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:43:57.390615 6273 ts_tablet_manager.cc:1428] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260928 10:43:57.390700 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 3 got 2
I20260928 10:43:57.391157 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.391563 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:43:57.391981 5818 leader_election.cc:341] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:57.392191 5818 leader_election.cc:341] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.392185 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:57.393132 5817 leader_election.cc:341] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.393236 5817 leader_election.cc:302] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:57.393651 6329 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.001s sys 0.007s
I20260928 10:43:57.393709 6280 raft_consensus.cc:2726] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.393584 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b34ae7f4b0094611a67b40e6d1e9306c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.394054 6273 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:57.394225 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b34ae7f4b0094611a67b40e6d1e9306c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.393829 6329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
uuid: "a2eb817eda984ab99ec4704c47699846"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:43:57.395275 6329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:43:57.396286 6269 tablet_replica.cc:330] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.396498 6269 raft_consensus.cc:2229] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.396574 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 3 got 2
I20260928 10:43:57.396647 6269 raft_consensus.cc:2258] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.397404 6269 ts_tablet_manager.cc:1905] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.403338 6273 tablet_bootstrap.cc:654] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.407079 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:57.408227 5817 leader_election.cc:341] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.408423 5817 leader_election.cc:302] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:57.408850 6280 raft_consensus.cc:2726] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:43:57.409870 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 44061.2us
I20260928 10:43:57.411535 6273 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.411713 6273 ts_tablet_manager.cc:1397] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260928 10:43:57.412918 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 8358dd69e3d24743a79c681e2316dfe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.413406 6272 tablet_replica.cc:330] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.413616 6272 raft_consensus.cc:2229] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.413494 6273 raft_consensus.cc:348] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.413794 6273 raft_consensus.cc:374] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.413815 6272 raft_consensus.cc:2258] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.413897 6273 raft_consensus.cc:729] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.414175 6273 consensus_queue.cc:260] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.415048 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6064f370434acb8fc02fda5b50ecf6 with delete_type TABLET_DATA_DELETED (replaced by tablet 780707959e0e48d6a83b22e6479a5884) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.415886 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dee0748fe04da7b4e07bfdfdb8cb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.417523 6273 ts_tablet_manager.cc:1428] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260928 10:43:57.419055 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet f4064e4b82ce49a19849a550cc252976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.420701 6273 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.422658 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.420406 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.424098 6269 ts_tablet_manager.cc:1918] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.424261 6269 log.cc:1196] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/2693b378215f425bb1c2e3e0963aac95
I20260928 10:43:57.424625 6269 ts_tablet_manager.cc:1939] T 2693b378215f425bb1c2e3e0963aac95 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.422070 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 72ace49431a24469bef73c596af089ae with delete_type TABLET_DATA_DELETED (replaced by tablet 16f7d561b10e46609f22ce17b323fb23) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.434051 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.434369 6270 tablet_replica.cc:330] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.434619 6270 raft_consensus.cc:2229] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.434806 6270 raft_consensus.cc:2258] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.435344 6273 tablet_bootstrap.cc:654] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.435599 6270 ts_tablet_manager.cc:1905] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.438439 6429 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:43:57.439230 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.439530 6431 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:43:57.439627 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0678bdc10bb74b3d922dc53a158bc752"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.440445 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0678bdc10bb74b3d922dc53a158bc752 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.445675 6270 ts_tablet_manager.cc:1918] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.445851 6270 log.cc:1196] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1447a551d9264d18bd1eeabe31b513f1
I20260928 10:43:57.446218 6270 ts_tablet_manager.cc:1939] T 1447a551d9264d18bd1eeabe31b513f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.447279 6270 tablet_replica.cc:330] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.447491 6270 raft_consensus.cc:2229] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.447585 6269 tablet_replica.cc:330] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.447777 6269 raft_consensus.cc:2229] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.448227 6270 raft_consensus.cc:2258] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.448244 6269 raft_consensus.cc:2258] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.448987 6270 ts_tablet_manager.cc:1905] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.449023 6269 ts_tablet_manager.cc:1905] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.450453 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]). Expected version 3 got 2
I20260928 10:43:57.450758 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
W20260928 10:43:57.456010 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 734c3196929d4814b77bce7938bf598e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c3196929d4814b77bce7938bf598e already in progress: creating tablet
I20260928 10:43:57.456482 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1447a551d9264d18bd1eeabe31b513f1 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
I20260928 10:43:57.456672 6273 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.456832 6273 ts_tablet_manager.cc:1397] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
W20260928 10:43:57.457593 5687 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997): Couldn't send request to peer a2eb817eda984ab99ec4704c47699846. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 10:43:57.457574 6273 raft_consensus.cc:348] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.457826 6273 raft_consensus.cc:374] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.457896 6273 raft_consensus.cc:729] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.458789 6273 consensus_queue.cc:260] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.459720 6275 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.460537 6273 ts_tablet_manager.cc:1428] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 10:43:57.460953 6270 ts_tablet_manager.cc:1918] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.461103 6270 log.cc:1196] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/2693b378215f425bb1c2e3e0963aac95
I20260928 10:43:57.461503 6270 ts_tablet_manager.cc:1939] T 2693b378215f425bb1c2e3e0963aac95 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.461571 6275 tablet_bootstrap.cc:654] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.461740 6273 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.463280 6272 ts_tablet_manager.cc:1905] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.463992 6273 tablet_bootstrap.cc:654] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.464313 6430 tablet.cc:1722] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:43:57.468115 6269 ts_tablet_manager.cc:1918] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.468262 6269 log.cc:1196] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1454e1e8bea746c0883c738ba8a293b9
I20260928 10:43:57.468639 6269 ts_tablet_manager.cc:1939] T 1454e1e8bea746c0883c738ba8a293b9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.469676 6272 ts_tablet_manager.cc:1918] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.471567 6272 log.cc:1196] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8358dd69e3d24743a79c681e2316dfe1
I20260928 10:43:57.472107 6272 ts_tablet_manager.cc:1939] T 8358dd69e3d24743a79c681e2316dfe1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.472970 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 2693b378215f425bb1c2e3e0963aac95 (table default.Table_51b6797b284b4bab9e23e290a53926fc [id=9bfa888c61bf433cab0fe7ef138106a5]) successfully deleted
I20260928 10:43:57.473060 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8358dd69e3d24743a79c681e2316dfe1 (table default.Table_1184af35f5874ebcb03cf04c2291fa78 [id=2add7df9a2714b1eb44de4c251a3c51e]) successfully deleted
I20260928 10:43:57.473409 6272 tablet_replica.cc:330] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.473835 6272 raft_consensus.cc:2229] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.474314 6272 raft_consensus.cc:2258] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.476995 6272 ts_tablet_manager.cc:1905] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:57.498202 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84912292d6c34a3991bd0f885de240a8 has no consensus state
W20260928 10:43:57.498575 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2f078ae6d2b498d8c5af90afba887ad consensus state has no leader
I20260928 10:43:57.498658 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a27210443a334e1791928f47d34cbbf4" } new_table_name: "default.Table_89caef5f6e1943cd824b68ae13547e1d" modify_external_catalogs: true
I20260928 10:43:57.498982 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5759f5da5ae84d678ab6a2e2042182e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.499495 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5759f5da5ae84d678ab6a2e2042182e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.499874 6272 ts_tablet_manager.cc:1918] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.499935 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e40f72ff466e4befb74290fd39285119
I20260928 10:43:57.500036 6272 log.cc:1196] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9f6064f370434acb8fc02fda5b50ecf6
I20260928 10:43:57.500370 5699 catalog_manager.cc:6565] ReplaceTablet: tablet e40f72ff466e4befb74290fd39285119 deleted and replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:43:57.500437 6272 ts_tablet_manager.cc:1939] T 9f6064f370434acb8fc02fda5b50ecf6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.500701 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cd7575bfe86d47dcaa4965e2c3745c9d" } modify_external_catalogs: true
I20260928 10:43:57.500885 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cd7575bfe86d47dcaa4965e2c3745c9d" } modify_external_catalogs: true
I20260928 10:43:57.501957 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:43:57.502337 5700 catalog_manager.cc:6565] ReplaceTablet: tablet f9a0d63c6cbc4eebaf42dc7f969f243c deleted and replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02
I20260928 10:43:57.502358 6275 tablet_bootstrap.cc:492] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.502563 6275 ts_tablet_manager.cc:1397] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.011s
I20260928 10:43:57.502681 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e57f65b9a17d4afa8b1e7329d8e053f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.503238 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.503432 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 68fe24b61d424274b407327f130bb020
I20260928 10:43:57.503690 6275 raft_consensus.cc:348] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.503975 6275 raft_consensus.cc:374] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.504050 6275 raft_consensus.cc:729] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.504045 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0e8300ffca6c4b18867a2070b918b402"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.504315 6275 consensus_queue.cc:260] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:57.504597 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e8300ffca6c4b18867a2070b918b402 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.504976 6275 ts_tablet_manager.cc:1428] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:43:57.505713 6329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:43:57.507047 6329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:43:57.507391 6329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:43:57.509202 6272 tablet_replica.cc:330] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.509428 6272 raft_consensus.cc:2229] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.509749 6272 raft_consensus.cc:2258] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.509878 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9f6064f370434acb8fc02fda5b50ecf6 (table default.Table_9fa7750af87240efb9e52060219b345c [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
I20260928 10:43:57.510780 6272 ts_tablet_manager.cc:1905] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.510846 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.511699 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60251724bf62411b81c9c535aaf6a52e" } modify_external_catalogs: true
I20260928 10:43:57.511919 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60251724bf62411b81c9c535aaf6a52e" } modify_external_catalogs: true
W20260928 10:43:57.515201 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01433ce37b2c49cd858ea88877ca56da consensus state has no leader
I20260928 10:43:57.515791 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f9cdfa55dd3842baa9953832efc2313d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.516515 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9cdfa55dd3842baa9953832efc2313d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.521442 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.521926 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.523547 6272 ts_tablet_manager.cc:1918] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.523716 6272 log.cc:1196] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d4dee0748fe04da7b4e07bfdfdb8cb7e
I20260928 10:43:57.524189 6272 ts_tablet_manager.cc:1939] T d4dee0748fe04da7b4e07bfdfdb8cb7e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.530812 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.531934 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 98566f85241c42cf92f3e131318d6efb from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.532321 6275 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.532604 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5d292f1b10c84bb58b70b64028774b25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.533334 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d292f1b10c84bb58b70b64028774b25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.534134 6275 tablet_bootstrap.cc:654] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.534638 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.537544 5693 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd] alter complete (version 3)
I20260928 10:43:57.538115 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.539582 6272 tablet_replica.cc:330] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:43:57.539621 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f9a0d63c6cbc4eebaf42dc7f969f243c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9a0d63c6cbc4eebaf42dc7f969f243c already in progress: creating tablet
I20260928 10:43:57.539832 6272 raft_consensus.cc:2229] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:43:57.539880 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 68fe24b61d424274b407327f130bb020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68fe24b61d424274b407327f130bb020 already in progress: creating tablet
I20260928 10:43:57.539997 6272 raft_consensus.cc:2258] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:57.540102 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e40f72ff466e4befb74290fd39285119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e40f72ff466e4befb74290fd39285119 already in progress: creating tablet
I20260928 10:43:57.541246 6275 tablet_bootstrap.cc:492] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.541391 6275 ts_tablet_manager.cc:1397] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260928 10:43:57.542168 6275 raft_consensus.cc:348] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:57.542388 6275 raft_consensus.cc:374] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.542397 5699 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4cdae2794cf2461a98b62f7358631734
I20260928 10:43:57.542506 6275 raft_consensus.cc:729] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.542757 5694 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 206400064f5c4060b8e7da8dfbdc5d02
W20260928 10:43:57.543785 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e32961679ee47379dab4c62efc53d99 consensus state has no leader
I20260928 10:43:57.545007 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d4dee0748fe04da7b4e07bfdfdb8cb7e (table default.Table_a8e8018f99c4497b87d378148987613d [id=8e77f8894ad940afacf970068a7872b0]) successfully deleted
I20260928 10:43:57.548309 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.548870 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d4da5ccb214a4bbc543c67529b59cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.552659 6131 tablet_service.cc:1467] Processing CreateTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c (DEFAULT_TABLE table=default.Table_4fe535242cc142b386b28842193045ab [id=61ff49fcb43c4d0e94532e49a70e21b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.553184 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb1d807c9f04fe4b02e3343f0c6511c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.554795 6272 ts_tablet_manager.cc:1905] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.542728 6275 consensus_queue.cc:260] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:57.558053 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet cf9361a96fdc44d7ac38a1d0d812eac0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9361a96fdc44d7ac38a1d0d812eac0 already in progress: creating tablet
W20260928 10:43:57.558365 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 97401498df144cc689066ea3033d68ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97401498df144cc689066ea3033d68ef already in progress: creating tablet
I20260928 10:43:57.558405 6275 ts_tablet_manager.cc:1428] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
W20260928 10:43:57.558576 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 118ae3f8af264a31b7c22403c4951bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 118ae3f8af264a31b7c22403c4951bdf already in progress: creating tablet
I20260928 10:43:57.558758 6275 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:43:57.558765 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 59bfe1f8050f47429ef80a19fdcd8198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59bfe1f8050f47429ef80a19fdcd8198 already in progress: creating tablet
I20260928 10:43:57.558924 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 2693b378215f425bb1c2e3e0963aac95 (table default.Table_51b6797b284b4bab9e23e290a53926fc [id=9bfa888c61bf433cab0fe7ef138106a5]) successfully deleted
I20260928 10:43:57.559033 6280 raft_consensus.cc:482] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:43:57.559108 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 317446124e354bbeaaef608d9e8852fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 317446124e354bbeaaef608d9e8852fd already in progress: creating tablet
I20260928 10:43:57.559265 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1454e1e8bea746c0883c738ba8a293b9 (table default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]) successfully deleted
I20260928 10:43:57.559187 6280 raft_consensus.cc:504] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:43:57.559449 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 734c3196929d4814b77bce7938bf598e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c3196929d4814b77bce7938bf598e already in progress: creating tablet
I20260928 10:43:57.559901 6280 leader_election.cc:288] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:57.560050 6280 raft_consensus.cc:482] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.560179 6280 raft_consensus.cc:504] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.560422 6275 tablet_bootstrap.cc:654] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.560745 6280 leader_election.cc:288] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:57.561684 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.561910 6269 tablet_replica.cc:330] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.561818 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f6916daf024379a7dd0411e44ba6ca" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.562091 6269 raft_consensus.cc:2229] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.562235 6269 raft_consensus.cc:2258] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.562436 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af258604238c4e39adac40c81d5a6f3f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.563053 6269 ts_tablet_manager.cc:1905] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.563467 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af258604238c4e39adac40c81d5a6f3f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:57.564136 6273 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.564289 6273 ts_tablet_manager.cc:1397] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.103s user 0.017s sys 0.033s
W20260928 10:43:57.564236 5817 leader_election.cc:341] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.565092 6273 raft_consensus.cc:348] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.565330 6273 raft_consensus.cc:374] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.565411 6273 raft_consensus.cc:729] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.565670 6273 consensus_queue.cc:260] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.566220 6273 ts_tablet_manager.cc:1428] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260928 10:43:57.566684 6273 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:57.567791 5818 leader_election.cc:341] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:57.568032 5818 leader_election.cc:341] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.568142 5818 leader_election.cc:302] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:57.568351 6273 tablet_bootstrap.cc:654] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.569346 6441 raft_consensus.cc:2726] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.573890 6269 ts_tablet_manager.cc:1918] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.574031 6269 log.cc:1196] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4c93507a0bf14c8383794b34ba1702fd
I20260928 10:43:57.574378 6269 ts_tablet_manager.cc:1939] T 4c93507a0bf14c8383794b34ba1702fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.575629 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.575863 6269 tablet_replica.cc:330] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.576032 6269 raft_consensus.cc:2229] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.577593 6269 raft_consensus.cc:2258] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.577785 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 1447a551d9264d18bd1eeabe31b513f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.578269 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.578408 6269 ts_tablet_manager.cc:1905] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.578820 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.579344 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.580564 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.581334 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 (DEFAULT_TABLE table=default.Table_5c182ed527ae4f3eaabdf4eedd17650c [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.581754 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bd99e7bdb647ceb9357f88affc45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.584514 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_174a55ee96184c3b83b11b790ad43d5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.585369 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_174a55ee96184c3b83b11b790ad43d5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.587407 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_03aaae30a2054fa09078e7fd2d90d84b" } modify_external_catalogs: true
I20260928 10:43:57.587616 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_03aaae30a2054fa09078e7fd2d90d84b" } modify_external_catalogs: true
I20260928 10:43:57.588618 6269 ts_tablet_manager.cc:1918] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.588740 6269 log.cc:1196] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/af258604238c4e39adac40c81d5a6f3f
I20260928 10:43:57.588840 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e04f84d5cc324c5195b178466810f64e" } modify_external_catalogs: true
I20260928 10:43:57.589097 6269 ts_tablet_manager.cc:1939] T af258604238c4e39adac40c81d5a6f3f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.589020 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e04f84d5cc324c5195b178466810f64e" } modify_external_catalogs: true
I20260928 10:43:57.590338 6269 tablet_replica.cc:330] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.590507 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_18107c18586f46468e64191ca0006cc0" } new_table_name: "default.Table_2782a761b523442d88471194d3f881e8" modify_external_catalogs: true
I20260928 10:43:57.590579 6269 raft_consensus.cc:2229] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.590732 6269 raft_consensus.cc:2258] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.591735 6271 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.591893 6271 ts_tablet_manager.cc:1397] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.224s user 0.047s sys 0.095s
I20260928 10:43:57.592355 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 (DEFAULT_TABLE table=default.Table_5c182ed527ae4f3eaabdf4eedd17650c [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.592631 6271 raft_consensus.cc:348] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.592859 6271 raft_consensus.cc:374] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.592959 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bd99e7bdb647ceb9357f88affc45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.592952 6271 raft_consensus.cc:729] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.593187 6271 consensus_queue.cc:260] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.595461 6271 ts_tablet_manager.cc:1428] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:57.597137 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.597553 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d4da5ccb214a4bbc543c67529b59cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.599049 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet cd13e6a9d8f04fa3abb8d22a80932dae from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.600561 6271 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.602429 6271 tablet_bootstrap.cc:654] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.602834 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet e6aa426fd7c5444ca7db936da87d2d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.604240 6269 ts_tablet_manager.cc:1905] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.605878 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 (DEFAULT_TABLE table=default.Table_5c182ed527ae4f3eaabdf4eedd17650c [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.606083 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.606321 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bd99e7bdb647ceb9357f88affc45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.606588 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d4da5ccb214a4bbc543c67529b59cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.610981 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4c93507a0bf14c8383794b34ba1702fd (table default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:43:57.611809 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 15f3f3bff84a416494431a19887bb88d (DEFAULT_TABLE table=default.Table_63fa40ed403746539e45b1b98250d0c5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.612407 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f3f3bff84a416494431a19887bb88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.612444 6273 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.612918 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet af258604238c4e39adac40c81d5a6f3f (table default.Table_9af467c9f80a4119845169339a5d6994 [id=bb501c74345744529c7acff050952d6e]) successfully deleted
I20260928 10:43:57.613142 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 1631d396362a4cffa1dec06d00894c63 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:57.613473 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e40f72ff466e4befb74290fd39285119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e40f72ff466e4befb74290fd39285119 already in progress: creating tablet
I20260928 10:43:57.613610 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 15f3f3bff84a416494431a19887bb88d (DEFAULT_TABLE table=default.Table_63fa40ed403746539e45b1b98250d0c5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.613662 5998 tablet_service.cc:1467] Processing CreateTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c (DEFAULT_TABLE table=default.Table_4fe535242cc142b386b28842193045ab [id=61ff49fcb43c4d0e94532e49a70e21b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.613621 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.614099 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f3f3bff84a416494431a19887bb88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.614127 6270 tablet_replica.cc:330] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.614323 6270 raft_consensus.cc:2229] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.614539 6270 raft_consensus.cc:2258] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:57.614737 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 68fe24b61d424274b407327f130bb020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68fe24b61d424274b407327f130bb020 already in progress: creating tablet
I20260928 10:43:57.615222 6270 ts_tablet_manager.cc:1905] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.618405 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8ab5057a6dd44d16a05cf47c02e20582"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.618650 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb1d807c9f04fe4b02e3343f0c6511c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.619096 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ab5057a6dd44d16a05cf47c02e20582 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.621145 6272 ts_tablet_manager.cc:1918] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.621305 6272 log.cc:1196] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f4064e4b82ce49a19849a550cc252976
I20260928 10:43:57.621773 6272 ts_tablet_manager.cc:1939] T f4064e4b82ce49a19849a550cc252976 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.622581 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f4064e4b82ce49a19849a550cc252976 (table default.Table_29808fa3a9bd4528bca3a52d8bb08044 [id=6b777ce372184887b9d4a6bf3f62254f]) successfully deleted
I20260928 10:43:57.623471 5859 tablet_service.cc:1467] Processing CreateTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c (DEFAULT_TABLE table=default.Table_4fe535242cc142b386b28842193045ab [id=61ff49fcb43c4d0e94532e49a70e21b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.623926 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecb1d807c9f04fe4b02e3343f0c6511c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.612615 6273 ts_tablet_manager.cc:1397] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.005s
I20260928 10:43:57.628563 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41f6916daf024379a7dd0411e44ba6ca" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:57.629230 5817 leader_election.cc:341] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.629407 5817 leader_election.cc:302] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:57.629827 6280 raft_consensus.cc:2726] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.630147 6270 ts_tablet_manager.cc:1918] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.628085 6273 raft_consensus.cc:348] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.630620 6273 raft_consensus.cc:374] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.630705 6273 raft_consensus.cc:729] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.631217 6270 log.cc:1196] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:57.631665 6270 ts_tablet_manager.cc:1939] T 0f81c769b5324ca4a68134e30da7fda1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.632045 6273 consensus_queue.cc:260] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.632874 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 0f81c769b5324ca4a68134e30da7fda1 (table default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]) successfully deleted
I20260928 10:43:57.639225 6271 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.639434 6271 ts_tablet_manager.cc:1397] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.001s
I20260928 10:43:57.640250 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 15f3f3bff84a416494431a19887bb88d (DEFAULT_TABLE table=default.Table_63fa40ed403746539e45b1b98250d0c5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.640228 6271 raft_consensus.cc:348] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.640465 6271 raft_consensus.cc:374] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.640535 6271 raft_consensus.cc:729] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.640697 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f3f3bff84a416494431a19887bb88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.640772 6271 consensus_queue.cc:260] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.641388 6271 ts_tablet_manager.cc:1428] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:57.641726 6271 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.642210 6273 ts_tablet_manager.cc:1428] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260928 10:43:57.643422 6271 tablet_bootstrap.cc:654] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.644709 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
I20260928 10:43:57.647014 6273 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.647524 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
I20260928 10:43:57.648476 6269 ts_tablet_manager.cc:1918] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.648900 6269 log.cc:1196] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a765989e9ba3467f811f5fd49b67cb36
I20260928 10:43:57.649570 6273 tablet_bootstrap.cc:654] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.649580 6269 ts_tablet_manager.cc:1939] T a765989e9ba3467f811f5fd49b67cb36 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.651583 6275 tablet_bootstrap.cc:492] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.651820 6271 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.651809 6275 ts_tablet_manager.cc:1397] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.011s
I20260928 10:43:57.652047 6271 ts_tablet_manager.cc:1397] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.007s
I20260928 10:43:57.652630 6275 raft_consensus.cc:348] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.652913 6275 raft_consensus.cc:374] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.653005 6275 raft_consensus.cc:729] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.653126 6271 raft_consensus.cc:348] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.653496 6271 raft_consensus.cc:374] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.653644 6271 raft_consensus.cc:729] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.653928 6271 consensus_queue.cc:260] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.654692 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.655012 6269 tablet_replica.cc:330] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.655210 6269 raft_consensus.cc:2229] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.655402 6269 raft_consensus.cc:2258] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.656123 6271 ts_tablet_manager.cc:1428] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:43:57.656457 6271 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.658591 6271 tablet_bootstrap.cc:654] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.660153 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b2d841c2f9b844208173f982b9eb7818
I20260928 10:43:57.660866 5694 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b56d11fc076147afaf1b7982c05d972e
W20260928 10:43:57.661213 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b77c90bc2ecc4fc29a4786152cb977bd has no consensus state
I20260928 10:43:57.661473 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.661547 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:43:57.661975 5699 catalog_manager.cc:6565] ReplaceTablet: tablet cd13e6a9d8f04fa3abb8d22a80932dae deleted and replaced by tablet 04b947da50894cdba0f49d0738f60187
I20260928 10:43:57.662298 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1631d396362a4cffa1dec06d00894c63
I20260928 10:43:57.662585 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.662696 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 1631d396362a4cffa1dec06d00894c63 deleted and replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:43:57.663156 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:57.663801 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 734c3196929d4814b77bce7938bf598e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c3196929d4814b77bce7938bf598e already in progress: creating tablet
I20260928 10:43:57.664129 6272 tablet_replica.cc:330] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.664240 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.664324 6272 raft_consensus.cc:2229] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.664465 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.664520 6272 raft_consensus.cc:2258] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.664652 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.665091 6272 ts_tablet_manager.cc:1905] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:57.665512 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b2d841c2f9b844208173f982b9eb7818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d841c2f9b844208173f982b9eb7818 already in progress: creating tablet
W20260928 10:43:57.665729 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cd13e6a9d8f04fa3abb8d22a80932dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd13e6a9d8f04fa3abb8d22a80932dae already in progress: creating tablet
W20260928 10:43:57.665894 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1631d396362a4cffa1dec06d00894c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1631d396362a4cffa1dec06d00894c63 already in progress: creating tablet
I20260928 10:43:57.653259 6275 consensus_queue.cc:260] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.669528 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a765989e9ba3467f811f5fd49b67cb36 (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
I20260928 10:43:57.670470 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.670902 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.671555 6275 ts_tablet_manager.cc:1428] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260928 10:43:57.672572 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.672638 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.672850 6270 tablet_replica.cc:330] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:57.673020 6270 raft_consensus.cc:2229] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.673194 6270 raft_consensus.cc:2258] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.674036 6270 ts_tablet_manager.cc:1905] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.674758 6275 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.676407 6275 tablet_bootstrap.cc:654] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.682169 6269 ts_tablet_manager.cc:1905] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.683349 6270 ts_tablet_manager.cc:1918] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.683544 6270 log.cc:1196] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e76a54bfddc74a9e86285add7b97645b
I20260928 10:43:57.683990 6270 ts_tablet_manager.cc:1939] T e76a54bfddc74a9e86285add7b97645b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:57.684943 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e76a54bfddc74a9e86285add7b97645b (table default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]) successfully deleted
I20260928 10:43:57.686250 6273 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.686407 6273 ts_tablet_manager.cc:1397] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20260928 10:43:57.687187 6273 raft_consensus.cc:348] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.687420 6273 raft_consensus.cc:374] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.687512 6273 raft_consensus.cc:729] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.687726 6273 consensus_queue.cc:260] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.688300 6269 ts_tablet_manager.cc:1918] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.688422 6269 log.cc:1196] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/7f61f6e2bb8a4166ae93f74ae13ac2a0
I20260928 10:43:57.688740 6269 ts_tablet_manager.cc:1939] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.695817 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (table default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]) successfully deleted
I20260928 10:43:57.696651 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.699043 6273 ts_tablet_manager.cc:1428] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
W20260928 10:43:57.701864 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1631d396362a4cffa1dec06d00894c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1631d396362a4cffa1dec06d00894c63 already in progress: creating tablet
W20260928 10:43:57.702705 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet cd13e6a9d8f04fa3abb8d22a80932dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd13e6a9d8f04fa3abb8d22a80932dae already in progress: creating tablet
W20260928 10:43:57.703413 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b2d841c2f9b844208173f982b9eb7818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d841c2f9b844208173f982b9eb7818 already in progress: creating tablet
I20260928 10:43:57.704063 6269 tablet_replica.cc:330] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.704331 6269 raft_consensus.cc:2229] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.704638 6269 raft_consensus.cc:2258] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.705498 6269 ts_tablet_manager.cc:1905] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.707212 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
I20260928 10:43:57.709137 6273 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.710588 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]). Expected version 4 got 0
I20260928 10:43:57.711027 6273 tablet_bootstrap.cc:654] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.712651 6269 ts_tablet_manager.cc:1918] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.712836 6269 log.cc:1196] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/98566f85241c42cf92f3e131318d6efb
I20260928 10:43:57.713382 6269 ts_tablet_manager.cc:1939] T 98566f85241c42cf92f3e131318d6efb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.713380 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 2187fe4785f9466eb7ed729a4e0407f2 (DEFAULT_TABLE table=default.Table_0e8300ffca6c4b18867a2070b918b402 [id=071f61c884fd434e96e05a92c26e325c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.713758 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 2187fe4785f9466eb7ed729a4e0407f2 (DEFAULT_TABLE table=default.Table_0e8300ffca6c4b18867a2070b918b402 [id=071f61c884fd434e96e05a92c26e325c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.713929 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2187fe4785f9466eb7ed729a4e0407f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.713913 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 2187fe4785f9466eb7ed729a4e0407f2 (DEFAULT_TABLE table=default.Table_0e8300ffca6c4b18867a2070b918b402 [id=071f61c884fd434e96e05a92c26e325c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.714198 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2187fe4785f9466eb7ed729a4e0407f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.714309 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2187fe4785f9466eb7ed729a4e0407f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.714569 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 98566f85241c42cf92f3e131318d6efb (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
I20260928 10:43:57.713331 6280 raft_consensus.cc:482] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.716557 6280 raft_consensus.cc:504] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.717233 6280 leader_election.cc:288] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:57.718758 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.719146 6275 tablet_bootstrap.cc:492] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.719286 6275 ts_tablet_manager.cc:1397] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.003s
I20260928 10:43:57.719225 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:57.720006 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a22814f9f7c4a3aa9bc76471f973c53" } modify_external_catalogs: true
I20260928 10:43:57.720010 6275 raft_consensus.cc:348] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.720223 6275 raft_consensus.cc:374] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.720225 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a22814f9f7c4a3aa9bc76471f973c53" } modify_external_catalogs: true
I20260928 10:43:57.720299 6275 raft_consensus.cc:729] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.720497 6275 consensus_queue.cc:260] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.721040 6275 ts_tablet_manager.cc:1428] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:57.721060 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9fa7750af87240efb9e52060219b345c" } new_table_name: "default.Table_50e898f110284e12a29a763192630a05" modify_external_catalogs: true
I20260928 10:43:57.721557 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_15cc12e71a0449f2bdd14380ad3710e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.722118 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15cc12e71a0449f2bdd14380ad3710e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:57.723269 5817 leader_election.cc:341] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.724874 6273 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.725044 6273 ts_tablet_manager.cc:1397] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
W20260928 10:43:57.725660 5818 leader_election.cc:341] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:57.725812 5818 leader_election.cc:302] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:57.726220 6280 raft_consensus.cc:2726] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.727020 6273 raft_consensus.cc:348] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.727257 6273 raft_consensus.cc:374] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.727316 6273 raft_consensus.cc:729] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.727628 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e140be79b9e24b58a59051919415af22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.728184 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e140be79b9e24b58a59051919415af22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.728550 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96e8a9a83ed748f7965066c48e25c57a" } new_table_name: "default.Table_847c180ba3b040189d5d48897728a05b" modify_external_catalogs: true
I20260928 10:43:57.731127 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81c769b5324ca4a68134e30da7fda1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.732056 6273 consensus_queue.cc:260] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.733054 6275 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:43:57.735024 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 780707959e0e48d6a83b22e6479a5884 consensus state has no leader
I20260928 10:43:57.735199 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 23d4da5ccb214a4bbc543c67529b59cf from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.735558 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8b21a965426145c9b678ae80869be833
I20260928 10:43:57.736244 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_da2eddc06d92439aa78eb340961125f9" } new_table_name: "default.Table_1393fcb0819d4e72bfa3196064b164e4" modify_external_catalogs: true
I20260928 10:43:57.736580 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.736912 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:57.737175 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8b21a965426145c9b678ae80869be833 because the tablet was not found. No further retry: Not found: Tablet not found: 8b21a965426145c9b678ae80869be833
I20260928 10:43:57.737861 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.737931 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9513354e0c5245fb9138ab1c1532f91d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.738421 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9513354e0c5245fb9138ab1c1532f91d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:57.741806 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8b21a965426145c9b678ae80869be833 because the tablet was not found. No further retry: Not found: Tablet not found: 8b21a965426145c9b678ae80869be833
W20260928 10:43:57.742195 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43d5479a2ce44c20a9437720820f3cec consensus state has no leader
I20260928 10:43:57.744789 6273 ts_tablet_manager.cc:1428] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.020s user 0.002s sys 0.001s
I20260928 10:43:57.746125 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 104a223ec6ef47988d0aa3335a1f81de (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.746608 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104a223ec6ef47988d0aa3335a1f81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.748044 6273 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.749415 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.749449 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1f1c12917895471e83d800259d4e5e19" } modify_external_catalogs: true
I20260928 10:43:57.749676 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1f1c12917895471e83d800259d4e5e19" } modify_external_catalogs: true
I20260928 10:43:57.749806 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b4c8b5f8eede428da452daeb16948828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.750371 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4c8b5f8eede428da452daeb16948828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.751471 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c2552880d04743968cc2e72c5f916b37" } modify_external_catalogs: true
I20260928 10:43:57.751683 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c2552880d04743968cc2e72c5f916b37" } modify_external_catalogs: true
I20260928 10:43:57.753440 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_676a3837be864fdda0d947883d6eccea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.754004 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_676a3837be864fdda0d947883d6eccea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.754576 6269 tablet_replica.cc:330] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.754774 6269 raft_consensus.cc:2229] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.754977 6269 raft_consensus.cc:2258] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.755733 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet d257233e5b934d619e2289a6df55d65a from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:57.758948 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a380da90a76545dba647e0c1b3e05acd consensus state has no leader
I20260928 10:43:57.760008 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5b6c5808b2f54b0094cd1910c2cda924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.760560 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b6c5808b2f54b0094cd1910c2cda924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.762238 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e9583b5637a428db383320d98a7a280 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.763134 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 104a223ec6ef47988d0aa3335a1f81de (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.763181 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 104a223ec6ef47988d0aa3335a1f81de (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.763603 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104a223ec6ef47988d0aa3335a1f81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.763589 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:43:57.763664 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104a223ec6ef47988d0aa3335a1f81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.764091 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 23d4da5ccb214a4bbc543c67529b59cf deleted and replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c
I20260928 10:43:57.765100 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:57.765754 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 23d4da5ccb214a4bbc543c67529b59cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d4da5ccb214a4bbc543c67529b59cf already in progress: creating tablet
I20260928 10:43:57.765887 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.760479 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4fe535242cc142b386b28842193045ab" } new_table_name: "default.Table_2599faf42aa64d3e85b31db48c5b2644" modify_external_catalogs: true
I20260928 10:43:57.766981 6126 tablet_service.cc:1467] Processing CreateTablet for tablet bae5a2038947413f95f134602081c889 (DEFAULT_TABLE table=default.Table_0678bdc10bb74b3d922dc53a158bc752 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.767477 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae5a2038947413f95f134602081c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.768786 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a4ed61f43d5d4a6fa21eb854dae895d8
I20260928 10:43:57.769569 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.769702 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.770306 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.770460 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:57.770982 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a4ed61f43d5d4a6fa21eb854dae895d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4ed61f43d5d4a6fa21eb854dae895d8 already in progress: creating tablet
I20260928 10:43:57.771114 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:43:57.771955 6269 ts_tablet_manager.cc:1905] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.772054 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.772408 5856 tablet_service.cc:1467] Processing CreateTablet for tablet bae5a2038947413f95f134602081c889 (DEFAULT_TABLE table=default.Table_0678bdc10bb74b3d922dc53a158bc752 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.772459 6130 tablet_service.cc:1467] Processing CreateTablet for tablet bd225da0b4b445c6ac03634d975e8396 (DEFAULT_TABLE table=default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.772804 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae5a2038947413f95f134602081c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.772848 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd225da0b4b445c6ac03634d975e8396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.772891 5857 tablet_service.cc:1467] Processing CreateTablet for tablet bd225da0b4b445c6ac03634d975e8396 (DEFAULT_TABLE table=default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.773262 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd225da0b4b445c6ac03634d975e8396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.775091 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.776377 6275 tablet_bootstrap.cc:654] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:57.777004 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4a973a1d20e3437c87ad889c723e7ebc because the tablet was not found. No further retry: Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:43:57.777726 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 86b16eb36c034591ac1603ab84fd9342 (DEFAULT_TABLE table=default.Table_5d1843f7fdad49b58bf61b192e5f37bd [id=d006fbd87b934957b39ed53725c2eb78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.777922 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 84912292d6c34a3991bd0f885de240a8 (DEFAULT_TABLE table=default.Table_8a054ca5f8f14a83aa001fe1b81ef734 [id=11a38f1ba2c7418f93cf366da4ac5813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.778255 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86b16eb36c034591ac1603ab84fd9342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.778450 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84912292d6c34a3991bd0f885de240a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.778761 5996 tablet_service.cc:1467] Processing CreateTablet for tablet bd225da0b4b445c6ac03634d975e8396 (DEFAULT_TABLE table=default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.779109 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd225da0b4b445c6ac03634d975e8396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.779312 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 8b21a965426145c9b678ae80869be833 (DEFAULT_TABLE table=default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.779649 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b21a965426145c9b678ae80869be833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.781243 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b73a1edf5a204eaea434f196b48efb2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.781854 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b73a1edf5a204eaea434f196b48efb2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.788580 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 84912292d6c34a3991bd0f885de240a8 (DEFAULT_TABLE table=default.Table_8a054ca5f8f14a83aa001fe1b81ef734 [id=11a38f1ba2c7418f93cf366da4ac5813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.789043 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84912292d6c34a3991bd0f885de240a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.790784 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 86b16eb36c034591ac1603ab84fd9342 (DEFAULT_TABLE table=default.Table_5d1843f7fdad49b58bf61b192e5f37bd [id=d006fbd87b934957b39ed53725c2eb78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.791147 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86b16eb36c034591ac1603ab84fd9342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.797902 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d257233e5b934d619e2289a6df55d65a
I20260928 10:43:57.798646 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.798971 5700 catalog_manager.cc:6565] ReplaceTablet: tablet d257233e5b934d619e2289a6df55d65a deleted and replaced by tablet efa178fc1e344069b086003d39f1b848
I20260928 10:43:57.800532 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 21b4deb353974c8aae4bb8148869758d (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.801023 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b4deb353974c8aae4bb8148869758d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.803916 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 8b21a965426145c9b678ae80869be833 (DEFAULT_TABLE table=default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.804378 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b21a965426145c9b678ae80869be833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.806643 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.808380 5989 tablet_service.cc:1467] Processing CreateTablet for tablet bae5a2038947413f95f134602081c889 (DEFAULT_TABLE table=default.Table_0678bdc10bb74b3d922dc53a158bc752 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.808691 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0e9583b5637a428db383320d98a7a280
I20260928 10:43:57.808780 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae5a2038947413f95f134602081c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.809036 6273 tablet_bootstrap.cc:654] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.809171 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 0e9583b5637a428db383320d98a7a280 deleted and replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:43:57.809857 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:57.810060 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d257233e5b934d619e2289a6df55d65a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d257233e5b934d619e2289a6df55d65a already in progress: creating tablet
I20260928 10:43:57.810160 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 86b16eb36c034591ac1603ab84fd9342 (DEFAULT_TABLE table=default.Table_5d1843f7fdad49b58bf61b192e5f37bd [id=d006fbd87b934957b39ed53725c2eb78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.812206 6272 ts_tablet_manager.cc:1918] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.812376 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 8b21a965426145c9b678ae80869be833 (DEFAULT_TABLE table=default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.814564 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:57.814512 5997 tablet_service.cc:1467] Processing CreateTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd (DEFAULT_TABLE table=default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.815078 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b77c90bc2ecc4fc29a4786152cb977bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.815284 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0e9583b5637a428db383320d98a7a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e9583b5637a428db383320d98a7a280 already in progress: creating tablet
I20260928 10:43:57.816479 5855 tablet_service.cc:1467] Processing CreateTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd (DEFAULT_TABLE table=default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.816973 6355 raft_consensus.cc:482] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.817742 6355 raft_consensus.cc:504] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.818379 6355 leader_election.cc:288] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:57.819595 5996 tablet_service.cc:1467] Processing CreateTablet for tablet fbac466fe364472391a1fc2d75a46b9b (DEFAULT_TABLE table=default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:57.819746 6091 leader_election.cc:341] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:57.819995 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac466fe364472391a1fc2d75a46b9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.820087 6090 leader_election.cc:341] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:57.820194 6090 leader_election.cc:302] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:57.820688 6355 raft_consensus.cc:2726] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:57.821237 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 21b4deb353974c8aae4bb8148869758d (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.821681 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b4deb353974c8aae4bb8148869758d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.822916 5849 tablet_service.cc:1467] Processing CreateTablet for tablet fbac466fe364472391a1fc2d75a46b9b (DEFAULT_TABLE table=default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.823632 6133 tablet_service.cc:1467] Processing CreateTablet for tablet fbac466fe364472391a1fc2d75a46b9b (DEFAULT_TABLE table=default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.823724 5990 tablet_service.cc:1467] Processing CreateTablet for tablet a6b418bbb3364006b097e3a78edf5f55 (DEFAULT_TABLE table=default.Table_3e98e3a878de4461bb9ad47b99d2ffc0 [id=5557e0d93f67480ca44cf2cd28b92e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.824334 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac466fe364472391a1fc2d75a46b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.824829 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6b418bbb3364006b097e3a78edf5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.826994 5850 tablet_service.cc:1467] Processing CreateTablet for tablet a6b418bbb3364006b097e3a78edf5f55 (DEFAULT_TABLE table=default.Table_3e98e3a878de4461bb9ad47b99d2ffc0 [id=5557e0d93f67480ca44cf2cd28b92e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.828061 6127 tablet_service.cc:1467] Processing CreateTablet for tablet a6b418bbb3364006b097e3a78edf5f55 (DEFAULT_TABLE table=default.Table_3e98e3a878de4461bb9ad47b99d2ffc0 [id=5557e0d93f67480ca44cf2cd28b92e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.828452 6131 tablet_service.cc:1467] Processing CreateTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd (DEFAULT_TABLE table=default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.829473 6272 log.cc:1196] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/72ace49431a24469bef73c596af089ae
I20260928 10:43:57.829703 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 (DEFAULT_TABLE table=default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.830116 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6b418bbb3364006b097e3a78edf5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.830401 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86b16eb36c034591ac1603ab84fd9342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.830720 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6b418bbb3364006b097e3a78edf5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.830823 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.830955 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b77c90bc2ecc4fc29a4786152cb977bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.830469 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 122fbbe54c174c4ea9cf38698debcb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.831049 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.831214 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 84912292d6c34a3991bd0f885de240a8 (DEFAULT_TABLE table=default.Table_8a054ca5f8f14a83aa001fe1b81ef734 [id=11a38f1ba2c7418f93cf366da4ac5813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.831625 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84912292d6c34a3991bd0f885de240a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.833114 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac466fe364472391a1fc2d75a46b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.834558 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 21b4deb353974c8aae4bb8148869758d (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.835007 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b4deb353974c8aae4bb8148869758d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.836081 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b77c90bc2ecc4fc29a4786152cb977bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.842703 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b21a965426145c9b678ae80869be833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.846642 6269 ts_tablet_manager.cc:1918] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.846864 6269 log.cc:1196] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/64a424286b6e4d32a2ceb67ed6cdc02d
I20260928 10:43:57.847227 6269 ts_tablet_manager.cc:1939] T 64a424286b6e4d32a2ceb67ed6cdc02d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.847226 6355 raft_consensus.cc:482] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.847393 6355 raft_consensus.cc:504] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.848068 6355 leader_election.cc:288] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:57.848884 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 64a424286b6e4d32a2ceb67ed6cdc02d (table default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]) successfully deleted
W20260928 10:43:57.849180 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a4ed61f43d5d4a6fa21eb854dae895d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4ed61f43d5d4a6fa21eb854dae895d8 already in progress: creating tablet
I20260928 10:43:57.850895 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:57.851188 5883 raft_consensus.cc:2454] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:43:57.854108 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 (DEFAULT_TABLE table=default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.854611 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 122fbbe54c174c4ea9cf38698debcb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.854570 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 3c957158dbd949e88554e70fe6146089 (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.854943 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c957158dbd949e88554e70fe6146089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.855149 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.855468 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f42d5aef2424b3aacc8564d98cd3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.856092 6272 ts_tablet_manager.cc:1939] T 72ace49431a24469bef73c596af089ae P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.857836 6272 tablet_replica.cc:330] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.857975 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.858826 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc (DEFAULT_TABLE table=default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.858901 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:57.859179 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a973a1d20e3437c87ad889c723e7ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.859179 6022 raft_consensus.cc:2454] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:43:57.859426 6272 raft_consensus.cc:2229] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.859616 6272 raft_consensus.cc:2258] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.859562 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 (DEFAULT_TABLE table=default.Table_b34ae7f4b0094611a67b40e6d1e9306c [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.859956 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b78fbf508f4e47bd31661e05dcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.860737 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc (DEFAULT_TABLE table=default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.861074 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a973a1d20e3437c87ad889c723e7ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.862394 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 3c957158dbd949e88554e70fe6146089 (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.862809 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c957158dbd949e88554e70fe6146089. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.866335 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ecb1d807c9f04fe4b02e3343f0c6511c consensus state has no leader
I20260928 10:43:57.867267 6091 leader_election.cc:302] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:57.869612 6272 ts_tablet_manager.cc:1905] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.871953 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9fb5ee6a62d1438e87785c58e1201a58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.872578 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fb5ee6a62d1438e87785c58e1201a58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.872757 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b6de790cff44909b80e9ab812bb2d60" } modify_external_catalogs: true
I20260928 10:43:57.872948 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b6de790cff44909b80e9ab812bb2d60" } modify_external_catalogs: true
I20260928 10:43:57.873443 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_15cc12e71a0449f2bdd14380ad3710e6" } new_table_name: "default.Table_c40c67db116d48bd969f06a5bd0febc1" modify_external_catalogs: true
I20260928 10:43:57.873814 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2599faf42aa64d3e85b31db48c5b2644" } modify_external_catalogs: true
I20260928 10:43:57.874006 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2599faf42aa64d3e85b31db48c5b2644" } modify_external_catalogs: true
I20260928 10:43:57.874586 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8c0911722bcd44c482d7070d941798f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.875048 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c0911722bcd44c482d7070d941798f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.877424 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cbfc5179d22f49d0852cb571f19adbfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.877910 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbfc5179d22f49d0852cb571f19adbfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.879534 6273 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.879699 6273 ts_tablet_manager.cc:1397] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.132s user 0.003s sys 0.007s
I20260928 10:43:57.879822 6355 raft_consensus.cc:2781] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:57.879953 6355 raft_consensus.cc:482] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:57.880053 6355 raft_consensus.cc:3037] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:57.880430 6273 raft_consensus.cc:348] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.880681 6273 raft_consensus.cc:374] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.880766 6273 raft_consensus.cc:729] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.881021 6273 consensus_queue.cc:260] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.881590 6273 ts_tablet_manager.cc:1428] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.881872 6273 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:57.885710 6275 tablet_bootstrap.cc:492] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:57.886168 6273 tablet_bootstrap.cc:654] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.887053 6275 ts_tablet_manager.cc:1397] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.165s user 0.009s sys 0.008s
I20260928 10:43:57.887802 6275 raft_consensus.cc:348] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.888055 6275 raft_consensus.cc:374] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.888128 6275 raft_consensus.cc:729] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.889262 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 72ace49431a24469bef73c596af089ae (table default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
W20260928 10:43:57.889554 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 68fe24b61d424274b407327f130bb020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68fe24b61d424274b407327f130bb020 already in progress: creating tablet
W20260928 10:43:57.890851 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 23d4da5ccb214a4bbc543c67529b59cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d4da5ccb214a4bbc543c67529b59cf already in progress: creating tablet
I20260928 10:43:57.889874 6275 consensus_queue.cc:260] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:57.891108 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d257233e5b934d619e2289a6df55d65a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d257233e5b934d619e2289a6df55d65a already in progress: creating tablet
W20260928 10:43:57.891294 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0e9583b5637a428db383320d98a7a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e9583b5637a428db383320d98a7a280 already in progress: creating tablet
W20260928 10:43:57.891742 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4a973a1d20e3437c87ad889c723e7ebc because the tablet was not found. No further retry: Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:43:57.897009 6275 ts_tablet_manager.cc:1428] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260928 10:43:57.897352 6275 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:57.900652 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 3c957158dbd949e88554e70fe6146089 (DEFAULT_TABLE table=default.Table_8c92519ebd044d35b76f6f708668ae19 [id=c8d4a6587af14ea39b7ace0ce005588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.901149 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c957158dbd949e88554e70fe6146089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.882431 6355 raft_consensus.cc:504] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.902289 6355 leader_election.cc:288] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:57.902467 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.902777 6269 tablet_replica.cc:330] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.903031 6269 raft_consensus.cc:2229] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.903106 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:57.903263 6269 raft_consensus.cc:2258] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.903370 5883 raft_consensus.cc:3037] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:57.906315 5883 raft_consensus.cc:2454] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:43:57.907074 6269 ts_tablet_manager.cc:1905] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.907790 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc (DEFAULT_TABLE table=default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.908265 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a973a1d20e3437c87ad889c723e7ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.914007 6272 ts_tablet_manager.cc:1918] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.914203 6272 log.cc:1196] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1447a551d9264d18bd1eeabe31b513f1
I20260928 10:43:57.914497 6269 ts_tablet_manager.cc:1918] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.914647 6269 log.cc:1196] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4ffa9fb5b11944b1b38e07bd43891773
I20260928 10:43:57.914642 6272 ts_tablet_manager.cc:1939] T 1447a551d9264d18bd1eeabe31b513f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.915189 6269 ts_tablet_manager.cc:1939] T 4ffa9fb5b11944b1b38e07bd43891773 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:57.915285 6272 tablet_replica.cc:330] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.915462 6272 raft_consensus.cc:2229] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.915720 6272 raft_consensus.cc:2258] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.915804 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet ecb1d807c9f04fe4b02e3343f0c6511c from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:57.916219 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 (DEFAULT_TABLE table=default.Table_b34ae7f4b0094611a67b40e6d1e9306c [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.916616 6272 ts_tablet_manager.cc:1905] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:57.917140 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b78fbf508f4e47bd31661e05dcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.918290 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a25c7f3b94e94cafb3275a2e190be0ed consensus state has no leader
I20260928 10:43:57.918231 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c97e247cfc4547558b59a4168fa7e3b0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:43:57.918522 6022 raft_consensus.cc:3037] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:57.920830 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1447a551d9264d18bd1eeabe31b513f1 (table default.Table_887b7b8b4db941078430be23306434aa [id=abc60993910c40d2908beaf95eb7355d]) successfully deleted
I20260928 10:43:57.926159 6091 leader_election.cc:302] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:57.926115 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 440a50034c6b4110b74b1531a6b7790d (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.926613 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a50034c6b4110b74b1531a6b7790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.927090 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.927457 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e05cdd590894adcb987ef3ac78bf416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.928079 6272 ts_tablet_manager.cc:1918] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:57.928294 6272 log.cc:1196] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e6aa426fd7c5444ca7db936da87d2d1c
I20260928 10:43:57.928462 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 847b18c212474456ac9b40eee055dbd0 (DEFAULT_TABLE table=default.Table_174a55ee96184c3b83b11b790ad43d5b [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.928725 6473 raft_consensus.cc:482] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:57.928825 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847b18c212474456ac9b40eee055dbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.929921 5993 tablet_service.cc:1467] Processing CreateTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed (DEFAULT_TABLE table=default.Table_c40c67db116d48bd969f06a5bd0febc1 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.930272 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25c7f3b94e94cafb3275a2e190be0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.929147 6272 ts_tablet_manager.cc:1939] T e6aa426fd7c5444ca7db936da87d2d1c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:57.931427 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.931545 6272 tablet_replica.cc:330] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:57.931792 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef1e7125d4e42f5b30f33bfa588511c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.930204 6473 raft_consensus.cc:504] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.932233 6275 tablet_bootstrap.cc:654] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:57.932771 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e6aa426fd7c5444ca7db936da87d2d1c (table default.Table_2f6a862b6954477fbb331f27dcfebc98 [id=8ebad4d6e6d449348b25b5710471ae86]) successfully deleted
W20260928 10:43:57.933076 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b2d841c2f9b844208173f982b9eb7818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d841c2f9b844208173f982b9eb7818 already in progress: creating tablet
W20260928 10:43:57.933276 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cd13e6a9d8f04fa3abb8d22a80932dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd13e6a9d8f04fa3abb8d22a80932dae already in progress: creating tablet
W20260928 10:43:57.933507 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1631d396362a4cffa1dec06d00894c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1631d396362a4cffa1dec06d00894c63 already in progress: creating tablet
I20260928 10:43:57.934017 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 847b18c212474456ac9b40eee055dbd0 (DEFAULT_TABLE table=default.Table_174a55ee96184c3b83b11b790ad43d5b [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.934994 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 04b947da50894cdba0f49d0738f60187 (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.935317 6273 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:57.935395 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b947da50894cdba0f49d0738f60187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.935484 6273 ts_tablet_manager.cc:1397] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.000s
I20260928 10:43:57.936707 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4ffa9fb5b11944b1b38e07bd43891773 (table default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]) successfully deleted
I20260928 10:43:57.936928 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (DEFAULT_TABLE table=default.Table_5d292f1b10c84bb58b70b64028774b25 [id=620121bbc5c641b792d823560616b120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.937199 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7dba507179ed44ce903111622ec1fb42
I20260928 10:43:57.937321 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.938068 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 847b18c212474456ac9b40eee055dbd0 (DEFAULT_TABLE table=default.Table_174a55ee96184c3b83b11b790ad43d5b [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.938431 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847b18c212474456ac9b40eee055dbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.940546 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.940975 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f42d5aef2424b3aacc8564d98cd3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.942871 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.942981 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:43:57.943104 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 (DEFAULT_TABLE table=default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.943279 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.943676 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef1e7125d4e42f5b30f33bfa588511c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.944288 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 04b947da50894cdba0f49d0738f60187 (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.945222 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01e7025c16c843ffb7cf7d80038d6a72" } new_table_name: "default.Table_134f33c0d27c4f579572dcad2654bc65" modify_external_catalogs: true
I20260928 10:43:57.945483 5856 tablet_service.cc:1467] Processing CreateTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed (DEFAULT_TABLE table=default.Table_c40c67db116d48bd969f06a5bd0febc1 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.947279 6271 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:57.936285 6273 raft_consensus.cc:348] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.947489 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_31cadc2943274de99ca4c78618ea19fd" } modify_external_catalogs: true
I20260928 10:43:57.947695 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_31cadc2943274de99ca4c78618ea19fd" } modify_external_catalogs: true
I20260928 10:43:57.946384 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 122fbbe54c174c4ea9cf38698debcb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.947615 6273 raft_consensus.cc:374] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.949594 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b947da50894cdba0f49d0738f60187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.950338 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25c7f3b94e94cafb3275a2e190be0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.951004 6271 ts_tablet_manager.cc:1397] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.291s user 0.007s sys 0.032s
I20260928 10:43:57.952435 6271 raft_consensus.cc:348] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.952687 6271 raft_consensus.cc:374] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:57.952765 6271 raft_consensus.cc:729] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.953012 6271 consensus_queue.cc:260] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:57.953568 6271 ts_tablet_manager.cc:1428] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:57.953955 6271 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:57.954739 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.955502 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fc332e83c5a34833bb32f19aecd40642" } new_table_name: "default.Table_89c05124506147cb91475760df1ce319" modify_external_catalogs: true
I20260928 10:43:57.963596 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0678bdc10bb74b3d922dc53a158bc752" } new_table_name: "default.Table_13c8e14c1b6f453387a61626092d58a0" modify_external_catalogs: true
I20260928 10:43:57.965763 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_620f3530f71449eaa20ab3d20919a8e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.966307 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fee865b67dc14771bb4771d414861964"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:57.966884 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fee865b67dc14771bb4771d414861964 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:57.966413 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_620f3530f71449eaa20ab3d20919a8e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:57.967394 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8c53e9be06f4d1aa0fc7eaef2c10303 consensus state has no leader
I20260928 10:43:57.968508 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 28eb4bef35cc413ebbdc177de1d7b057
I20260928 10:43:57.970662 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.949611 6273 raft_consensus.cc:729] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:57.971104 6273 consensus_queue.cc:260] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:57.971654 6273 ts_tablet_manager.cc:1428] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260928 10:43:57.971951 6273 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:57.972324 6090 leader_election.cc:341] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:57.972524 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847b18c212474456ac9b40eee055dbd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.973994 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bae5a2038947413f95f134602081c889 consensus state has no leader
I20260928 10:43:57.974699 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.975136 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e05cdd590894adcb987ef3ac78bf416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.976190 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:57.979228 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7dba507179ed44ce903111622ec1fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dba507179ed44ce903111622ec1fb42 already in progress: creating tablet
W20260928 10:43:57.979898 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ecb1d807c9f04fe4b02e3343f0c6511c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb1d807c9f04fe4b02e3343f0c6511c already in progress: creating tablet
W20260928 10:43:57.980465 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 28eb4bef35cc413ebbdc177de1d7b057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28eb4bef35cc413ebbdc177de1d7b057 already in progress: creating tablet
I20260928 10:43:57.981390 6269 tablet_replica.cc:330] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:57.981357 6272 raft_consensus.cc:2229] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.981638 6269 raft_consensus.cc:2229] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:57.981727 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8cafdf332e5d48c4a1f719cef76f2d70" } modify_external_catalogs: true
I20260928 10:43:57.981827 6272 raft_consensus.cc:2258] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.981844 6269 raft_consensus.cc:2258] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:57.981938 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8cafdf332e5d48c4a1f719cef76f2d70" } modify_external_catalogs: true
I20260928 10:43:57.982066 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 440a50034c6b4110b74b1531a6b7790d (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.982139 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_423a4f1dc8dd44c8a0a578be4f07c984" } modify_external_catalogs: true
I20260928 10:43:57.982302 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_423a4f1dc8dd44c8a0a578be4f07c984" } modify_external_catalogs: true
I20260928 10:43:57.982448 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a50034c6b4110b74b1531a6b7790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:57.985918 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 (DEFAULT_TABLE table=default.Table_b34ae7f4b0094611a67b40e6d1e9306c [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.986048 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fc69aee75b914164961654baaea21d7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.986291 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b78fbf508f4e47bd31661e05dcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:57.986603 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc69aee75b914164961654baaea21d7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.988305 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2693b378215f425bb1c2e3e0963aac95 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f36552ca554b60ae0d1cdacbc28af6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.989066 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.990224 6355 raft_consensus.cc:2781] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:57.990918 6473 leader_election.cc:288] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:57.991895 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:43:57.991889 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c97e247cfc4547558b59a4168fa7e3b0
I20260928 10:43:57.992797 6132 tablet_service.cc:1467] Processing CreateTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed (DEFAULT_TABLE table=default.Table_c40c67db116d48bd969f06a5bd0febc1 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.993650 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:57.994764 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c (DEFAULT_TABLE table=default.Table_00fbff9d20b64e17a45b28933380b233 [id=6c4f8a03470949939c8e51847b52ce13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.995236 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d8fd16c3c602488693b9c88e13f98589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:57.996410 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:57.996816 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.997051 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:57.996057 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:57.998299 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8fd16c3c602488693b9c88e13f98589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:57.998888 6272 ts_tablet_manager.cc:1905] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:57.999558 6091 leader_election.cc:341] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:58.000228 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.000623 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.000824 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.000876 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.001048 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e05cdd590894adcb987ef3ac78bf416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.003012 6091 leader_election.cc:302] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:43:58.003228 6091 raft_consensus.cc:2670] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:43:58.004252 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef1e7125d4e42f5b30f33bfa588511c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.004771 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0d36f9f8ba214574854051d92467ff92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.005399 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d36f9f8ba214574854051d92467ff92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.006989 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25c7f3b94e94cafb3275a2e190be0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.007351 6022 raft_consensus.cc:2454] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
W20260928 10:43:58.007526 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7dba507179ed44ce903111622ec1fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dba507179ed44ce903111622ec1fb42 already in progress: creating tablet
I20260928 10:43:58.008260 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f42d5aef2424b3aacc8564d98cd3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.009529 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_76d30388f69f4b4295f41fe5c15c6d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.010147 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76d30388f69f4b4295f41fe5c15c6d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.019783 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.022840 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.022925 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.017987 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.037292 6270 tablet_replica.cc:330] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.037778 6271 tablet_bootstrap.cc:654] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.038321 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 04b947da50894cdba0f49d0738f60187 (DEFAULT_TABLE table=default.Table_d6349536abdb4f5ea6addc8eb9a7811b [id=4a75e89669ef4e509eb3d9b832262916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.040792 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b947da50894cdba0f49d0738f60187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.041551 6270 raft_consensus.cc:2229] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.041821 6270 raft_consensus.cc:2258] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.059265 6269 ts_tablet_manager.cc:1905] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.066574 6270 ts_tablet_manager.cc:1905] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.068212 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fee865b67dc14771bb4771d414861964" } new_table_name: "default.Table_257888168c6742c6b8e8cee352d1f468" modify_external_catalogs: true
I20260928 10:43:58.073138 6269 ts_tablet_manager.cc:1918] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.073274 6269 log.cc:1196] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8b0aee4f49a44bb7bf19b28d96040e65
I20260928 10:43:58.073633 6269 ts_tablet_manager.cc:1939] T 8b0aee4f49a44bb7bf19b28d96040e65 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.073740 6272 ts_tablet_manager.cc:1918] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.074631 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8b0aee4f49a44bb7bf19b28d96040e65 (table default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]) successfully deleted
W20260928 10:43:58.085599 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2d38c0ed54b45a89f8e1daefd5b67a1 already in progress: creating tablet
I20260928 10:43:58.086498 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_aff364c052aa4d948976b84e1d9e6575"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.087152 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aff364c052aa4d948976b84e1d9e6575 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.094672 6269 tablet_replica.cc:330] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.094918 6269 raft_consensus.cc:2229] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.095119 6269 raft_consensus.cc:2258] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.095719 6269 ts_tablet_manager.cc:1905] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.097379 6272 log.cc:1196] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/0f81c769b5324ca4a68134e30da7fda1
I20260928 10:43:58.098234 6272 ts_tablet_manager.cc:1939] T 0f81c769b5324ca4a68134e30da7fda1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.100363 6272 tablet_replica.cc:330] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.100625 6272 raft_consensus.cc:2229] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.100888 6272 raft_consensus.cc:2258] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.101428 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 0f81c769b5324ca4a68134e30da7fda1 (table default.Table_3340d0272c64421c93ea8d7d1495776c [id=9c582ce63a79477ebb5dd9e1d46206b8]) successfully deleted
W20260928 10:43:58.101788 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8b21a965426145c9b678ae80869be833 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b21a965426145c9b678ae80869be833 already in progress: creating tablet
I20260928 10:43:58.101833 6269 ts_tablet_manager.cc:1918] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.101970 6269 log.cc:1196] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c97e247cfc4547558b59a4168fa7e3b0
I20260928 10:43:58.102284 6269 ts_tablet_manager.cc:1939] T c97e247cfc4547558b59a4168fa7e3b0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:43:58.102262 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 23d4da5ccb214a4bbc543c67529b59cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d4da5ccb214a4bbc543c67529b59cf already in progress: creating tablet
W20260928 10:43:58.103212 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a4ed61f43d5d4a6fa21eb854dae895d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4ed61f43d5d4a6fa21eb854dae895d8 already in progress: creating tablet
W20260928 10:43:58.103511 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4a973a1d20e3437c87ad889c723e7ebc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a973a1d20e3437c87ad889c723e7ebc already in progress: creating tablet
W20260928 10:43:58.103828 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d257233e5b934d619e2289a6df55d65a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d257233e5b934d619e2289a6df55d65a already in progress: creating tablet
I20260928 10:43:58.103951 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_31d8e5b8c5614bee809b95acf1d8492f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.104224 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0e9583b5637a428db383320d98a7a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e9583b5637a428db383320d98a7a280 already in progress: creating tablet
W20260928 10:43:58.104598 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31d8e5b8c5614bee809b95acf1d8492f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.105916 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0c8bd47b36164059883db315b2959dd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.106528 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c8bd47b36164059883db315b2959dd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.109025 6273 tablet_bootstrap.cc:700] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent opening tablet: real 0.136s user 0.001s sys 0.000s
I20260928 10:43:58.109442 6273 tablet_bootstrap.cc:654] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.117728 6272 ts_tablet_manager.cc:1905] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:58.119163 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ecb1d807c9f04fe4b02e3343f0c6511c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb1d807c9f04fe4b02e3343f0c6511c already in progress: creating tablet
W20260928 10:43:58.120258 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2d38c0ed54b45a89f8e1daefd5b67a1 already in progress: creating tablet
I20260928 10:43:58.120370 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]) successfully deleted
I20260928 10:43:58.120577 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_41b8356a51a841219348f8ad61d5740e" } new_table_name: "default.Table_2b41839e03984bf8ba1380b19cb1327a" modify_external_catalogs: true
W20260928 10:43:58.120771 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 28eb4bef35cc413ebbdc177de1d7b057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28eb4bef35cc413ebbdc177de1d7b057 already in progress: creating tablet
I20260928 10:43:58.122843 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet c97e247cfc4547558b59a4168fa7e3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.123070 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_29a5cb184a6844e8823710b31cfec866"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.123704 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29a5cb184a6844e8823710b31cfec866 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.127180 6355 raft_consensus.cc:686] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:43:58.127717 6355 consensus_queue.cc:237] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.130982 6275 tablet_bootstrap.cc:492] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.131237 6275 ts_tablet_manager.cc:1397] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.234s user 0.001s sys 0.011s
I20260928 10:43:58.132117 6275 raft_consensus.cc:348] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.132519 6275 raft_consensus.cc:374] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.132668 6275 raft_consensus.cc:729] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.133039 6275 consensus_queue.cc:260] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.133983 6275 ts_tablet_manager.cc:1428] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:43:58.135388 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 440a50034c6b4110b74b1531a6b7790d (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.135936 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a50034c6b4110b74b1531a6b7790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.140867 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (DEFAULT_TABLE table=default.Table_5d292f1b10c84bb58b70b64028774b25 [id=620121bbc5c641b792d823560616b120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.141327 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.142867 5850 tablet_service.cc:1467] Processing CreateTablet for tablet db824b43256640e9bfef44da1ccf8e1a (DEFAULT_TABLE table=default.Table_676a3837be864fdda0d947883d6eccea [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.143298 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db824b43256640e9bfef44da1ccf8e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.143379 5999 tablet_service.cc:1467] Processing CreateTablet for tablet db824b43256640e9bfef44da1ccf8e1a (DEFAULT_TABLE table=default.Table_676a3837be864fdda0d947883d6eccea [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.143739 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 9afe3c828c9747958a7c558716643007 (DEFAULT_TABLE table=default.Table_e140be79b9e24b58a59051919415af22 [id=b9fd4743707c40a9bbfb44b1d14bfe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.143828 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db824b43256640e9bfef44da1ccf8e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.144138 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9afe3c828c9747958a7c558716643007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.146034 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 9afe3c828c9747958a7c558716643007 (DEFAULT_TABLE table=default.Table_e140be79b9e24b58a59051919415af22 [id=b9fd4743707c40a9bbfb44b1d14bfe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.146421 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9afe3c828c9747958a7c558716643007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.149645 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 9afe3c828c9747958a7c558716643007 (DEFAULT_TABLE table=default.Table_e140be79b9e24b58a59051919415af22 [id=b9fd4743707c40a9bbfb44b1d14bfe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.150736 6126 tablet_service.cc:1467] Processing CreateTablet for tablet db824b43256640e9bfef44da1ccf8e1a (DEFAULT_TABLE table=default.Table_676a3837be864fdda0d947883d6eccea [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.151460 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db824b43256640e9bfef44da1ccf8e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.154421 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b760d137ae6348e4abddd913d0d12649" } modify_external_catalogs: true
I20260928 10:43:58.154724 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b760d137ae6348e4abddd913d0d12649" } modify_external_catalogs: true
I20260928 10:43:58.154383 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_89caef5f6e1943cd824b68ae13547e1d" } modify_external_catalogs: true
I20260928 10:43:58.158775 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_89caef5f6e1943cd824b68ae13547e1d" } modify_external_catalogs: true
I20260928 10:43:58.158885 6273 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.159060 6273 ts_tablet_manager.cc:1397] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.187s user 0.004s sys 0.000s
I20260928 10:43:58.159737 6273 raft_consensus.cc:348] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.160264 6273 raft_consensus.cc:374] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.160346 6273 raft_consensus.cc:729] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.160625 6273 consensus_queue.cc:260] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.162396 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5c182ed527ae4f3eaabdf4eedd17650c" } new_table_name: "default.Table_9420102eb4994caea7a11294bebbebd0" modify_external_catalogs: true
I20260928 10:43:58.164888 6273 ts_tablet_manager.cc:1428] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:43:58.173177 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9afe3c828c9747958a7c558716643007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.178848 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (DEFAULT_TABLE table=default.Table_5d292f1b10c84bb58b70b64028774b25 [id=620121bbc5c641b792d823560616b120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.179898 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_847c180ba3b040189d5d48897728a05b" } new_table_name: "default.Table_bd532df1bba0449693d242f921a74c00" modify_external_catalogs: true
W20260928 10:43:58.183192 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7d762e03b384d85b4e04be8331474a4 has no consensus state
I20260928 10:43:58.183602 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e57f65b9a17d4afa8b1e7329d8e053f8" } modify_external_catalogs: true
I20260928 10:43:58.183676 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f93f92720b8f413a8b2a56dc99a59838"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.183799 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e57f65b9a17d4afa8b1e7329d8e053f8" } modify_external_catalogs: true
W20260928 10:43:58.184170 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f93f92720b8f413a8b2a56dc99a59838 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.185276 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.185621 6269 tablet_replica.cc:330] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.185827 6269 raft_consensus.cc:2229] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.186035 6269 raft_consensus.cc:2258] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.188989 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_513e423be442478eb2ff886b474898a8" } new_table_name: "default.Table_b8eb2356801c4e01a3abf4084cf4380f" modify_external_catalogs: true
I20260928 10:43:58.189384 6280 raft_consensus.cc:482] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:58.189556 6280 raft_consensus.cc:504] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.190204 6280 leader_election.cc:288] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:58.190404 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_973b0af0dc714a2e963e9915961984a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.190999 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973b0af0dc714a2e963e9915961984a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.192572 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:58.193501 6269 ts_tablet_manager.cc:1905] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:58.194736 5818 leader_election.cc:341] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:58.159612 6270 ts_tablet_manager.cc:1918] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.172811 6271 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.201433 6271 ts_tablet_manager.cc:1397] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.248s user 0.009s sys 0.001s
I20260928 10:43:58.201737 6269 ts_tablet_manager.cc:1918] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.201864 6269 log.cc:1196] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/42b522152aa44e45969f37e3f65de554
I20260928 10:43:58.202172 6269 ts_tablet_manager.cc:1939] T 42b522152aa44e45969f37e3f65de554 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.202373 6271 raft_consensus.cc:348] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.202646 6271 raft_consensus.cc:374] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.202733 6271 raft_consensus.cc:729] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.202808 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 42b522152aa44e45969f37e3f65de554 (table default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]) successfully deleted
I20260928 10:43:58.202965 6271 consensus_queue.cc:260] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.203540 6271 ts_tablet_manager.cc:1428] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:43:58.203866 6271 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.206219 6271 tablet_bootstrap.cc:654] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.191172 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:58.208149 5817 leader_election.cc:341] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:58.208318 5817 leader_election.cc:302] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:58.208776 6280 raft_consensus.cc:2726] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:58.209384 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.210603 6270 log.cc:1196] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1454e1e8bea746c0883c738ba8a293b9
I20260928 10:43:58.211051 6270 ts_tablet_manager.cc:1939] T 1454e1e8bea746c0883c738ba8a293b9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.213380 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1454e1e8bea746c0883c738ba8a293b9 (table default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]) successfully deleted
I20260928 10:43:58.214910 6270 tablet_replica.cc:330] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.215124 6270 raft_consensus.cc:2229] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.215323 6270 raft_consensus.cc:2258] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.215888 6270 ts_tablet_manager.cc:1905] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.219046 6271 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.219719 6271 ts_tablet_manager.cc:1397] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260928 10:43:58.220568 6271 raft_consensus.cc:348] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.220837 6271 raft_consensus.cc:374] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.220911 6271 raft_consensus.cc:729] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.221160 6271 consensus_queue.cc:260] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.221909 6271 ts_tablet_manager.cc:1428] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:43:58.222609 6271 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.224750 5849 tablet_service.cc:1467] Processing CreateTablet for tablet efa178fc1e344069b086003d39f1b848 (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.225211 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa178fc1e344069b086003d39f1b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.227346 5998 tablet_service.cc:1467] Processing CreateTablet for tablet c1e7257c8b114e80853ff0a108d2998a (DEFAULT_TABLE table=default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.227428 6131 tablet_service.cc:1467] Processing CreateTablet for tablet efa178fc1e344069b086003d39f1b848 (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.227780 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e7257c8b114e80853ff0a108d2998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.227699 5851 tablet_service.cc:1467] Processing CreateTablet for tablet c1e7257c8b114e80853ff0a108d2998a (DEFAULT_TABLE table=default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.228111 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e7257c8b114e80853ff0a108d2998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.228252 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 (DEFAULT_TABLE table=default.Table_513e423be442478eb2ff886b474898a8 [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.228653 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cbecd1c19541f28bd32b7c46f2df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.228681 6132 tablet_service.cc:1467] Processing CreateTablet for tablet c1e7257c8b114e80853ff0a108d2998a (DEFAULT_TABLE table=default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.232513 5995 tablet_service.cc:1467] Processing CreateTablet for tablet efa178fc1e344069b086003d39f1b848 (DEFAULT_TABLE table=default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8 [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:58.232848 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3168fb311ee64931bd326b043a397ea1 consensus state has no leader
I20260928 10:43:58.232987 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa178fc1e344069b086003d39f1b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.234790 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1e32961679ee47379dab4c62efc53d99
I20260928 10:43:58.235105 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet fbac466fe364472391a1fc2d75a46b9b
I20260928 10:43:58.235392 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet b77c90bc2ecc4fc29a4786152cb977bd from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.235648 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96174d1bf9934bcf8ca2a0000012d955" } modify_external_catalogs: true
I20260928 10:43:58.235850 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96174d1bf9934bcf8ca2a0000012d955" } modify_external_catalogs: true
I20260928 10:43:58.236159 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.236682 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43d5479a2ce44c20a9437720820f3cec consensus state has no leader
I20260928 10:43:58.236917 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 21b4deb353974c8aae4bb8148869758d from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.238341 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4938837463c94e6787ec7868085a9b35" } modify_external_catalogs: true
I20260928 10:43:58.238447 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]). Expected version 2 got 1
I20260928 10:43:58.238572 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4938837463c94e6787ec7868085a9b35" } modify_external_catalogs: true
I20260928 10:43:58.239092 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 75ccd6efe3854d65995b17a38d81eaa5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.240096 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.240213 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa178fc1e344069b086003d39f1b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.241066 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 733ca22794da4015bbe09ed6c374ad05
W20260928 10:43:58.234843 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98bd99e7bdb647ceb9357f88affc45d9 consensus state has no leader
W20260928 10:43:58.234792 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39cbecd1c19541f28bd32b7c46f2df61 consensus state has no leader
I20260928 10:43:58.243939 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b12c9e0066374ae3a437cd0ebdb3efb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.244655 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.246827 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_56cad2504f324a07bdc271aeaeb77f0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.247525 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56cad2504f324a07bdc271aeaeb77f0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.251506 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bad6520821464a76b299414b42ab029f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.252099 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bad6520821464a76b299414b42ab029f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.252259 6273 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.252408 6271 tablet_bootstrap.cc:654] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.253939 6273 tablet_bootstrap.cc:654] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.255229 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.255843 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.256556 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet fbac466fe364472391a1fc2d75a46b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbac466fe364472391a1fc2d75a46b9b already in progress: creating tablet
W20260928 10:43:58.256820 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1e32961679ee47379dab4c62efc53d99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e32961679ee47379dab4c62efc53d99 already in progress: creating tablet
I20260928 10:43:58.255587 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.257556 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.257562 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01958d46e9064e34966558e06b2d3cb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.258764 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01958d46e9064e34966558e06b2d3cb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.260447 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.261387 6270 ts_tablet_manager.cc:1918] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.261821 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]). Expected version 1 got 0
I20260928 10:43:58.262136 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet a765989e9ba3467f811f5fd49b67cb36 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.262548 6270 log.cc:1196] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c97e247cfc4547558b59a4168fa7e3b0
I20260928 10:43:58.263221 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.263855 6271 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.264032 6271 ts_tablet_manager.cc:1397] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
I20260928 10:43:58.264472 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 (DEFAULT_TABLE table=default.Table_b8eb2356801c4e01a3abf4084cf4380f [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:58.264735 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 733ca22794da4015bbe09ed6c374ad05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ca22794da4015bbe09ed6c374ad05 already in progress: creating tablet
W20260928 10:43:58.265004 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 42b522152aa44e45969f37e3f65de554 because the tablet was not found. No further retry: Not found: Tablet not found: 42b522152aa44e45969f37e3f65de554
I20260928 10:43:58.265419 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.265801 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.265973 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.266372 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.270908 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 943db4a7f3fe4283a67defd68e744e33 (DEFAULT_TABLE table=default.Table_b4c8b5f8eede428da452daeb16948828 [id=0334f9b1aea343a2b20a0b0aa513d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.271302 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 943db4a7f3fe4283a67defd68e744e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.272645 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e9583b5637a428db383320d98a7a280 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.273069 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cbecd1c19541f28bd32b7c46f2df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.278036 6271 raft_consensus.cc:348] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.278292 6271 raft_consensus.cc:374] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.278389 6271 raft_consensus.cc:729] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.278617 6271 consensus_queue.cc:260] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.279175 6271 ts_tablet_manager.cc:1428] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 10:43:58.279532 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c4528bf643664da29496849c94e6dd2e
I20260928 10:43:58.280685 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 21b4deb353974c8aae4bb8148869758d
I20260928 10:43:58.280876 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.281033 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 21b4deb353974c8aae4bb8148869758d deleted and replaced by tablet 502d275d161945ce86626594ab0d89b3
I20260928 10:43:58.281383 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:43:58.281642 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.281759 5698 catalog_manager.cc:6565] ReplaceTablet: tablet b77c90bc2ecc4fc29a4786152cb977bd deleted and replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361
I20260928 10:43:58.282401 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.284901 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5a51d9a67e15479587ab2d5a492bb7c2
I20260928 10:43:58.286617 6271 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.287187 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.287160 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 943db4a7f3fe4283a67defd68e744e33 (DEFAULT_TABLE table=default.Table_b4c8b5f8eede428da452daeb16948828 [id=0334f9b1aea343a2b20a0b0aa513d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.287559 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 943db4a7f3fe4283a67defd68e744e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.287640 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.270062 6491 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:58.263875 6270 ts_tablet_manager.cc:1939] T c97e247cfc4547558b59a4168fa7e3b0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:58.289134 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b77c90bc2ecc4fc29a4786152cb977bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c90bc2ecc4fc29a4786152cb977bd already in progress: creating tablet
W20260928 10:43:58.291532 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5a51d9a67e15479587ab2d5a492bb7c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a51d9a67e15479587ab2d5a492bb7c2 already in progress: creating tablet
I20260928 10:43:58.290730 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.292212 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.293334 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 21b4deb353974c8aae4bb8148869758d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21b4deb353974c8aae4bb8148869758d already in progress: creating tablet
W20260928 10:43:58.293625 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c4528bf643664da29496849c94e6dd2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4528bf643664da29496849c94e6dd2e already in progress: creating tablet
I20260928 10:43:58.298302 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e7257c8b114e80853ff0a108d2998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.299424 6272 ts_tablet_manager.cc:1918] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.299582 6272 log.cc:1196] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/2693b378215f425bb1c2e3e0963aac95
I20260928 10:43:58.300976 6273 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.301149 6273 ts_tablet_manager.cc:1397] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.001s
I20260928 10:43:58.290954 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.290987 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.301975 6273 raft_consensus.cc:348] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.302237 6273 raft_consensus.cc:374] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.302340 6273 raft_consensus.cc:729] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.302920 6496 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:58.303381 6275 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.304793 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]) successfully deleted
W20260928 10:43:58.305552 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 733ca22794da4015bbe09ed6c374ad05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ca22794da4015bbe09ed6c374ad05 already in progress: creating tablet
I20260928 10:43:58.304550 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.306607 6271 tablet_bootstrap.cc:654] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:58.308674 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet fbac466fe364472391a1fc2d75a46b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbac466fe364472391a1fc2d75a46b9b already in progress: creating tablet
I20260928 10:43:58.309082 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.309419 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:58.309424 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1e32961679ee47379dab4c62efc53d99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e32961679ee47379dab4c62efc53d99 already in progress: creating tablet
I20260928 10:43:58.309825 6270 tablet_replica.cc:330] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.310109 6270 raft_consensus.cc:2229] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.310405 6270 raft_consensus.cc:2258] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.313310 6273 consensus_queue.cc:260] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.314633 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.315361 6271 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.315536 6271 ts_tablet_manager.cc:1397] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
I20260928 10:43:58.316360 6271 raft_consensus.cc:348] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.316668 6271 raft_consensus.cc:374] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.316744 6271 raft_consensus.cc:729] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.316992 6271 consensus_queue.cc:260] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.317593 6271 ts_tablet_manager.cc:1428] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:43:58.317932 6271 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.318617 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.316360 6270 ts_tablet_manager.cc:1905] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.319948 6271 tablet_bootstrap.cc:654] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.322219 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.323030 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1f6fe4271349432db8efda609d85d611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6fe4271349432db8efda609d85d611 already in progress: creating tablet
I20260928 10:43:58.323637 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822] alter complete (version 2)
I20260928 10:43:58.325815 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 (DEFAULT_TABLE table=default.Table_b8eb2356801c4e01a3abf4084cf4380f [id=0e2cd69449224ba0a1d4cae1da393956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.326257 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cbecd1c19541f28bd32b7c46f2df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.326833 6273 ts_tablet_manager.cc:1428] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20260928 10:43:58.330058 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.330338 6269 tablet_replica.cc:330] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.330577 6269 raft_consensus.cc:2229] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.330556 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet e76a54bfddc74a9e86285add7b97645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.330766 6269 raft_consensus.cc:2258] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.330766 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.330904 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.331328 6269 ts_tablet_manager.cc:1905] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.333001 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 943db4a7f3fe4283a67defd68e744e33 (DEFAULT_TABLE table=default.Table_b4c8b5f8eede428da452daeb16948828 [id=0334f9b1aea343a2b20a0b0aa513d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.333467 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 943db4a7f3fe4283a67defd68e744e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.338348 6269 ts_tablet_manager.cc:1918] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.338766 6269 log.cc:1196] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1f6fe4271349432db8efda609d85d611
I20260928 10:43:58.338745 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (DEFAULT_TABLE table=default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.339187 6269 ts_tablet_manager.cc:1939] T 1f6fe4271349432db8efda609d85d611 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.339313 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:58.339450 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3168fb311ee64931bd326b043a397ea1 consensus state has no leader
I20260928 10:43:58.340019 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1f6fe4271349432db8efda609d85d611 (table default.Table_b6a8b78145f2494aa8b0e49415c15f9d [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]) successfully deleted
I20260928 10:43:58.342887 6275 tablet_bootstrap.cc:654] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.344120 6273 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.344304 6272 ts_tablet_manager.cc:1939] T 2693b378215f425bb1c2e3e0963aac95 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.345508 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 2693b378215f425bb1c2e3e0963aac95 (table default.Table_51b6797b284b4bab9e23e290a53926fc [id=9bfa888c61bf433cab0fe7ef138106a5]) successfully deleted
I20260928 10:43:58.347214 6270 ts_tablet_manager.cc:1918] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.347394 6270 log.cc:1196] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/af258604238c4e39adac40c81d5a6f3f
I20260928 10:43:58.349674 6272 tablet_replica.cc:330] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.349895 6272 raft_consensus.cc:2229] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:43:58.350313 6272 pending_rounds.cc:62] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:43:58.351485 6271 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.351652 6271 ts_tablet_manager.cc:1397] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20260928 10:43:58.352432 6271 raft_consensus.cc:348] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.352711 6271 raft_consensus.cc:374] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.352800 6271 raft_consensus.cc:729] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.353035 6271 consensus_queue.cc:260] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.355719 6271 ts_tablet_manager.cc:1428] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 10:43:58.356280 6270 ts_tablet_manager.cc:1939] T af258604238c4e39adac40c81d5a6f3f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.349869 6273 tablet_bootstrap.cc:654] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.359112 6271 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.360934 6271 tablet_bootstrap.cc:654] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.350464 6272 pending_rounds.cc:68] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265807377727488 op_type: NO_OP noop_request { }
I20260928 10:43:58.361126 6272 raft_consensus.cc:2866] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:43:58.361276 6272 raft_consensus.cc:2258] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.362582 6272 ts_tablet_manager.cc:1905] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.362608 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet af258604238c4e39adac40c81d5a6f3f (table default.Table_9af467c9f80a4119845169339a5d6994 [id=bb501c74345744529c7acff050952d6e]) successfully deleted
W20260928 10:43:58.362953 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c4528bf643664da29496849c94e6dd2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4528bf643664da29496849c94e6dd2e already in progress: creating tablet
W20260928 10:43:58.363202 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 21b4deb353974c8aae4bb8148869758d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21b4deb353974c8aae4bb8148869758d already in progress: creating tablet
W20260928 10:43:58.363466 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b77c90bc2ecc4fc29a4786152cb977bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c90bc2ecc4fc29a4786152cb977bd already in progress: creating tablet
W20260928 10:43:58.363693 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5a51d9a67e15479587ab2d5a492bb7c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a51d9a67e15479587ab2d5a492bb7c2 already in progress: creating tablet
I20260928 10:43:58.363597 6270 tablet_replica.cc:330] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.364131 6270 raft_consensus.cc:2229] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.364329 6270 raft_consensus.cc:2258] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.357295 6499 tablet.cc:1722] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:43:58.370278 6271 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.370527 6271 ts_tablet_manager.cc:1397] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260928 10:43:58.359771 6275 tablet_bootstrap.cc:492] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.372372 6275 ts_tablet_manager.cc:1397] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.003s
I20260928 10:43:58.372714 6271 raft_consensus.cc:348] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.373006 6271 raft_consensus.cc:374] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.373080 6271 raft_consensus.cc:729] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.373322 6275 raft_consensus.cc:348] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.373616 6275 raft_consensus.cc:374] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.373674 6270 ts_tablet_manager.cc:1905] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.373710 6275 raft_consensus.cc:729] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.374055 6275 consensus_queue.cc:260] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.374402 6271 consensus_queue.cc:260] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.374743 6275 ts_tablet_manager.cc:1428] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:58.375557 6273 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.375746 6273 ts_tablet_manager.cc:1397] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.005s
I20260928 10:43:58.376430 6273 raft_consensus.cc:348] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.376667 6273 raft_consensus.cc:374] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.376752 6273 raft_consensus.cc:729] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.377058 6273 consensus_queue.cc:260] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.378921 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_89c05124506147cb91475760df1ce319 [id=6677562fe2604addb84af531539cbebd]). Expected version 1 got 0
I20260928 10:43:58.379513 6270 ts_tablet_manager.cc:1918] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.379633 6270 log.cc:1196] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/7f61f6e2bb8a4166ae93f74ae13ac2a0
I20260928 10:43:58.380891 6270 ts_tablet_manager.cc:1939] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.381156 5857 tablet_service.cc:1467] Processing CreateTablet for tablet cc50ec106e9b4137b64bf6ce71487979 (DEFAULT_TABLE table=default.Table_29a5cb184a6844e8823710b31cfec866 [id=6bef1aebacdc4a03b212adda83e80f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.381528 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc50ec106e9b4137b64bf6ce71487979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.382227 6131 tablet_service.cc:1467] Processing CreateTablet for tablet cc50ec106e9b4137b64bf6ce71487979 (DEFAULT_TABLE table=default.Table_29a5cb184a6844e8823710b31cfec866 [id=6bef1aebacdc4a03b212adda83e80f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.382457 6273 ts_tablet_manager.cc:1428] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 10:43:58.382720 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc50ec106e9b4137b64bf6ce71487979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.389971 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.390250 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (table default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]) successfully deleted
I20260928 10:43:58.390318 6271 ts_tablet_manager.cc:1428] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260928 10:43:58.390694 6271 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.390960 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a390c5e5221f4bbba5c21311860ca5f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.391501 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a390c5e5221f4bbba5c21311860ca5f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.392439 6271 tablet_bootstrap.cc:654] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.392694 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_752e3c917c88427c89c7b474aa6e2142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.393512 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bb8c5c03d60e4a16b7a66ec258c00e74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.394060 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:58.396782 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_752e3c917c88427c89c7b474aa6e2142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.398200 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_50e898f110284e12a29a763192630a05 [id=7af448c554a042ab877113eb284d68c7]). Expected version 3 got 0
I20260928 10:43:58.399609 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.400144 6275 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.400539 6273 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.402275 6273 tablet_bootstrap.cc:654] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.402297 6270 tablet_replica.cc:330] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.402540 6270 raft_consensus.cc:2229] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.402719 6275 tablet_bootstrap.cc:654] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.402725 6270 raft_consensus.cc:2258] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.404150 6270 ts_tablet_manager.cc:1905] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.404615 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_50e898f110284e12a29a763192630a05" } new_table_name: "default.Table_31f734bdbf584367a86b12dcf8e2b373" modify_external_catalogs: true
I20260928 10:43:58.410038 6272 ts_tablet_manager.cc:1918] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:43:58.410952 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_50e898f110284e12a29a763192630a05 [id=7af448c554a042ab877113eb284d68c7]). Expected version 3 got 0
I20260928 10:43:58.412024 6270 ts_tablet_manager.cc:1918] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.414726 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1454e1e8bea746c0883c738ba8a293b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.415812 6272 log.cc:1196] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c97e247cfc4547558b59a4168fa7e3b0
I20260928 10:43:58.416322 6272 ts_tablet_manager.cc:1939] T c97e247cfc4547558b59a4168fa7e3b0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.418207 6273 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.418366 6273 ts_tablet_manager.cc:1397] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.004s
I20260928 10:43:58.419153 6273 raft_consensus.cc:348] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.419394 6273 raft_consensus.cc:374] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.419492 6273 raft_consensus.cc:729] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.419773 6273 consensus_queue.cc:260] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.420311 6270 log.cc:1196] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4c93507a0bf14c8383794b34ba1702fd
I20260928 10:43:58.420948 6270 ts_tablet_manager.cc:1939] T 4c93507a0bf14c8383794b34ba1702fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.421016 6275 tablet_bootstrap.cc:492] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.421924 6273 ts_tablet_manager.cc:1428] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:58.422204 6273 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.423867 6273 tablet_bootstrap.cc:654] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:58.426000 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 780707959e0e48d6a83b22e6479a5884 consensus state has no leader
I20260928 10:43:58.426973 6270 tablet_replica.cc:330] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.427260 6275 ts_tablet_manager.cc:1397] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260928 10:43:58.427582 6270 raft_consensus.cc:2229] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.428086 6270 raft_consensus.cc:2258] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.429075 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c97e247cfc4547558b59a4168fa7e3b0 (table default.Table_423a4f1dc8dd44c8a0a578be4f07c984 [id=1ea87897a2684da8a50f4bba795e4c60]) successfully deleted
I20260928 10:43:58.429742 6270 ts_tablet_manager.cc:1905] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.429978 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (DEFAULT_TABLE table=default.Table_31d8e5b8c5614bee809b95acf1d8492f [id=aa8af07a351b4a479550ac24c9e23f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.429996 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (DEFAULT_TABLE table=default.Table_31d8e5b8c5614bee809b95acf1d8492f [id=aa8af07a351b4a479550ac24c9e23f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.430657 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8242d0647d1b4f28a5f1ccf36b00d616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.430967 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8242d0647d1b4f28a5f1ccf36b00d616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.431705 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.432027 6269 tablet_replica.cc:330] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.432238 6269 raft_consensus.cc:2229] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.432457 6269 raft_consensus.cc:2258] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.433369 6275 raft_consensus.cc:348] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.433619 6275 raft_consensus.cc:374] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.433717 6275 raft_consensus.cc:729] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.434022 6275 consensus_queue.cc:260] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:43:58.435616 6275 ts_tablet_manager.cc:1428] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 10:43:58.438805 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]). Expected version 1 got 0
I20260928 10:43:58.439617 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_676a3837be864fdda0d947883d6eccea" } new_table_name: "default.Table_e76b9dab4c2a46e09d9ac504f02b02e0" modify_external_catalogs: true
I20260928 10:43:58.439967 6269 ts_tablet_manager.cc:1905] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.439625 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_84284909ddb043bfa220be15cff2a4ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.440634 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84284909ddb043bfa220be15cff2a4ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.440937 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 44bc6831f9354ddb81212bc107efdf68 (DEFAULT_TABLE table=default.Table_aff364c052aa4d948976b84e1d9e6575 [id=7e99e684b74f47279b22e18c1cf09935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.441387 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44bc6831f9354ddb81212bc107efdf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.442314 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 44bc6831f9354ddb81212bc107efdf68 (DEFAULT_TABLE table=default.Table_aff364c052aa4d948976b84e1d9e6575 [id=7e99e684b74f47279b22e18c1cf09935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.442812 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44bc6831f9354ddb81212bc107efdf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.444612 6273 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.444799 6273 ts_tablet_manager.cc:1397] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260928 10:43:58.445636 6273 raft_consensus.cc:348] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.445875 6273 raft_consensus.cc:374] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.445945 6273 raft_consensus.cc:729] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.446174 6273 consensus_queue.cc:260] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.447723 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]). Expected version 1 got 0
I20260928 10:43:58.448135 5998 tablet_service.cc:1467] Processing CreateTablet for tablet cc50ec106e9b4137b64bf6ce71487979 (DEFAULT_TABLE table=default.Table_29a5cb184a6844e8823710b31cfec866 [id=6bef1aebacdc4a03b212adda83e80f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.448558 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc50ec106e9b4137b64bf6ce71487979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.448843 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0c8bd47b36164059883db315b2959dd3" } new_table_name: "default.Table_771449d5cc0d4eb2b2ed9241efa22ed6" modify_external_catalogs: true
I20260928 10:43:58.449626 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e1bf6b61428c4c59b89c1570bf86cdde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.450196 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1bf6b61428c4c59b89c1570bf86cdde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.450148 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d1843f7fdad49b58bf61b192e5f37bd" } new_table_name: "default.Table_6279d9ee60ce44759d7bc1ae62dd2073" modify_external_catalogs: true
I20260928 10:43:58.450562 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_be18240efd154023873afce4c90875f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.451064 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be18240efd154023873afce4c90875f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.451346 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf" } modify_external_catalogs: true
I20260928 10:43:58.451527 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf" } modify_external_catalogs: true
I20260928 10:43:58.452723 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bad6520821464a76b299414b42ab029f" } modify_external_catalogs: true
I20260928 10:43:58.452922 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bad6520821464a76b299414b42ab029f" } modify_external_catalogs: true
I20260928 10:43:58.453248 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_00fbff9d20b64e17a45b28933380b233" } new_table_name: "default.Table_b69782fa1420476b8da47aaa1366be8b" modify_external_catalogs: true
I20260928 10:43:58.455488 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (DEFAULT_TABLE table=default.Table_31d8e5b8c5614bee809b95acf1d8492f [id=aa8af07a351b4a479550ac24c9e23f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.455896 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8242d0647d1b4f28a5f1ccf36b00d616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.455962 6272 tablet_replica.cc:330] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.456168 6272 raft_consensus.cc:2229] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.456328 6272 raft_consensus.cc:2258] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.454695 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2782a761b523442d88471194d3f881e8" } modify_external_catalogs: true
I20260928 10:43:58.458222 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2782a761b523442d88471194d3f881e8" } modify_external_catalogs: true
I20260928 10:43:58.462214 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4c93507a0bf14c8383794b34ba1702fd (table default.Table_b8eb2356801c4e01a3abf4084cf4380f [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:43:58.462280 6269 ts_tablet_manager.cc:1918] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.462424 6269 log.cc:1196] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f57cd5585604424d92b8ce2522085567
I20260928 10:43:58.462807 6269 ts_tablet_manager.cc:1939] T f57cd5585604424d92b8ce2522085567 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.463315 6275 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.465087 6275 tablet_bootstrap.cc:654] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:58.465446 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ecb1d807c9f04fe4b02e3343f0c6511c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb1d807c9f04fe4b02e3343f0c6511c already in progress: creating tablet
W20260928 10:43:58.465716 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2d38c0ed54b45a89f8e1daefd5b67a1 already in progress: creating tablet
W20260928 10:43:58.465951 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7dba507179ed44ce903111622ec1fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dba507179ed44ce903111622ec1fb42 already in progress: creating tablet
W20260928 10:43:58.466150 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 28eb4bef35cc413ebbdc177de1d7b057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28eb4bef35cc413ebbdc177de1d7b057 already in progress: creating tablet
I20260928 10:43:58.466321 6273 ts_tablet_manager.cc:1428] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
W20260928 10:43:58.466368 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1e32961679ee47379dab4c62efc53d99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e32961679ee47379dab4c62efc53d99 already in progress: creating tablet
W20260928 10:43:58.466643 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c4528bf643664da29496849c94e6dd2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4528bf643664da29496849c94e6dd2e already in progress: creating tablet
W20260928 10:43:58.466909 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b77c90bc2ecc4fc29a4786152cb977bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b77c90bc2ecc4fc29a4786152cb977bd already in progress: creating tablet
W20260928 10:43:58.467082 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fbac466fe364472391a1fc2d75a46b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbac466fe364472391a1fc2d75a46b9b already in progress: creating tablet
I20260928 10:43:58.467275 6273 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:58.467283 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 733ca22794da4015bbe09ed6c374ad05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ca22794da4015bbe09ed6c374ad05 already in progress: creating tablet
I20260928 10:43:58.468508 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f57cd5585604424d92b8ce2522085567 (table default.Table_333faec6e5864a4982d5c0743c880176 [id=6c9610724d3341d193cf34cdee8780b7]) successfully deleted
I20260928 10:43:58.469388 6271 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.469549 6271 ts_tablet_manager.cc:1397] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.001s
I20260928 10:43:58.474256 6273 tablet_bootstrap.cc:654] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.474429 6272 ts_tablet_manager.cc:1905] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.471765 6271 raft_consensus.cc:348] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.476156 6271 raft_consensus.cc:374] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.476262 6271 raft_consensus.cc:729] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.476539 6271 consensus_queue.cc:260] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.477244 6271 ts_tablet_manager.cc:1428] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:43:58.477532 6271 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.478674 6270 ts_tablet_manager.cc:1918] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.478868 6270 log.cc:1196] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/98566f85241c42cf92f3e131318d6efb
I20260928 10:43:58.479223 6271 tablet_bootstrap.cc:654] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.479441 6270 ts_tablet_manager.cc:1939] T 98566f85241c42cf92f3e131318d6efb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.480568 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 98566f85241c42cf92f3e131318d6efb (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
I20260928 10:43:58.481691 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:58.482293 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16510244612242f796910cf28e367da9 consensus state has no leader
I20260928 10:43:58.482997 6275 tablet_bootstrap.cc:492] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.483867 6275 ts_tablet_manager.cc:1397] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260928 10:43:58.484635 6275 raft_consensus.cc:348] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.484874 6275 raft_consensus.cc:374] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.484890 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.484941 6275 raft_consensus.cc:729] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.485213 6269 tablet_replica.cc:330] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.485443 6269 raft_consensus.cc:2229] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.485605 6269 raft_consensus.cc:2258] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.489930 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 41f6916daf024379a7dd0411e44ba6ca
I20260928 10:43:58.490028 6269 ts_tablet_manager.cc:1905] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.491101 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f6916daf024379a7dd0411e44ba6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.492070 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db824b43256640e9bfef44da1ccf8e1a consensus state has no leader
I20260928 10:43:58.485867 6275 consensus_queue.cc:260] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.495802 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet a380da90a76545dba647e0c1b3e05acd from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.496531 6275 ts_tablet_manager.cc:1428] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 10:43:58.496466 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_56cad2504f324a07bdc271aeaeb77f0e" } modify_external_catalogs: true
I20260928 10:43:58.496680 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_56cad2504f324a07bdc271aeaeb77f0e" } modify_external_catalogs: true
I20260928 10:43:58.496860 6275 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.499982 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60470bf7130b4650bf7042a36ed9fb00" } modify_external_catalogs: true
I20260928 10:43:58.500205 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60470bf7130b4650bf7042a36ed9fb00" } modify_external_catalogs: true
I20260928 10:43:58.502782 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f6916daf024379a7dd0411e44ba6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.503039 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.502997 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9afdecc58f0a43359450f328ef0633f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.503428 6270 tablet_replica.cc:330] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:43:58.503648 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9afdecc58f0a43359450f328ef0633f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.503674 6270 raft_consensus.cc:2229] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.503958 6270 raft_consensus.cc:2258] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.504777 6270 ts_tablet_manager.cc:1905] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.505319 6269 ts_tablet_manager.cc:1918] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.505481 6269 log.cc:1196] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/cf9361a96fdc44d7ac38a1d0d812eac0
I20260928 10:43:58.505347 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bfc5c67f10b449c1a9c2ab1380fa042a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.505853 6269 ts_tablet_manager.cc:1939] T cf9361a96fdc44d7ac38a1d0d812eac0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:43:58.505927 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfc5c67f10b449c1a9c2ab1380fa042a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.507035 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet cf9361a96fdc44d7ac38a1d0d812eac0 (table default.Table_d317ef6e443b4c10b5972fe1ad8e93ea [id=d8bb5aee4ea44ee3b1eb058e062c389d]) successfully deleted
I20260928 10:43:58.507149 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7b765681901c4d4180fd455a743f0a4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.507651 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b765681901c4d4180fd455a743f0a4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.507830 6275 tablet_bootstrap.cc:654] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.511060 6269 tablet_replica.cc:330] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.511276 6269 raft_consensus.cc:2229] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.511489 6269 raft_consensus.cc:2258] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.511910 6270 ts_tablet_manager.cc:1918] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.512064 6270 log.cc:1196] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/41f6916daf024379a7dd0411e44ba6ca
I20260928 10:43:58.512089 6269 ts_tablet_manager.cc:1905] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.513037 6270 ts_tablet_manager.cc:1939] T 41f6916daf024379a7dd0411e44ba6ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.513374 6271 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.513538 6271 ts_tablet_manager.cc:1397] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260928 10:43:58.514776 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]) successfully deleted
I20260928 10:43:58.514753 6271 raft_consensus.cc:348] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.515046 6271 raft_consensus.cc:374] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.515128 6271 raft_consensus.cc:729] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.515236 6273 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.515388 6273 ts_tablet_manager.cc:1397] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.001s
I20260928 10:43:58.515441 6271 consensus_queue.cc:260] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.516090 6271 ts_tablet_manager.cc:1428] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:43:58.516392 6271 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:43:58.517125 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86b16eb36c034591ac1603ab84fd9342 consensus state has no leader
I20260928 10:43:58.518216 6273 raft_consensus.cc:348] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.518854 6273 raft_consensus.cc:374] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.518976 6273 raft_consensus.cc:729] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.519340 6273 consensus_queue.cc:260] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.521667 6271 tablet_bootstrap.cc:654] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.521723 6273 ts_tablet_manager.cc:1428] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:43:58.523115 6273 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.523826 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 41f6916daf024379a7dd0411e44ba6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.524008 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4a57721f3cd145538940531d9b55ac4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.524284 6275 tablet_bootstrap.cc:492] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.524431 6275 ts_tablet_manager.cc:1397] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
W20260928 10:43:58.525669 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a57721f3cd145538940531d9b55ac4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.525938 6273 tablet_bootstrap.cc:654] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.525254 6275 raft_consensus.cc:348] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.526417 6275 raft_consensus.cc:374] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.526556 6275 raft_consensus.cc:729] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.526804 6275 consensus_queue.cc:260] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.527643 6275 ts_tablet_manager.cc:1428] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:43:58.530967 6275 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.531513 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 98566f85241c42cf92f3e131318d6efb with delete_type TABLET_DATA_DELETED (replaced by tablet 734c3196929d4814b77bce7938bf598e) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.531670 6270 tablet_replica.cc:330] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.531899 6270 raft_consensus.cc:2229] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.532145 6270 raft_consensus.cc:2258] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.535017 6275 tablet_bootstrap.cc:654] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.537515 6272 ts_tablet_manager.cc:1918] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.537690 6272 log.cc:1196] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e76a54bfddc74a9e86285add7b97645b
I20260928 10:43:58.538098 6272 ts_tablet_manager.cc:1939] T e76a54bfddc74a9e86285add7b97645b P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.538300 6270 ts_tablet_manager.cc:1905] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.538812 5697 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f23280c7067441229cff95c7cc6efb00
I20260928 10:43:58.542196 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e76a54bfddc74a9e86285add7b97645b (table default.Table_6d8b6b9f7f18477e8cf57a7624940b36 [id=fdaf549a8da04f45a0d076c092f74fc6]) successfully deleted
I20260928 10:43:58.545153 6269 ts_tablet_manager.cc:1918] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.545316 6269 log.cc:1196] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/41f6916daf024379a7dd0411e44ba6ca
I20260928 10:43:58.545699 6269 ts_tablet_manager.cc:1939] T 41f6916daf024379a7dd0411e44ba6ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.546759 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]) successfully deleted
I20260928 10:43:58.548179 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.548385 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 16f7d561b10e46609f22ce17b323fb23 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.550714 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:58.551337 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 21b4deb353974c8aae4bb8148869758d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21b4deb353974c8aae4bb8148869758d already in progress: creating tablet
I20260928 10:43:58.551514 6272 tablet_replica.cc:330] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.551642 6269 tablet_replica.cc:330] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.551708 6272 raft_consensus.cc:2229] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.551927 6272 raft_consensus.cc:2258] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:58.551909 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5a51d9a67e15479587ab2d5a492bb7c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a51d9a67e15479587ab2d5a492bb7c2 already in progress: creating tablet
I20260928 10:43:58.551859 6269 raft_consensus.cc:2229] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.552138 6269 raft_consensus.cc:2258] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.554677 6269 ts_tablet_manager.cc:1905] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.555375 6272 ts_tablet_manager.cc:1905] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.556568 5701 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a2ab820fc9e4460bac0d4c21dd69d361
I20260928 10:43:58.562258 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet db824b43256640e9bfef44da1ccf8e1a from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.565209 6271 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.565336 6273 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.565395 6271 ts_tablet_manager.cc:1397] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.008s
I20260928 10:43:58.565491 6273 ts_tablet_manager.cc:1397] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
I20260928 10:43:58.566203 6271 raft_consensus.cc:348] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.566183 6273 raft_consensus.cc:348] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.566452 6271 raft_consensus.cc:374] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.566493 6273 raft_consensus.cc:374] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.566573 6273 raft_consensus.cc:729] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.566591 6271 raft_consensus.cc:729] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.566852 6271 consensus_queue.cc:260] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.566867 6273 consensus_queue.cc:260] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.567608 6271 ts_tablet_manager.cc:1428] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 10:43:58.567898 6271 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:43:58.569273 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ef1e7125d4e42f5b30f33bfa588511c consensus state has no leader
I20260928 10:43:58.574218 6272 ts_tablet_manager.cc:1918] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.574366 6272 log.cc:1196] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1454e1e8bea746c0883c738ba8a293b9
I20260928 10:43:58.574644 6273 ts_tablet_manager.cc:1428] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260928 10:43:58.574641 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:43:58.575109 6271 tablet_bootstrap.cc:654] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.575742 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet ab1277e4c47141ea9480987eef715528 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.576730 6273 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.577543 6275 tablet_bootstrap.cc:492] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.577720 6275 ts_tablet_manager.cc:1397] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.003s
I20260928 10:43:58.578495 6275 raft_consensus.cc:348] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.578748 6275 raft_consensus.cc:374] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.578824 6275 raft_consensus.cc:729] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.579094 6275 consensus_queue.cc:260] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.579766 6275 ts_tablet_manager.cc:1428] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:43:58.580288 6273 tablet_bootstrap.cc:654] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.581651 5694 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 059b37a215a04b4b971528d792e27c18
I20260928 10:43:58.580657 6275 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.581481 6272 ts_tablet_manager.cc:1939] T 1454e1e8bea746c0883c738ba8a293b9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.586262 6272 tablet_replica.cc:330] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.586462 6272 raft_consensus.cc:2229] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.586640 6272 raft_consensus.cc:2258] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.587641 6275 tablet_bootstrap.cc:654] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.588689 6272 ts_tablet_manager.cc:1905] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.589004 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.589527 6269 ts_tablet_manager.cc:1918] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.589676 6269 log.cc:1196] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0acf2685688e4e108bba66842acedbb9
I20260928 10:43:58.590664 6269 ts_tablet_manager.cc:1939] T 0acf2685688e4e108bba66842acedbb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.591017 6270 ts_tablet_manager.cc:1918] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.591171 6270 log.cc:1196] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/64a424286b6e4d32a2ceb67ed6cdc02d
I20260928 10:43:58.591566 6270 ts_tablet_manager.cc:1939] T 64a424286b6e4d32a2ceb67ed6cdc02d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.592108 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1454e1e8bea746c0883c738ba8a293b9 (table default.Table_b9d751ff716d42048d84fa159b5cdff7 [id=c1970a46d9584fd9aa7313b3fd3e7867]) successfully deleted
I20260928 10:43:58.592303 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a424286b6e4d32a2ceb67ed6cdc02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.592557 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 64a424286b6e4d32a2ceb67ed6cdc02d (table default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]) successfully deleted
I20260928 10:43:58.592952 6271 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.593116 6271 ts_tablet_manager.cc:1397] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260928 10:43:58.593858 6271 raft_consensus.cc:348] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.594120 6271 raft_consensus.cc:374] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.594197 6271 raft_consensus.cc:729] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.594460 6271 consensus_queue.cc:260] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.596462 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0acf2685688e4e108bba66842acedbb9 (table default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]) successfully deleted
I20260928 10:43:58.597877 6271 ts_tablet_manager.cc:1428] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 10:43:58.599087 6269 tablet_replica.cc:330] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.599303 6269 raft_consensus.cc:2229] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.599311 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.599500 6269 raft_consensus.cc:2258] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.600029 6272 ts_tablet_manager.cc:1918] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.600198 6272 log.cc:1196] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/41f6916daf024379a7dd0411e44ba6ca
I20260928 10:43:58.600540 6271 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.600603 6272 ts_tablet_manager.cc:1939] T 41f6916daf024379a7dd0411e44ba6ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.601511 6269 ts_tablet_manager.cc:1905] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.602315 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a380da90a76545dba647e0c1b3e05acd
I20260928 10:43:58.603193 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.603415 5693 catalog_manager.cc:6565] ReplaceTablet: tablet a380da90a76545dba647e0c1b3e05acd deleted and replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7
I20260928 10:43:58.603410 6271 tablet_bootstrap.cc:654] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.605047 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.605698 6275 tablet_bootstrap.cc:492] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.605875 6275 ts_tablet_manager.cc:1397] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260928 10:43:58.606359 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3b1f6971648540279d90e7812fddf964"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.606739 6275 raft_consensus.cc:348] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.606993 6275 raft_consensus.cc:374] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:43:58.607079 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b1f6971648540279d90e7812fddf964 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.607091 6275 raft_consensus.cc:729] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.607390 6275 consensus_queue.cc:260] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.608954 6275 ts_tablet_manager.cc:1428] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 10:43:58.610381 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 41f6916daf024379a7dd0411e44ba6ca (table default.Table_b9ea1c2322f24f038f7bd48e4bf7ebdf [id=0558f36d9f534cc9a044dcad2e835c63]) successfully deleted
I20260928 10:43:58.610767 6272 tablet_replica.cc:330] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.610965 6272 raft_consensus.cc:2229] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.611177 6272 raft_consensus.cc:2258] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.611658 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.612983 6272 ts_tablet_manager.cc:1905] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.613039 6479 raft_consensus.cc:482] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:58.613199 6479 raft_consensus.cc:504] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.613956 6479 leader_election.cc:288] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:58.614168 6270 tablet_replica.cc:330] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:58.614394 6270 raft_consensus.cc:2229] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.614580 6270 raft_consensus.cc:2258] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.615451 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:58.615470 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:58.615713 5883 raft_consensus.cc:2454] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:43:58.616214 5955 leader_election.cc:341] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:58.616787 5957 leader_election.cc:302] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:58.617115 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 44bc6831f9354ddb81212bc107efdf68 (DEFAULT_TABLE table=default.Table_aff364c052aa4d948976b84e1d9e6575 [id=7e99e684b74f47279b22e18c1cf09935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.617203 6479 raft_consensus.cc:2781] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:58.617312 6479 raft_consensus.cc:482] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:58.617388 6479 raft_consensus.cc:3037] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:58.617596 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44bc6831f9354ddb81212bc107efdf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.618609 6275 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.620311 6275 tablet_bootstrap.cc:654] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.620353 6479 raft_consensus.cc:504] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.621748 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:58.621990 5884 raft_consensus.cc:3037] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:58.626319 6270 ts_tablet_manager.cc:1905] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.626899 6479 leader_election.cc:288] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:58.627646 5884 raft_consensus.cc:2454] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:58.627861 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c53e9be06f4d1aa0fc7eaef2c10303" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:58.628232 5957 leader_election.cc:302] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
W20260928 10:43:58.628909 5955 leader_election.cc:341] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:58.629407 6479 raft_consensus.cc:2781] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:58.629789 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet a765989e9ba3467f811f5fd49b67cb36 with delete_type TABLET_DATA_DELETED (replaced by tablet 971f8344436f4e60ac0152e811efea8d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.630120 6479 raft_consensus.cc:686] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:58.630491 6479 consensus_queue.cc:237] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.630723 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:43:58.630937 6271 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.631085 6271 ts_tablet_manager.cc:1397] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20260928 10:43:58.631719 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.631855 6271 raft_consensus.cc:348] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.632094 6271 raft_consensus.cc:374] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.632177 6271 raft_consensus.cc:729] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.632385 6271 consensus_queue.cc:260] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.634155 6271 ts_tablet_manager.cc:1428] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:58.634642 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_139347c4fd714c3a926c9a6044cb6c77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.635497 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_139347c4fd714c3a926c9a6044cb6c77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.635960 6272 ts_tablet_manager.cc:1918] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.636175 6271 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.636902 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.637306 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.638024 6271 tablet_bootstrap.cc:654] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.638597 6272 log.cc:1196] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/98566f85241c42cf92f3e131318d6efb
I20260928 10:43:58.639029 6272 ts_tablet_manager.cc:1939] T 98566f85241c42cf92f3e131318d6efb P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.638965 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a303983e2e7f444886ff5e22fc9b1abf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.639642 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a303983e2e7f444886ff5e22fc9b1abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.640053 6272 tablet_replica.cc:330] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.640321 6272 raft_consensus.cc:2229] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.640503 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 98566f85241c42cf92f3e131318d6efb (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
I20260928 10:43:58.642264 6272 raft_consensus.cc:2258] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.642292 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_aff364c052aa4d948976b84e1d9e6575" } new_table_name: "default.Table_ccc54fc0e3d24f22a89149b227256f81" modify_external_catalogs: true
I20260928 10:43:58.641999 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 67f29acce3604e458d1981aad87f2eb9 (DEFAULT_TABLE table=default.Table_620f3530f71449eaa20ab3d20919a8e2 [id=ae18f339d30546ddad1a25f939345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.643079 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f29acce3604e458d1981aad87f2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.644683 6272 ts_tablet_manager.cc:1905] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.647608 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 593015cc3f8547b5a08043d2c016ec91 (DEFAULT_TABLE table=default.Table_8c0911722bcd44c482d7070d941798f0 [id=78c21cb16c8e4745b67eb1700a404525]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.648126 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593015cc3f8547b5a08043d2c016ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.651264 6272 ts_tablet_manager.cc:1918] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.652426 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 593015cc3f8547b5a08043d2c016ec91 (DEFAULT_TABLE table=default.Table_8c0911722bcd44c482d7070d941798f0 [id=78c21cb16c8e4745b67eb1700a404525]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.652901 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593015cc3f8547b5a08043d2c016ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.654953 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd09430a2c34965a590f2e0852c686b (DEFAULT_TABLE table=default.Table_973b0af0dc714a2e963e9915961984a1 [id=a7daec6534ba449085e65f718a2330f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.655467 6271 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.655481 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd09430a2c34965a590f2e0852c686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.655520 6273 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.655632 6271 ts_tablet_manager.cc:1397] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260928 10:43:58.655651 6273 ts_tablet_manager.cc:1397] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.002s
I20260928 10:43:58.656411 6271 raft_consensus.cc:348] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.656433 6273 raft_consensus.cc:348] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.656649 6273 raft_consensus.cc:374] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.656658 6271 raft_consensus.cc:374] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.656721 6271 raft_consensus.cc:729] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.656736 6273 raft_consensus.cc:729] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.657037 6271 consensus_queue.cc:260] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.657289 6273 consensus_queue.cc:260] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.657543 6271 ts_tablet_manager.cc:1428] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:43:58.658732 6271 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.658864 5851 tablet_service.cc:1467] Processing CreateTablet for tablet b6d5121db2d34ea99c851595c395f3be (DEFAULT_TABLE table=default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.659273 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6d5121db2d34ea99c851595c395f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.661059 6271 tablet_bootstrap.cc:654] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.651751 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 593015cc3f8547b5a08043d2c016ec91 (DEFAULT_TABLE table=default.Table_8c0911722bcd44c482d7070d941798f0 [id=78c21cb16c8e4745b67eb1700a404525]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.662284 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593015cc3f8547b5a08043d2c016ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.662856 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 16510244612242f796910cf28e367da9 (DEFAULT_TABLE table=default.Table_771449d5cc0d4eb2b2ed9241efa22ed6 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.663275 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16510244612242f796910cf28e367da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.664996 6273 ts_tablet_manager.cc:1428] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:43:58.666886 5849 tablet_service.cc:1467] Processing CreateTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc (DEFAULT_TABLE table=default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.667305 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a8f5241dd14684b5544e47d6cec9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.669688 6272 log.cc:1196] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/7f61f6e2bb8a4166ae93f74ae13ac2a0
I20260928 10:43:58.670015 6272 ts_tablet_manager.cc:1939] T 7f61f6e2bb8a4166ae93f74ae13ac2a0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.670667 5855 tablet_service.cc:1467] Processing CreateTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 (DEFAULT_TABLE table=default.Table_f93f92720b8f413a8b2a56dc99a59838 [id=2d4736814acb47298c4f96e849f840f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.670925 6272 tablet_replica.cc:330] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.671072 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d64c1af58d6a4dfcabd6eecb8c75d572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.671105 6272 raft_consensus.cc:2229] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.671273 6272 raft_consensus.cc:2258] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.671725 6273 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.671994 6272 ts_tablet_manager.cc:1905] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.673390 6273 tablet_bootstrap.cc:654] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.674856 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0ca8630f134d5fba6e87bd901df70b (DEFAULT_TABLE table=default.Table_9fb5ee6a62d1438e87785c58e1201a58 [id=27f3d1254fb54059b670e34330963ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.675249 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0ca8630f134d5fba6e87bd901df70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.675876 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 28efefe228f24b01914e0d43be5061ce (DEFAULT_TABLE table=default.Table_76d30388f69f4b4295f41fe5c15c6d79 [id=56b10bf597f14dc39909f013f05edf7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.676236 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28efefe228f24b01914e0d43be5061ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.676708 6271 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:58.676851 6271 ts_tablet_manager.cc:1397] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.001s
I20260928 10:43:58.677553 6271 raft_consensus.cc:348] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.677793 6271 raft_consensus.cc:374] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.677868 6271 raft_consensus.cc:729] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.678112 6271 consensus_queue.cc:260] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.680203 6271 ts_tablet_manager.cc:1428] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:43:58.681172 6271 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:58.683700 6271 tablet_bootstrap.cc:654] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.684513 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd09430a2c34965a590f2e0852c686b (DEFAULT_TABLE table=default.Table_973b0af0dc714a2e963e9915961984a1 [id=a7daec6534ba449085e65f718a2330f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.684736 6001 tablet_service.cc:1467] Processing CreateTablet for tablet b6d5121db2d34ea99c851595c395f3be (DEFAULT_TABLE table=default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.684943 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd09430a2c34965a590f2e0852c686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.685145 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6d5121db2d34ea99c851595c395f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.685441 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 16510244612242f796910cf28e367da9 (DEFAULT_TABLE table=default.Table_771449d5cc0d4eb2b2ed9241efa22ed6 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.685796 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16510244612242f796910cf28e367da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.686168 6270 ts_tablet_manager.cc:1918] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.686774 5989 tablet_service.cc:1467] Processing CreateTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc (DEFAULT_TABLE table=default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.688072 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 7f61f6e2bb8a4166ae93f74ae13ac2a0 (table default.Table_391fe28cf8c44817971a0e1ce4b4bed3 [id=3d5e26eddc43440284bf95ddd8dbbe69]) successfully deleted
I20260928 10:43:58.688511 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 45a00a2c4692459cbdd0628af0184f09 (DEFAULT_TABLE table=default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.688894 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a00a2c4692459cbdd0628af0184f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.689316 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0ca8630f134d5fba6e87bd901df70b (DEFAULT_TABLE table=default.Table_9fb5ee6a62d1438e87785c58e1201a58 [id=27f3d1254fb54059b670e34330963ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.689963 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 28efefe228f24b01914e0d43be5061ce (DEFAULT_TABLE table=default.Table_76d30388f69f4b4295f41fe5c15c6d79 [id=56b10bf597f14dc39909f013f05edf7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.690224 5994 tablet_service.cc:1467] Processing CreateTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 (DEFAULT_TABLE table=default.Table_f93f92720b8f413a8b2a56dc99a59838 [id=2d4736814acb47298c4f96e849f840f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.690572 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a8f5241dd14684b5544e47d6cec9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.691208 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0ca8630f134d5fba6e87bd901df70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.691350 6130 tablet_service.cc:1467] Processing CreateTablet for tablet b6d5121db2d34ea99c851595c395f3be (DEFAULT_TABLE table=default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.691803 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6d5121db2d34ea99c851595c395f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.691967 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd09430a2c34965a590f2e0852c686b (DEFAULT_TABLE table=default.Table_973b0af0dc714a2e963e9915961984a1 [id=a7daec6534ba449085e65f718a2330f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.692339 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd09430a2c34965a590f2e0852c686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.692802 6272 ts_tablet_manager.cc:1918] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.692970 6272 log.cc:1196] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/64a424286b6e4d32a2ceb67ed6cdc02d
I20260928 10:43:58.693445 6272 ts_tablet_manager.cc:1939] T 64a424286b6e4d32a2ceb67ed6cdc02d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.694799 6119 tablet_service.cc:1467] Processing CreateTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 (DEFAULT_TABLE table=default.Table_f93f92720b8f413a8b2a56dc99a59838 [id=2d4736814acb47298c4f96e849f840f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.695048 6270 log.cc:1196] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a765989e9ba3467f811f5fd49b67cb36
I20260928 10:43:58.695102 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d64c1af58d6a4dfcabd6eecb8c75d572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.695061 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc (DEFAULT_TABLE table=default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.695152 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d64c1af58d6a4dfcabd6eecb8c75d572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.695390 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a8f5241dd14684b5544e47d6cec9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.694808 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 16510244612242f796910cf28e367da9 (DEFAULT_TABLE table=default.Table_771449d5cc0d4eb2b2ed9241efa22ed6 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.696596 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16510244612242f796910cf28e367da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.697261 6272 tablet_replica.cc:330] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.697576 6272 raft_consensus.cc:2229] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.697772 6272 raft_consensus.cc:2258] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.698685 6272 ts_tablet_manager.cc:1905] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.698804 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0ca8630f134d5fba6e87bd901df70b (DEFAULT_TABLE table=default.Table_9fb5ee6a62d1438e87785c58e1201a58 [id=27f3d1254fb54059b670e34330963ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.699213 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0ca8630f134d5fba6e87bd901df70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.700018 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28efefe228f24b01914e0d43be5061ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.700588 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 28efefe228f24b01914e0d43be5061ce (DEFAULT_TABLE table=default.Table_76d30388f69f4b4295f41fe5c15c6d79 [id=56b10bf597f14dc39909f013f05edf7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.701112 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28efefe228f24b01914e0d43be5061ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.703234 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 45a00a2c4692459cbdd0628af0184f09 (DEFAULT_TABLE table=default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.703685 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a00a2c4692459cbdd0628af0184f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.705699 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 64a424286b6e4d32a2ceb67ed6cdc02d (table default.Table_8a46a3766a754fdeb1a211cff00ce691 [id=c496586ada0945278e06a9e71af25fd5]) successfully deleted
W20260928 10:43:58.706004 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a380da90a76545dba647e0c1b3e05acd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a380da90a76545dba647e0c1b3e05acd already in progress: creating tablet
I20260928 10:43:58.706772 6126 tablet_service.cc:1467] Processing CreateTablet for tablet f7d762e03b384d85b4e04be8331474a4 (DEFAULT_TABLE table=default.Table_257888168c6742c6b8e8cee352d1f468 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.707193 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d762e03b384d85b4e04be8331474a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.711253 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 (DEFAULT_TABLE table=default.Table_fc69aee75b914164961654baaea21d7e [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.711725 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eded874aa094054b0c2e7c2e592dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.711884 5861 tablet_service.cc:1467] Processing CreateTablet for tablet f7d762e03b384d85b4e04be8331474a4 (DEFAULT_TABLE table=default.Table_257888168c6742c6b8e8cee352d1f468 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.712291 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d762e03b384d85b4e04be8331474a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.715380 6270 ts_tablet_manager.cc:1939] T a765989e9ba3467f811f5fd49b67cb36 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:58.716382 6273 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.716867 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 (DEFAULT_TABLE table=default.Table_fc69aee75b914164961654baaea21d7e [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.717542 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eded874aa094054b0c2e7c2e592dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.719241 6273 ts_tablet_manager.cc:1397] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260928 10:43:58.719853 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 (DEFAULT_TABLE table=default.Table_d8fd16c3c602488693b9c88e13f98589 [id=b97213ac749448e9a97fde5cf9246b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.720297 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9956318fe8ef4d1cbc92eda9caa98602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.720644 6273 raft_consensus.cc:348] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.721405 6273 raft_consensus.cc:374] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.721509 6273 raft_consensus.cc:729] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.722085 6273 consensus_queue.cc:260] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:58.725134 6273 ts_tablet_manager.cc:1428] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:43:58.718743 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 (DEFAULT_TABLE table=default.Table_d8fd16c3c602488693b9c88e13f98589 [id=b97213ac749448e9a97fde5cf9246b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.751129 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9956318fe8ef4d1cbc92eda9caa98602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.752770 5702 catalog_manager.cc:5495] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:58.754624 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_89c05124506147cb91475760df1ce319 [id=6677562fe2604addb84af531539cbebd]). Expected version 1 got 0
I20260928 10:43:58.755363 6272 ts_tablet_manager.cc:1918] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.755674 6272 log.cc:1196] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a765989e9ba3467f811f5fd49b67cb36
I20260928 10:43:58.756151 6272 ts_tablet_manager.cc:1939] T a765989e9ba3467f811f5fd49b67cb36 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.756278 6269 ts_tablet_manager.cc:1918] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.756433 6269 log.cc:1196] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/6c7a51b960f24a2fbc3f0e851c98b9f9
I20260928 10:43:58.756863 6269 ts_tablet_manager.cc:1939] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.758389 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (table default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]) successfully deleted
W20260928 10:43:58.758766 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a380da90a76545dba647e0c1b3e05acd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a380da90a76545dba647e0c1b3e05acd already in progress: creating tablet
W20260928 10:43:58.758994 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95e1f8a63fed4c82ac95c2fbb7bc633d already in progress: creating tablet
I20260928 10:43:58.760257 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a765989e9ba3467f811f5fd49b67cb36 (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
W20260928 10:43:58.760555 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95e1f8a63fed4c82ac95c2fbb7bc633d already in progress: creating tablet
I20260928 10:43:58.764219 6273 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.765918 6273 tablet_bootstrap.cc:654] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:58.768916 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44bc6831f9354ddb81212bc107efdf68 consensus state has no leader
I20260928 10:43:58.769922 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet db824b43256640e9bfef44da1ccf8e1a
I20260928 10:43:58.770296 5701 catalog_manager.cc:6565] ReplaceTablet: tablet db824b43256640e9bfef44da1ccf8e1a deleted and replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8
I20260928 10:43:58.770623 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fe170946878a4e9abe047ae72c9e95bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.770952 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_84731f32539b428ab9107d83eabb7553" } new_table_name: "default.Table_d8361cd920f64394b922d3f17c2ae915" modify_external_catalogs: true
W20260928 10:43:58.771205 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe170946878a4e9abe047ae72c9e95bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.772347 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ab1277e4c47141ea9480987eef715528
I20260928 10:43:58.772852 5699 catalog_manager.cc:6565] ReplaceTablet: tablet ab1277e4c47141ea9480987eef715528 deleted and replaced by tablet 3abfedf425b84f679b22d6ca9bef718a
I20260928 10:43:58.773197 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ebcbdae68e524eca87a2587129902f3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.773566 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:58.773900 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebcbdae68e524eca87a2587129902f3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.774536 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.775136 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.775415 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.775506 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.775817 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet db824b43256640e9bfef44da1ccf8e1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db824b43256640e9bfef44da1ccf8e1a already in progress: creating tablet
W20260928 10:43:58.776118 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ab1277e4c47141ea9480987eef715528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab1277e4c47141ea9480987eef715528 already in progress: creating tablet
W20260928 10:43:58.776384 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ab1277e4c47141ea9480987eef715528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab1277e4c47141ea9480987eef715528 already in progress: creating tablet
I20260928 10:43:58.776499 6269 tablet_replica.cc:330] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.776693 6269 raft_consensus.cc:2229] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.776855 6269 raft_consensus.cc:2258] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.777460 6269 ts_tablet_manager.cc:1905] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.778069 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1c13a45c9a2248a9a00aea0ca2a8af55" } modify_external_catalogs: true
I20260928 10:43:58.778390 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1c13a45c9a2248a9a00aea0ca2a8af55" } modify_external_catalogs: true
I20260928 10:43:58.783823 6269 ts_tablet_manager.cc:1918] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.783999 6269 log.cc:1196] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8854c8a8e4024c6db4cb6b21d6ae021f
I20260928 10:43:58.784363 6269 ts_tablet_manager.cc:1939] T 8854c8a8e4024c6db4cb6b21d6ae021f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.784605 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b8eb2356801c4e01a3abf4084cf4380f" } new_table_name: "default.Table_96c0113a38234d5fa727f275b4dde281" modify_external_catalogs: true
I20260928 10:43:58.785717 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8854c8a8e4024c6db4cb6b21d6ae021f (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
W20260928 10:43:58.786600 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet db824b43256640e9bfef44da1ccf8e1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db824b43256640e9bfef44da1ccf8e1a already in progress: creating tablet
I20260928 10:43:58.790501 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 16f7d561b10e46609f22ce17b323fb23
I20260928 10:43:58.791079 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 16f7d561b10e46609f22ce17b323fb23 deleted and replaced by tablet 463cf5ecb52d40069b564698433c6781
I20260928 10:43:58.791359 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.791558 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.791823 6269 tablet_replica.cc:330] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.791783 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f75884ab2dba4b54bc1311e2c5be5412"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:58.792034 6269 raft_consensus.cc:2229] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.792227 6269 raft_consensus.cc:2258] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.793179 6269 ts_tablet_manager.cc:1905] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:43:58.793769 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 16f7d561b10e46609f22ce17b323fb23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16f7d561b10e46609f22ce17b323fb23 already in progress: creating tablet
I20260928 10:43:58.793889 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_69c7c49b76ee4bcea446b84a5b64dd69" } new_table_name: "default.Table_0fd9d5a5cd454643973fba6cab7daa7f" modify_external_catalogs: true
I20260928 10:43:58.642088 6275 tablet_bootstrap.cc:492] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.795565 6275 ts_tablet_manager.cc:1397] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.002s
I20260928 10:43:58.796576 6275 raft_consensus.cc:348] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.797400 6275 raft_consensus.cc:374] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.797560 6275 raft_consensus.cc:729] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.797950 6275 consensus_queue.cc:260] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.806964 6269 ts_tablet_manager.cc:1918] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:58.807150 6269 log.cc:1196] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/16f7d561b10e46609f22ce17b323fb23
I20260928 10:43:58.807566 6269 ts_tablet_manager.cc:1939] T 16f7d561b10e46609f22ce17b323fb23 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.808771 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 16f7d561b10e46609f22ce17b323fb23 (table default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
I20260928 10:43:58.828353 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 0563f8c31f7d43b3b703593dbc562ad6 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:58.828753 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f75884ab2dba4b54bc1311e2c5be5412 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.830618 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 67f29acce3604e458d1981aad87f2eb9 (DEFAULT_TABLE table=default.Table_620f3530f71449eaa20ab3d20919a8e2 [id=ae18f339d30546ddad1a25f939345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.832839 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 67f29acce3604e458d1981aad87f2eb9 (DEFAULT_TABLE table=default.Table_620f3530f71449eaa20ab3d20919a8e2 [id=ae18f339d30546ddad1a25f939345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.833513 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f29acce3604e458d1981aad87f2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.844223 6275 ts_tablet_manager.cc:1428] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260928 10:43:58.847337 6275 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:58.849383 6275 tablet_bootstrap.cc:654] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.849570 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e690f55d690b46358de9c97d59e9644b" } modify_external_catalogs: true
I20260928 10:43:58.849776 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e690f55d690b46358de9c97d59e9644b" } modify_external_catalogs: true
W20260928 10:43:58.850528 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87d5dd4e5b544262938b1822510d8b9f consensus state has no leader
I20260928 10:43:58.850924 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_91702b0277c943068af0c1f3ac3b6604" } modify_external_catalogs: true
I20260928 10:43:58.851198 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_91702b0277c943068af0c1f3ac3b6604" } modify_external_catalogs: true
I20260928 10:43:58.852785 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cbf12a51196c4a90bd8dde13cdc7dd52" } new_table_name: "default.Table_0134f07e54b24b6f9252f5613e61bb7a" modify_external_catalogs: true
I20260928 10:43:58.854777 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a392670fdb5a4d4097c7edaf8f6642ce
I20260928 10:43:58.856024 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.856041 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.856314 6269 tablet_replica.cc:330] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:58.856473 6272 tablet_replica.cc:330] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:58.856556 6269 raft_consensus.cc:2229] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.856658 6272 raft_consensus.cc:2229] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:58.856593 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_84284909ddb043bfa220be15cff2a4ec" } modify_external_catalogs: true
I20260928 10:43:58.856771 6269 raft_consensus.cc:2258] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:58.856786 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_84284909ddb043bfa220be15cff2a4ec" } modify_external_catalogs: true
I20260928 10:43:58.856897 6272 raft_consensus.cc:2258] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:58.857131 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39cbecd1c19541f28bd32b7c46f2df61 consensus state has no leader
I20260928 10:43:58.857445 6269 ts_tablet_manager.cc:1905] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.857486 6272 ts_tablet_manager.cc:1905] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:58.857555 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 440a50034c6b4110b74b1531a6b7790d from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:58.861464 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 45a00a2c4692459cbdd0628af0184f09 (DEFAULT_TABLE table=default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.864423 6269 ts_tablet_manager.cc:1918] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:43:58.864583 6269 log.cc:1196] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a392670fdb5a4d4097c7edaf8f6642ce
I20260928 10:43:58.865003 6269 ts_tablet_manager.cc:1939] T a392670fdb5a4d4097c7edaf8f6642ce P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:58.865115 6272 ts_tablet_manager.cc:1918] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:43:58.865260 6272 log.cc:1196] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a392670fdb5a4d4097c7edaf8f6642ce
I20260928 10:43:58.865732 6272 ts_tablet_manager.cc:1939] T a392670fdb5a4d4097c7edaf8f6642ce P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:58.866214 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]) successfully deleted
I20260928 10:43:58.866880 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]) successfully deleted
I20260928 10:43:58.867336 5997 tablet_service.cc:1467] Processing CreateTablet for tablet f7d762e03b384d85b4e04be8331474a4 (DEFAULT_TABLE table=default.Table_257888168c6742c6b8e8cee352d1f468 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:58.870031 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 consensus state has no leader
I20260928 10:43:58.870976 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cbfc5179d22f49d0852cb571f19adbfb" } modify_external_catalogs: true
I20260928 10:43:58.871264 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cbfc5179d22f49d0852cb571f19adbfb" } modify_external_catalogs: true
I20260928 10:43:58.871455 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:43:58.872056 6273 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:58.872222 6273 ts_tablet_manager.cc:1397] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.144s user 0.033s sys 0.040s
I20260928 10:43:58.873003 6273 raft_consensus.cc:348] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.873231 6273 raft_consensus.cc:374] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:58.873339 6273 raft_consensus.cc:729] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:58.873571 6273 consensus_queue.cc:260] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.874145 6273 ts_tablet_manager.cc:1428] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:43:58.875476 6273 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:58.873970 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfb47ad184148d595830276bad311dc (DEFAULT_TABLE table=default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.877094 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_67ff90909aa94822929782b78faf711f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.877800 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67ff90909aa94822929782b78faf711f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.879084 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 60f0191c7dd347058749790b4e4159c2 (DEFAULT_TABLE table=default.Table_01958d46e9064e34966558e06b2d3cb7 [id=b708ecbb24f14ccca7c3a7f05b458809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.880156 5857 tablet_service.cc:1467] Processing CreateTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 (DEFAULT_TABLE table=default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.880537 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfb47ad184148d595830276bad311dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.880497 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.880481 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.881080 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 502d275d161945ce86626594ab0d89b3 (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.881284 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f0191c7dd347058749790b4e4159c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.881516 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a0c6ca08884dc6813b25e3991d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.882642 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502d275d161945ce86626594ab0d89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.882696 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.882862 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfb47ad184148d595830276bad311dc (DEFAULT_TABLE table=default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.883270 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfb47ad184148d595830276bad311dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.883261 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 502d275d161945ce86626594ab0d89b3 (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.883575 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502d275d161945ce86626594ab0d89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.885388 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a0c6ca08884dc6813b25e3991d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.886652 6132 tablet_service.cc:1467] Processing CreateTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 (DEFAULT_TABLE table=default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.887089 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61d97ed6b7b4dcba34a7a2190316b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.887490 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61d97ed6b7b4dcba34a7a2190316b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.887602 6125 tablet_service.cc:1467] Processing CreateTablet for tablet fe50a4f375244d0bbc507cc638bb2f35 (DEFAULT_TABLE table=default.Table_bfc5c67f10b449c1a9c2ab1380fa042a [id=0ade819d12284b7ebe0376654fda47c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.887956 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe50a4f375244d0bbc507cc638bb2f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.888247 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 60f0191c7dd347058749790b4e4159c2 (DEFAULT_TABLE table=default.Table_01958d46e9064e34966558e06b2d3cb7 [id=b708ecbb24f14ccca7c3a7f05b458809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.877930 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:43:58.891603 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f0191c7dd347058749790b4e4159c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:58.892199 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 16f7d561b10e46609f22ce17b323fb23 because the tablet was not found. No further retry: Not found: Tablet not found: 16f7d561b10e46609f22ce17b323fb23
W20260928 10:43:58.893113 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 362ef9f9aa8641cca11c0a154882e1d4 consensus state has no leader
I20260928 10:43:58.897078 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:43:58.898901 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 440a50034c6b4110b74b1531a6b7790d
I20260928 10:43:58.899247 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 440a50034c6b4110b74b1531a6b7790d deleted and replaced by tablet a229207ce7cc475c8f4492e62d122721
I20260928 10:43:58.900857 6130 tablet_service.cc:1467] Processing CreateTablet for tablet d22260b5f20d47ad99d612ed5a7c022c (DEFAULT_TABLE table=default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.901997 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d22260b5f20d47ad99d612ed5a7c022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.905021 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0a3d035581da47abb64156066e53fa67 (table default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99 [id=8c4d995731f94c088f6e4625446cee13]). Expected version 1 got 0
I20260928 10:43:58.889587 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 (DEFAULT_TABLE table=default.Table_fc69aee75b914164961654baaea21d7e [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.909394 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.909875 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.910576 5858 tablet_service.cc:1467] Processing CreateTablet for tablet fe50a4f375244d0bbc507cc638bb2f35 (DEFAULT_TABLE table=default.Table_bfc5c67f10b449c1a9c2ab1380fa042a [id=0ade819d12284b7ebe0376654fda47c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.910750 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4bfb47ad184148d595830276bad311dc
I20260928 10:43:58.911154 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe50a4f375244d0bbc507cc638bb2f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.913868 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bd225da0b4b445c6ac03634d975e8396
I20260928 10:43:58.918362 5852 tablet_service.cc:1467] Processing CreateTablet for tablet d22260b5f20d47ad99d612ed5a7c022c (DEFAULT_TABLE table=default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.918648 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 (DEFAULT_TABLE table=default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.918877 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d22260b5f20d47ad99d612ed5a7c022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.920028 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb9c554d363441b8006abc2d9bdd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.920462 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0dfb805fb3de478abcdab81632a2da31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.921078 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dfb805fb3de478abcdab81632a2da31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.922694 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet dfd9b4092b1242b8a60974c445a2789a
I20260928 10:43:58.924679 5853 tablet_service.cc:1467] Processing CreateTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 (DEFAULT_TABLE table=default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.925104 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c1a1c5e22e455d91de92f0aa3535c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.926038 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.926317 6275 tablet_bootstrap.cc:492] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:58.936640 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 (DEFAULT_TABLE table=default.Table_9afdecc58f0a43359450f328ef0633f5 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.937191 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.938344 6479 raft_consensus.cc:482] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:58.938318 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 76a47129ab5444dcab0a3f92a16046db (DEFAULT_TABLE table=default.Table_be18240efd154023873afce4c90875f7 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.938759 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a47129ab5444dcab0a3f92a16046db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.938939 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 (DEFAULT_TABLE table=default.Table_d8fd16c3c602488693b9c88e13f98589 [id=b97213ac749448e9a97fde5cf9246b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.940263 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 (DEFAULT_TABLE table=default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.940708 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb9c554d363441b8006abc2d9bdd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.944878 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0563f8c31f7d43b3b703593dbc562ad6
I20260928 10:43:58.946115 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 0563f8c31f7d43b3b703593dbc562ad6 deleted and replaced by tablet 5ced63ab7188472e80d4ff52350be3e0
I20260928 10:43:58.942869 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.948505 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.948843 6275 ts_tablet_manager.cc:1397] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.002s
I20260928 10:43:58.949435 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.949455 6133 tablet_service.cc:1467] Processing CreateTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 (DEFAULT_TABLE table=default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:58.949882 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f1a8f5241dd14684b5544e47d6cec9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a8f5241dd14684b5544e47d6cec9cc already in progress: creating tablet
W20260928 10:43:58.950340 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 440a50034c6b4110b74b1531a6b7790d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 440a50034c6b4110b74b1531a6b7790d already in progress: creating tablet
W20260928 10:43:58.951710 5688 catalog_manager.cc:4808] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4bfb47ad184148d595830276bad311dc because the tablet was not found. No further retry: Not found: Tablet not found: 4bfb47ad184148d595830276bad311dc
I20260928 10:43:58.952399 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6db38f77f64cfe9a7802d5307aa949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.953316 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.954845 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.957086 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:58.959960 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet dfd9b4092b1242b8a60974c445a2789a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfd9b4092b1242b8a60974c445a2789a already in progress: creating tablet
W20260928 10:43:58.960285 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0563f8c31f7d43b3b703593dbc562ad6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0563f8c31f7d43b3b703593dbc562ad6 already in progress: creating tablet
I20260928 10:43:58.960654 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f29acce3604e458d1981aad87f2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.961138 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:58.962134 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (DEFAULT_TABLE table=default.Table_a390c5e5221f4bbba5c21311860ca5f1 [id=b1363dbf11ec4d228eac4323ea1ad5d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:58.962585 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet bd225da0b4b445c6ac03634d975e8396 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd225da0b4b445c6ac03634d975e8396 already in progress: creating tablet
I20260928 10:43:58.956844 5983 tablet_service.cc:1467] Processing CreateTablet for tablet fe50a4f375244d0bbc507cc638bb2f35 (DEFAULT_TABLE table=default.Table_bfc5c67f10b449c1a9c2ab1380fa042a [id=0ade819d12284b7ebe0376654fda47c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.965073 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.966617 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 60f0191c7dd347058749790b4e4159c2 (DEFAULT_TABLE table=default.Table_01958d46e9064e34966558e06b2d3cb7 [id=b708ecbb24f14ccca7c3a7f05b458809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.967379 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:58.967392 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.967861 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.965195 6479 raft_consensus.cc:504] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:58.969951 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.971304 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:58.972177 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet a392670fdb5a4d4097c7edaf8f6642ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.972368 5883 raft_consensus.cc:2454] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:43:58.968278 5984 tablet_service.cc:1467] Processing CreateTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 (DEFAULT_TABLE table=default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.972862 5957 leader_election.cc:302] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:58.972445 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 502d275d161945ce86626594ab0d89b3 (DEFAULT_TABLE table=default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd [id=16bcd943724f4799be80c69f3e54bd37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.973755 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfb47ad184148d595830276bad311dc (DEFAULT_TABLE table=default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.974830 6476 raft_consensus.cc:2781] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:58.974957 6476 raft_consensus.cc:482] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:58.976544 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_620f3530f71449eaa20ab3d20919a8e2" } new_table_name: "default.Table_a766cb0490244b6794f67a154e92eb96" modify_external_catalogs: true
I20260928 10:43:58.976930 6476 raft_consensus.cc:3037] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:58.977901 6479 leader_election.cc:288] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:58.978156 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 76a47129ab5444dcab0a3f92a16046db (DEFAULT_TABLE table=default.Table_be18240efd154023873afce4c90875f7 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.978246 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_320ffa6517e14f969247ecdd0b4a7ca8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.978839 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_320ffa6517e14f969247ecdd0b4a7ca8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.980213 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_026184575e69478c879d0441560fcf70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.980703 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_026184575e69478c879d0441560fcf70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:58.984238 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f1a8f5241dd14684b5544e47d6cec9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a8f5241dd14684b5544e47d6cec9cc already in progress: creating tablet
W20260928 10:43:58.984524 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 440a50034c6b4110b74b1531a6b7790d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 440a50034c6b4110b74b1531a6b7790d already in progress: creating tablet
W20260928 10:43:58.984715 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67f29acce3604e458d1981aad87f2eb9 consensus state has no leader
I20260928 10:43:58.978217 5987 tablet_service.cc:1467] Processing CreateTablet for tablet d22260b5f20d47ad99d612ed5a7c022c (DEFAULT_TABLE table=default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.986774 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 (DEFAULT_TABLE table=default.Table_9afdecc58f0a43359450f328ef0633f5 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.987128 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fec7d4d51f114043944b5de668a91d15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.987624 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fec7d4d51f114043944b5de668a91d15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.988330 5994 tablet_service.cc:1467] Processing CreateTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 (DEFAULT_TABLE table=default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.988655 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.982664 6273 tablet_bootstrap.cc:654] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:58.989275 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 76a47129ab5444dcab0a3f92a16046db (DEFAULT_TABLE table=default.Table_be18240efd154023873afce4c90875f7 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.994094 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:58.994189 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_61d563e1c8cb41f08ec6e49b87e45b1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:58.994709 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61d563e1c8cb41f08ec6e49b87e45b1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:58.995765 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 (DEFAULT_TABLE table=default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:58.995838 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.997625 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:58.985580 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:58.998581 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c1a1c5e22e455d91de92f0aa3535c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:59.000447 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4bfb47ad184148d595830276bad311dc because the tablet was not found. No further retry: Not found: Tablet not found: 4bfb47ad184148d595830276bad311dc
W20260928 10:43:59.000738 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet dfd9b4092b1242b8a60974c445a2789a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfd9b4092b1242b8a60974c445a2789a already in progress: creating tablet
I20260928 10:43:58.979950 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 (DEFAULT_TABLE table=default.Table_9afdecc58f0a43359450f328ef0633f5 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.002370 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.003974 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (DEFAULT_TABLE table=default.Table_a390c5e5221f4bbba5c21311860ca5f1 [id=b1363dbf11ec4d228eac4323ea1ad5d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.006642 6479 raft_consensus.cc:482] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.006829 6479 raft_consensus.cc:504] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.007692 6273 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.008086 6273 ts_tablet_manager.cc:1397] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.134s user 0.002s sys 0.006s
I20260928 10:43:59.009703 6273 raft_consensus.cc:348] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.010198 6273 raft_consensus.cc:374] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.010344 6273 raft_consensus.cc:729] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.011188 6479 leader_election.cc:288] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.010887 6273 consensus_queue.cc:260] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:59.011494 5955 leader_election.cc:341] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.012243 6273 ts_tablet_manager.cc:1428] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:43:59.012866 6273 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.016144 6270 tablet_replica.cc:330] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.016409 6270 raft_consensus.cc:2229] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.016597 6273 tablet_bootstrap.cc:654] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.016629 6270 raft_consensus.cc:2258] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.018702 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.019399 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:59.019486 5957 leader_election.cc:341] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 4ffa9fb5b11944b1b38e07bd43891773
I20260928 10:43:59.019788 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eded874aa094054b0c2e7c2e592dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.022626 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.022904 6269 tablet_replica.cc:330] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.023105 6269 raft_consensus.cc:2229] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.023296 6269 raft_consensus.cc:2258] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.023475 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (DEFAULT_TABLE table=default.Table_a390c5e5221f4bbba5c21311860ca5f1 [id=b1363dbf11ec4d228eac4323ea1ad5d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.024264 6269 ts_tablet_manager.cc:1905] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.019227 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ffa9fb5b11944b1b38e07bd43891773" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.027664 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b577808dfde24cf88b354b7f3e01eb74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.028313 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b577808dfde24cf88b354b7f3e01eb74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.030925 6271 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:59.031118 6270 ts_tablet_manager.cc:1905] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.032178 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a765989e9ba3467f811f5fd49b67cb36 (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
W20260928 10:43:59.032447 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a380da90a76545dba647e0c1b3e05acd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a380da90a76545dba647e0c1b3e05acd already in progress: creating tablet
W20260928 10:43:59.032709 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95e1f8a63fed4c82ac95c2fbb7bc633d already in progress: creating tablet
W20260928 10:43:59.033186 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ab1277e4c47141ea9480987eef715528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab1277e4c47141ea9480987eef715528 already in progress: creating tablet
W20260928 10:43:59.033417 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 16f7d561b10e46609f22ce17b323fb23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16f7d561b10e46609f22ce17b323fb23 already in progress: creating tablet
W20260928 10:43:59.033730 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet db824b43256640e9bfef44da1ccf8e1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db824b43256640e9bfef44da1ccf8e1a already in progress: creating tablet
I20260928 10:43:59.034538 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfb47ad184148d595830276bad311dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.034862 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c1a1c5e22e455d91de92f0aa3535c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.035331 6275 raft_consensus.cc:348] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.035662 6275 raft_consensus.cc:374] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.035763 6275 raft_consensus.cc:729] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.035986 6275 consensus_queue.cc:260] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.036580 6275 ts_tablet_manager.cc:1428] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.088s user 0.002s sys 0.000s
I20260928 10:43:59.036912 6275 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:59.037611 6476 raft_consensus.cc:504] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:59.038498 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0563f8c31f7d43b3b703593dbc562ad6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0563f8c31f7d43b3b703593dbc562ad6 already in progress: creating tablet
W20260928 10:43:59.038959 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bd225da0b4b445c6ac03634d975e8396 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd225da0b4b445c6ac03634d975e8396 already in progress: creating tablet
I20260928 10:43:59.039170 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:59.039438 5883 raft_consensus.cc:3037] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:59.040308 6273 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.040956 6273 ts_tablet_manager.cc:1397] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.005s
I20260928 10:43:59.042328 5883 raft_consensus.cc:2454] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:43:59.042660 6355 raft_consensus.cc:482] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.042831 6355 raft_consensus.cc:504] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.043133 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a47129ab5444dcab0a3f92a16046db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.043516 6273 raft_consensus.cc:348] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.044296 6273 raft_consensus.cc:374] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.044399 6273 raft_consensus.cc:729] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.044641 6273 consensus_queue.cc:260] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.045210 6273 ts_tablet_manager.cc:1428] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:43:59.045719 6269 ts_tablet_manager.cc:1918] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:43:59.045708 5955 leader_election.cc:341] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.045853 6269 log.cc:1196] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/68fe24b61d424274b407327f130bb020
I20260928 10:43:59.045898 5955 leader_election.cc:302] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:59.046341 6273 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.046649 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.046965 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.047286 6479 raft_consensus.cc:2726] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.047714 6269 ts_tablet_manager.cc:1939] T 68fe24b61d424274b407327f130bb020 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.050493 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 68fe24b61d424274b407327f130bb020 (table default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]) successfully deleted
I20260928 10:43:59.051697 6273 tablet_bootstrap.cc:654] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.053036 6271 ts_tablet_manager.cc:1397] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.351s user 0.004s sys 0.035s
I20260928 10:43:59.053081 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d762e03b384d85b4e04be8331474a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.053998 6271 raft_consensus.cc:348] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.054272 6271 raft_consensus.cc:374] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.054352 6271 raft_consensus.cc:729] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.054642 6271 consensus_queue.cc:260] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.055320 6271 ts_tablet_manager.cc:1428] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.055934 6271 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:59.058300 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a00a2c4692459cbdd0628af0184f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.058698 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a47129ab5444dcab0a3f92a16046db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.059970 5957 leader_election.cc:302] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:59.060644 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.062839 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cb9c554d363441b8006abc2d9bdd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.066313 6479 raft_consensus.cc:2781] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:43:59.066509 6479 raft_consensus.cc:686] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:43:59.066787 6479 consensus_queue.cc:237] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.068264 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6db38f77f64cfe9a7802d5307aa949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.069577 6273 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.070030 6273 ts_tablet_manager.cc:1397] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260928 10:43:59.072213 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502d275d161945ce86626594ab0d89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.072978 6476 leader_election.cc:288] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.071110 6273 raft_consensus.cc:348] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.075023 6273 raft_consensus.cc:374] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.075119 6273 raft_consensus.cc:729] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.075562 6273 consensus_queue.cc:260] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.076169 6273 ts_tablet_manager.cc:1428] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:43:59.076490 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d22260b5f20d47ad99d612ed5a7c022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.076584 6273 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.077485 6355 leader_election.cc:288] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:43:59.077662 6091 leader_election.cc:341] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: af258604238c4e39adac40c81d5a6f3f
W20260928 10:43:59.077931 6090 leader_election.cc:341] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: af258604238c4e39adac40c81d5a6f3f
I20260928 10:43:59.078236 6273 tablet_bootstrap.cc:654] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.078860 6090 leader_election.cc:302] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:59.080796 6273 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.080955 6273 ts_tablet_manager.cc:1397] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260928 10:43:59.081751 6273 raft_consensus.cc:348] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.082002 6273 raft_consensus.cc:374] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.082108 6273 raft_consensus.cc:729] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.082320 6273 consensus_queue.cc:260] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.082851 6273 ts_tablet_manager.cc:1428] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.083112 6273 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.083423 6355 raft_consensus.cc:2726] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.084139 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6db38f77f64cfe9a7802d5307aa949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.084448 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f0191c7dd347058749790b4e4159c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.085047 6273 tablet_bootstrap.cc:654] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.085309 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a0c6ca08884dc6813b25e3991d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.092975 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61d97ed6b7b4dcba34a7a2190316b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.093508 6273 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.093672 6273 ts_tablet_manager.cc:1397] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260928 10:43:59.094548 6273 raft_consensus.cc:348] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.094785 6273 raft_consensus.cc:374] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.094857 6273 raft_consensus.cc:729] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.095149 6273 consensus_queue.cc:260] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.095520 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:59.095780 6273 ts_tablet_manager.cc:1428] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.095958 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.096076 6273 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.097752 6273 tablet_bootstrap.cc:654] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.100983 6273 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.101132 6273 ts_tablet_manager.cc:1397] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260928 10:43:59.101840 6273 raft_consensus.cc:348] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.102195 6273 raft_consensus.cc:374] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.102298 6273 raft_consensus.cc:729] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.102561 6273 consensus_queue.cc:260] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.103168 6273 ts_tablet_manager.cc:1428] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.103459 6273 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.105662 6273 tablet_bootstrap.cc:654] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.114650 6273 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.114859 6273 ts_tablet_manager.cc:1397] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260928 10:43:59.115711 6273 raft_consensus.cc:348] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.115995 6273 raft_consensus.cc:374] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.116086 6273 raft_consensus.cc:729] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.116379 6273 consensus_queue.cc:260] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.117177 6273 ts_tablet_manager.cc:1428] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.117509 6273 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.119751 6273 tablet_bootstrap.cc:654] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.120544 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_00012b0f0bd34c4bae0dd33bd461bc07" } modify_external_catalogs: true
I20260928 10:43:59.121747 6273 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.122990 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_00012b0f0bd34c4bae0dd33bd461bc07" } modify_external_catalogs: true
I20260928 10:43:59.122589 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_174a55ee96184c3b83b11b790ad43d5b" } new_table_name: "default.Table_f0821d260af54eb2a7eb3cb19f94df64" modify_external_catalogs: true
I20260928 10:43:59.123878 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_34c0c54e906048a6981e6e89da155bc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.124408 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c0c54e906048a6981e6e89da155bc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.122161 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f93f92720b8f413a8b2a56dc99a59838" } new_table_name: "default.Table_8062a54a93234807a39d7ff0f8787f73" modify_external_catalogs: true
I20260928 10:43:59.125646 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0dfb805fb3de478abcdab81632a2da31" } new_table_name: "default.Table_8fbb02cd83954bd2ad721b776064fa23" modify_external_catalogs: true
I20260928 10:43:59.127094 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ad2135ad3d3e47d38c8f863737165aea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.127607 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad2135ad3d3e47d38c8f863737165aea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.130066 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bab2604ba651431d8828e6a78a445930"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.130580 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bab2604ba651431d8828e6a78a445930 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.122345 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.132573 6273 ts_tablet_manager.cc:1397] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260928 10:43:59.133262 6476 raft_consensus.cc:482] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.133504 6273 raft_consensus.cc:348] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.133744 6273 raft_consensus.cc:374] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.133862 6273 raft_consensus.cc:729] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.134096 6273 consensus_queue.cc:260] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.134668 6273 ts_tablet_manager.cc:1428] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.135993 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet af258604238c4e39adac40c81d5a6f3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.136361 6275 tablet_bootstrap.cc:654] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.136536 6269 tablet_replica.cc:330] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.136729 6269 raft_consensus.cc:2229] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.136888 6269 raft_consensus.cc:2258] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.137666 6269 ts_tablet_manager.cc:1905] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.140810 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_89c05124506147cb91475760df1ce319" } new_table_name: "default.Table_40542c2360704c5ca950edfd1e8274e2" modify_external_catalogs: true
I20260928 10:43:59.141868 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1393fcb0819d4e72bfa3196064b164e4" } modify_external_catalogs: true
I20260928 10:43:59.142068 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1393fcb0819d4e72bfa3196064b164e4" } modify_external_catalogs: true
I20260928 10:43:59.142273 6273 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.145282 6273 tablet_bootstrap.cc:654] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.151896 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb (DEFAULT_TABLE table=default.Table_f75884ab2dba4b54bc1311e2c5be5412 [id=2ff0d03c75a046f5b76951e171ee8e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.152402 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85583238d6b54f1d89ff5b53b40e73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.153657 6269 ts_tablet_manager.cc:1918] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.153858 6269 log.cc:1196] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/7dba507179ed44ce903111622ec1fb42
I20260928 10:43:59.161003 6272 tablet_replica.cc:330] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:59.163101 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 4082931c332f40fc9c6530190fb61017 (DEFAULT_TABLE table=default.Table_ebcbdae68e524eca87a2587129902f3d [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.164398 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 190cd281b1ad41aab2564744c282bcab (DEFAULT_TABLE table=default.Table_7b765681901c4d4180fd455a743f0a4c [id=717f077e672e43d9a1763748a97a4b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.164680 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 463cf5ecb52d40069b564698433c6781 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.165513 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d (DEFAULT_TABLE table=default.Table_0dfb805fb3de478abcdab81632a2da31 [id=aa0fbbc798a8402e98d41714bad869b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.165759 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 00b7e26971914613a2372476b348b702 (DEFAULT_TABLE table=default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.166152 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 5ced63ab7188472e80d4ff52350be3e0 (DEFAULT_TABLE table=default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.166373 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb (DEFAULT_TABLE table=default.Table_f75884ab2dba4b54bc1311e2c5be5412 [id=2ff0d03c75a046f5b76951e171ee8e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.166594 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c54e444afb3043c0adbaeafa7e6edb1c" } modify_external_catalogs: true
I20260928 10:43:59.166942 6272 raft_consensus.cc:2229] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.166847 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c54e444afb3043c0adbaeafa7e6edb1c" } modify_external_catalogs: true
I20260928 10:43:59.166953 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.171139 6118 tablet_service.cc:1467] Processing CreateTablet for tablet a229207ce7cc475c8f4492e62d122721 (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.168555 6123 tablet_service.cc:1467] Processing CreateTablet for tablet c322d11fab43499f82e077fd8a8c02f3 (DEFAULT_TABLE table=default.Table_139347c4fd714c3a926c9a6044cb6c77 [id=07eac26ccf134fb5b9bcc53ba57eb067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.173501 6272 raft_consensus.cc:2258] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.173561 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 4082931c332f40fc9c6530190fb61017 (DEFAULT_TABLE table=default.Table_ebcbdae68e524eca87a2587129902f3d [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.175915 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 00b7e26971914613a2372476b348b702 (DEFAULT_TABLE table=default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.177728 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4082931c332f40fc9c6530190fb61017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.180869 6272 ts_tablet_manager.cc:1905] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.176118 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 5ced63ab7188472e80d4ff52350be3e0 (DEFAULT_TABLE table=default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.186693 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d (DEFAULT_TABLE table=default.Table_0dfb805fb3de478abcdab81632a2da31 [id=aa0fbbc798a8402e98d41714bad869b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.187390 5860 tablet_service.cc:1467] Processing CreateTablet for tablet c322d11fab43499f82e077fd8a8c02f3 (DEFAULT_TABLE table=default.Table_139347c4fd714c3a926c9a6044cb6c77 [id=07eac26ccf134fb5b9bcc53ba57eb067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.187680 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.188256 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 190cd281b1ad41aab2564744c282bcab (DEFAULT_TABLE table=default.Table_7b765681901c4d4180fd455a743f0a4c [id=717f077e672e43d9a1763748a97a4b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.188551 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4082931c332f40fc9c6530190fb61017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.196883 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ced63ab7188472e80d4ff52350be3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.197263 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1072cf156cdf4c2a8c9d9764de110c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.197538 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b7e26971914613a2372476b348b702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.198451 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 463cf5ecb52d40069b564698433c6781 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.198462 6121 tablet_service.cc:1467] Processing CreateTablet for tablet bb5eed4318fe482789fee32e24a49bfc (DEFAULT_TABLE table=default.Table_67ff90909aa94822929782b78faf711f [id=42b8d28c18164d34bbad1117d30d8289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.171177 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 3abfedf425b84f679b22d6ca9bef718a (DEFAULT_TABLE table=default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.199747 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877e2d1c734a4e2891119f308f9f3ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.200223 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.202618 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 3abfedf425b84f679b22d6ca9bef718a (DEFAULT_TABLE table=default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.203363 6269 ts_tablet_manager.cc:1939] T 7dba507179ed44ce903111622ec1fb42 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.204741 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.205457 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 463cf5ecb52d40069b564698433c6781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.207472 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3abfedf425b84f679b22d6ca9bef718a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.209183 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c2635c7c47ba4383b6b0f07cd3b42f74
W20260928 10:43:59.209348 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 847b18c212474456ac9b40eee055dbd0 consensus state has no leader
I20260928 10:43:59.199586 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 2f714f8d6e0d49ab885760bf4f2aa37a (DEFAULT_TABLE table=default.Table_3b1f6971648540279d90e7812fddf964 [id=33dceb6fb65c4d4590e8acca3fca51f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:59.209460 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1072cf156cdf4c2a8c9d9764de110c6d consensus state has no leader
I20260928 10:43:59.209916 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5aca2d8635034ce69a07c97d997a2c86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:59.210194 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a766cb0490244b6794f67a154e92eb96" } modify_external_catalogs: true
I20260928 10:43:59.210368 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_855cceaf3f204f99b1cfe97f4506389f" } modify_external_catalogs: true
W20260928 10:43:59.210567 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5aca2d8635034ce69a07c97d997a2c86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.210618 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_855cceaf3f204f99b1cfe97f4506389f" } modify_external_catalogs: true
I20260928 10:43:59.211140 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_19576f3ea75745b09af525ae5b30f0a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:59.211576 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ced63ab7188472e80d4ff52350be3e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:59.211655 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19576f3ea75745b09af525ae5b30f0a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.212384 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb5eed4318fe482789fee32e24a49bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.212318 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0134f07e54b24b6f9252f5613e61bb7a" } new_table_name: "default.Table_6e5afe68ebdd46258a4e2ba8e4de308c" modify_external_catalogs: true
I20260928 10:43:59.209308 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 49c40696fe8645de9b639d2293f41403 (DEFAULT_TABLE table=default.Table_4a57721f3cd145538940531d9b55ac4c [id=7acebc30682b4301baf9446bb5006a5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.212453 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3443d4c6674342b4124156414dcc13 (DEFAULT_TABLE table=default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.213531 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c5c1a1c5e22e455d91de92f0aa3535c7
W20260928 10:43:59.214672 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d64c1af58d6a4dfcabd6eecb8c75d572 consensus state has no leader
I20260928 10:43:59.215961 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.216387 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b7e26971914613a2372476b348b702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.216675 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 463cf5ecb52d40069b564698433c6781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.210371 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a766cb0490244b6794f67a154e92eb96" } modify_external_catalogs: true
I20260928 10:43:59.223278 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f714f8d6e0d49ab885760bf4f2aa37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.224424 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a3443d4c6674342b4124156414dcc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.225473 6280 raft_consensus.cc:482] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.225682 5859 tablet_service.cc:1467] Processing CreateTablet for tablet a229207ce7cc475c8f4492e62d122721 (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.226390 6269 tablet_replica.cc:330] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.226632 6269 raft_consensus.cc:2229] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.227509 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c40696fe8645de9b639d2293f41403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.227854 6280 raft_consensus.cc:504] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.229612 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85583238d6b54f1d89ff5b53b40e73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.232676 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3abfedf425b84f679b22d6ca9bef718a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.232893 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c322d11fab43499f82e077fd8a8c02f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.233328 5861 tablet_service.cc:1467] Processing CreateTablet for tablet bb5eed4318fe482789fee32e24a49bfc (DEFAULT_TABLE table=default.Table_67ff90909aa94822929782b78faf711f [id=42b8d28c18164d34bbad1117d30d8289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.233453 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0c283584d125415e848f4d61a2838a78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.234042 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c283584d125415e848f4d61a2838a78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.228972 6269 raft_consensus.cc:2258] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.235085 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.235435 6280 leader_election.cc:288] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:59.236111 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1072cf156cdf4c2a8c9d9764de110c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.237648 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f60af5c4c3ac4b139003d1d9f56268d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.238229 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f60af5c4c3ac4b139003d1d9f56268d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.239482 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 49c40696fe8645de9b639d2293f41403 (DEFAULT_TABLE table=default.Table_4a57721f3cd145538940531d9b55ac4c [id=7acebc30682b4301baf9446bb5006a5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.239650 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a229207ce7cc475c8f4492e62d122721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.239903 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a229207ce7cc475c8f4492e62d122721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.242661 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c40696fe8645de9b639d2293f41403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.242905 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877e2d1c734a4e2891119f308f9f3ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.244874 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb5eed4318fe482789fee32e24a49bfc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:59.247020 5817 leader_election.cc:341] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.244261 6269 ts_tablet_manager.cc:1905] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.250651 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190cd281b1ad41aab2564744c282bcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.254978 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.257507 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 7dba507179ed44ce903111622ec1fb42 (table default.Table_8b6de790cff44909b80e9ab812bb2d60 [id=4c0912577f204df2a369e5a7be835b49]) successfully deleted
I20260928 10:43:59.258203 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190cd281b1ad41aab2564744c282bcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.132874 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:59.266597 5955 leader_election.cc:341] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:59.266956 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 136021us
I20260928 10:43:59.271003 6271 tablet_bootstrap.cc:654] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.271096 6476 raft_consensus.cc:504] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.271811 6476 leader_election.cc:288] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.272536 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe50a4f375244d0bbc507cc638bb2f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.275981 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.272531 6550 raft_consensus.cc:482] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.284228 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9956318fe8ef4d1cbc92eda9caa98602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.289486 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb (DEFAULT_TABLE table=default.Table_f75884ab2dba4b54bc1311e2c5be5412 [id=2ff0d03c75a046f5b76951e171ee8e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.290000 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85583238d6b54f1d89ff5b53b40e73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.290163 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.290547 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 4082931c332f40fc9c6530190fb61017 (DEFAULT_TABLE table=default.Table_ebcbdae68e524eca87a2587129902f3d [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.290915 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4082931c332f40fc9c6530190fb61017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.293331 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d (DEFAULT_TABLE table=default.Table_0dfb805fb3de478abcdab81632a2da31 [id=aa0fbbc798a8402e98d41714bad869b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.259505 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 2f714f8d6e0d49ab885760bf4f2aa37a (DEFAULT_TABLE table=default.Table_3b1f6971648540279d90e7812fddf964 [id=33dceb6fb65c4d4590e8acca3fca51f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.294414 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.259169 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3443d4c6674342b4124156414dcc13 (DEFAULT_TABLE table=default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.292932 6550 raft_consensus.cc:504] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.296195 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f714f8d6e0d49ab885760bf4f2aa37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.298574 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1072cf156cdf4c2a8c9d9764de110c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.300642 6550 leader_election.cc:288] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.301496 5993 tablet_service.cc:1467] Processing CreateTablet for tablet c322d11fab43499f82e077fd8a8c02f3 (DEFAULT_TABLE table=default.Table_139347c4fd714c3a926c9a6044cb6c77 [id=07eac26ccf134fb5b9bcc53ba57eb067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.301966 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c322d11fab43499f82e077fd8a8c02f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.301333 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.293844 6574 raft_consensus.cc:482] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.312914 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a3443d4c6674342b4124156414dcc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.329491 6273 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.334189 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_678f98b781d743d7a90db47d1a9bcb58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.334916 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_678f98b781d743d7a90db47d1a9bcb58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.335011 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 5ced63ab7188472e80d4ff52350be3e0 (DEFAULT_TABLE table=default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.335453 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ced63ab7188472e80d4ff52350be3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.340379 6273 ts_tablet_manager.cc:1397] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.188s user 0.013s sys 0.037s
I20260928 10:43:59.343930 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 00b7e26971914613a2372476b348b702 (DEFAULT_TABLE table=default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.344422 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b7e26971914613a2372476b348b702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.320030 6574 raft_consensus.cc:504] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.351936 6574 leader_election.cc:288] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:43:59.357729 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 67f29acce3604e458d1981aad87f2eb9 (table default.Table_a766cb0490244b6794f67a154e92eb96 [id=ae18f339d30546ddad1a25f939345b78], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 67f29acce3604e458d1981aad87f2eb9 consensus state has no leader
I20260928 10:43:59.361718 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:59.363305 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f3ec53daf068417ea2f10390d2736b66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.363998 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3ec53daf068417ea2f10390d2736b66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:59.369614 5818 leader_election.cc:341] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.370672 5818 leader_election.cc:302] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.373878 6280 raft_consensus.cc:2726] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.374905 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c322d11fab43499f82e077fd8a8c02f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.376847 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:59.377082 5883 raft_consensus.cc:2454] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:43:59.380431 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.382885 6355 raft_consensus.cc:482] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.383026 6355 raft_consensus.cc:504] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.384405 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:43:59.384598 5883 raft_consensus.cc:2454] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:43:59.384902 6273 raft_consensus.cc:348] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.385432 6273 raft_consensus.cc:374] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.385547 6273 raft_consensus.cc:729] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.387825 6091 leader_election.cc:302] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:59.390537 6273 consensus_queue.cc:260] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.393826 6273 ts_tablet_manager.cc:1428] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20260928 10:43:59.394842 6273 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.396894 6273 tablet_bootstrap.cc:654] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.400527 6269 ts_tablet_manager.cc:1918] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.400671 6269 log.cc:1196] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a19c9c61d774437ea873fdc6e1c93486
I20260928 10:43:59.401163 6269 ts_tablet_manager.cc:1939] T a19c9c61d774437ea873fdc6e1c93486 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.402631 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a19c9c61d774437ea873fdc6e1c93486 (table default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]) successfully deleted
I20260928 10:43:59.403272 6269 tablet_replica.cc:330] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.403522 6269 raft_consensus.cc:2229] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.403750 6269 raft_consensus.cc:2258] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.404587 6269 ts_tablet_manager.cc:1905] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.404783 6355 leader_election.cc:288] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.404966 6355 raft_consensus.cc:2781] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:59.408851 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 190cd281b1ad41aab2564744c282bcab (DEFAULT_TABLE table=default.Table_7b765681901c4d4180fd455a743f0a4c [id=717f077e672e43d9a1763748a97a4b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.411687 6355 raft_consensus.cc:482] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:59.411845 6355 raft_consensus.cc:3037] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:59.417277 6273 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.417449 6273 ts_tablet_manager.cc:1397] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20260928 10:43:59.417590 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190cd281b1ad41aab2564744c282bcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.417972 6280 raft_consensus.cc:482] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.418190 6280 raft_consensus.cc:504] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.418999 6280 leader_election.cc:288] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:59.423696 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 463cf5ecb52d40069b564698433c6781 (DEFAULT_TABLE table=default.Table_67cf9eac75a94f95a5dc8a009d27f6b3 [id=c6c3ffb46ceb49eca78668fed12ab1cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.424026 6273 raft_consensus.cc:348] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.424265 6273 raft_consensus.cc:374] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.424350 6273 raft_consensus.cc:729] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.429123 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.430577 6273 consensus_queue.cc:260] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.435702 6273 ts_tablet_manager.cc:1428] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260928 10:43:59.437870 6273 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.439508 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3d035581da47abb64156066e53fa67" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:59.440860 5817 leader_election.cc:341] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.444494 6273 tablet_bootstrap.cc:654] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.448580 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 3abfedf425b84f679b22d6ca9bef718a (DEFAULT_TABLE table=default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.451776 6355 raft_consensus.cc:504] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.452507 6269 ts_tablet_manager.cc:1918] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.452700 6269 log.cc:1196] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/68e1b25f634e48008f5262aed44010da
I20260928 10:43:59.453080 6269 ts_tablet_manager.cc:1939] T 68e1b25f634e48008f5262aed44010da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.454216 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 68e1b25f634e48008f5262aed44010da (table default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]) successfully deleted
I20260928 10:43:59.456036 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:59.457206 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:43:59.462613 6269 tablet_replica.cc:330] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.463021 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877e2d1c734a4e2891119f308f9f3ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.462914 6269 raft_consensus.cc:2229] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.463480 6022 raft_consensus.cc:2454] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:43:59.464861 6269 raft_consensus.cc:2258] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:59.465583 5957 leader_election.cc:341] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 42b522152aa44e45969f37e3f65de554
I20260928 10:43:59.467276 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 463cf5ecb52d40069b564698433c6781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.465363 6273 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:43:59.468753 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 57993.5us
I20260928 10:43:59.469254 5988 tablet_service.cc:1467] Processing CreateTablet for tablet a229207ce7cc475c8f4492e62d122721 (DEFAULT_TABLE table=default.Table_5b6c5808b2f54b0094cd1910c2cda924 [id=9f353ac79b55463da1daedc2523f6cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.468825 6273 ts_tablet_manager.cc:1397] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.003s
I20260928 10:43:59.470707 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3abfedf425b84f679b22d6ca9bef718a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.472074 6355 leader_election.cc:288] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.472754 6269 ts_tablet_manager.cc:1905] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.474437 5994 tablet_service.cc:1467] Processing CreateTablet for tablet bb5eed4318fe482789fee32e24a49bfc (DEFAULT_TABLE table=default.Table_67ff90909aa94822929782b78faf711f [id=42b8d28c18164d34bbad1117d30d8289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.474767 6273 raft_consensus.cc:348] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.475006 6273 raft_consensus.cc:374] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.475082 6273 raft_consensus.cc:729] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.476984 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:59.477273 5883 raft_consensus.cc:3037] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:43:59.479990 5957 leader_election.cc:341] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8b0aee4f49a44bb7bf19b28d96040e65
I20260928 10:43:59.480059 6272 ts_tablet_manager.cc:1918] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.480242 6272 log.cc:1196] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/af258604238c4e39adac40c81d5a6f3f
I20260928 10:43:59.480470 5957 leader_election.cc:302] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:43:59.480613 6272 ts_tablet_manager.cc:1939] T af258604238c4e39adac40c81d5a6f3f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:59.480844 6574 raft_consensus.cc:2781] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:43:59.480945 6574 raft_consensus.cc:482] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:43:59.481029 6574 raft_consensus.cc:3037] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:43:59.481822 6273 consensus_queue.cc:260] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.482194 5884 raft_consensus.cc:1261] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:43:59.483405 6280 raft_consensus.cc:482] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.483541 6280 raft_consensus.cc:504] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.483667 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3d035581da47abb64156066e53fa67" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:59.484078 6280 leader_election.cc:288] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:43:59.484284 5818 leader_election.cc:341] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.484416 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 01433ce37b2c49cd858ea88877ca56da
I20260928 10:43:59.484424 5818 leader_election.cc:302] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.485144 6280 raft_consensus.cc:2726] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.486528 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2df1933315314f7394f4f47e678c4645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.487114 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2df1933315314f7394f4f47e678c4645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.488685 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.489568 6273 ts_tablet_manager.cc:1428] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260928 10:43:59.489938 6273 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.490869 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.492247 6273 tablet_bootstrap.cc:654] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.494066 6269 ts_tablet_manager.cc:1918] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.494194 6269 log.cc:1196] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/65905f0cb4154bdcb8ee6702c87d23ca
I20260928 10:43:59.494558 6269 ts_tablet_manager.cc:1939] T 65905f0cb4154bdcb8ee6702c87d23ca P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.495554 6269 tablet_replica.cc:330] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.495801 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet af258604238c4e39adac40c81d5a6f3f (table default.Table_9af467c9f80a4119845169339a5d6994 [id=bb501c74345744529c7acff050952d6e]) successfully deleted
I20260928 10:43:59.496444 6269 raft_consensus.cc:2229] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.496692 6269 raft_consensus.cc:2258] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.496229 6273 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.496814 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 49c40696fe8645de9b639d2293f41403 (DEFAULT_TABLE table=default.Table_4a57721f3cd145538940531d9b55ac4c [id=7acebc30682b4301baf9446bb5006a5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.497040 6273 ts_tablet_manager.cc:1397] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260928 10:43:59.497805 6273 raft_consensus.cc:348] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.498023 6273 raft_consensus.cc:374] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.498097 6273 raft_consensus.cc:729] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.498332 6273 consensus_queue.cc:260] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.498529 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a229207ce7cc475c8f4492e62d122721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.499136 6273 ts_tablet_manager.cc:1428] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:43:59.499316 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 65905f0cb4154bdcb8ee6702c87d23ca (table default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]) successfully deleted
I20260928 10:43:59.499419 6273 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:43:59.499620 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c2635c7c47ba4383b6b0f07cd3b42f74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2635c7c47ba4383b6b0f07cd3b42f74 already in progress: creating tablet
I20260928 10:43:59.501791 6273 tablet_bootstrap.cc:654] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.503237 6269 ts_tablet_manager.cc:1905] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.504354 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 2f714f8d6e0d49ab885760bf4f2aa37a (DEFAULT_TABLE table=default.Table_3b1f6971648540279d90e7812fddf964 [id=33dceb6fb65c4d4590e8acca3fca51f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.506747 5883 raft_consensus.cc:2454] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:43:59.506897 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8abd00f2742a29fdc79059332b91d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:59.508839 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.509636 6269 ts_tablet_manager.cc:1918] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.509804 6269 log.cc:1196] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/97e20784940a4647a220ad74e3e15f83
I20260928 10:43:59.510188 6269 ts_tablet_manager.cc:1939] T 97e20784940a4647a220ad74e3e15f83 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.510111 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8abd00f2742a29fdc79059332b91d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.510983 6091 leader_election.cc:302] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027
I20260928 10:43:59.510546 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.511507 6355 raft_consensus.cc:2781] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 10:43:59.510692 5817 leader_election.cc:341] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:43:59.511785 5818 leader_election.cc:341] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.512207 5818 leader_election.cc:302] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.512315 6355 raft_consensus.cc:686] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:43:59.512791 6355 consensus_queue.cc:237] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.513151 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb5eed4318fe482789fee32e24a49bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.512660 6582 raft_consensus.cc:2726] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.513218 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b522152aa44e45969f37e3f65de554" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.515992 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b0aee4f49a44bb7bf19b28d96040e65" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.516172 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 97e20784940a4647a220ad74e3e15f83 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
W20260928 10:43:59.517895 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c5c1a1c5e22e455d91de92f0aa3535c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c1a1c5e22e455d91de92f0aa3535c7 already in progress: creating tablet
I20260928 10:43:59.518419 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.518705 6269 tablet_replica.cc:330] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.518913 6269 raft_consensus.cc:2229] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.519111 6269 raft_consensus.cc:2258] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.521209 6273 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.521380 6273 ts_tablet_manager.cc:1397] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260928 10:43:59.525755 6273 raft_consensus.cc:348] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.526058 6273 raft_consensus.cc:374] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.526153 6273 raft_consensus.cc:729] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.527617 6269 ts_tablet_manager.cc:1905] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.527578 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3443d4c6674342b4124156414dcc13 (DEFAULT_TABLE table=default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.528337 6273 consensus_queue.cc:260] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.530436 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c40696fe8645de9b639d2293f41403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.531273 6273 ts_tablet_manager.cc:1428] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260928 10:43:59.531602 6273 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.531843 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:43:59.534559 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c5c1a1c5e22e455d91de92f0aa3535c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c1a1c5e22e455d91de92f0aa3535c7 already in progress: creating tablet
I20260928 10:43:59.534828 6273 tablet_bootstrap.cc:654] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:59.535311 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c2635c7c47ba4383b6b0f07cd3b42f74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2635c7c47ba4383b6b0f07cd3b42f74 already in progress: creating tablet
W20260928 10:43:59.536456 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 01433ce37b2c49cd858ea88877ca56da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01433ce37b2c49cd858ea88877ca56da already in progress: creating tablet
I20260928 10:43:59.538859 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.539283 6275 tablet_bootstrap.cc:492] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:59.539510 6275 ts_tablet_manager.cc:1397] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.503s user 0.007s sys 0.003s
I20260928 10:43:59.540350 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a3443d4c6674342b4124156414dcc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.540356 6275 raft_consensus.cc:348] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.540719 6275 raft_consensus.cc:374] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.540832 6275 raft_consensus.cc:729] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.541167 6275 consensus_queue.cc:260] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:43:59.541872 5955 leader_election.cc:341] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.542045 5955 leader_election.cc:302] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:59.543670 6575 raft_consensus.cc:2726] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.544703 6271 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:59.544931 6269 ts_tablet_manager.cc:1918] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.545080 6269 log.cc:1196] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/ab1277e4c47141ea9480987eef715528
I20260928 10:43:59.545472 6269 ts_tablet_manager.cc:1939] T ab1277e4c47141ea9480987eef715528 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.547484 6271 ts_tablet_manager.cc:1397] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.489s user 0.011s sys 0.013s
I20260928 10:43:59.547923 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f714f8d6e0d49ab885760bf4f2aa37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.548750 6270 ts_tablet_manager.cc:1918] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.549427 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 67f29acce3604e458d1981aad87f2eb9
I20260928 10:43:59.551823 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e25db69b15eb445792e6168f99304bf2
I20260928 10:43:59.525198 6564 consensus_queue.cc:1035] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260928 10:43:59.552433 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b69782fa1420476b8da47aaa1366be8b" } new_table_name: "default.Table_003e601167904dcd8816bb3be11c926a" modify_external_catalogs: true
I20260928 10:43:59.552636 5698 catalog_manager.cc:5495] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67). New cstate: current_term: 1 leader_uuid: "4dab87557ec9445dbe35ea05e3561a94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:59.553105 5698 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:43:59.553683 6270 log.cc:1196] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1f6fe4271349432db8efda609d85d611
I20260928 10:43:59.554157 6270 ts_tablet_manager.cc:1939] T 1f6fe4271349432db8efda609d85d611 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:59.554136 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 54b78fbf508f4e47bd31661e05dcaa16 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:59.554922 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8062a54a93234807a39d7ff0f8787f73" } modify_external_catalogs: true
I20260928 10:43:59.555152 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8062a54a93234807a39d7ff0f8787f73" } modify_external_catalogs: true
I20260928 10:43:59.555315 6270 tablet_replica.cc:330] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.555531 6270 raft_consensus.cc:2229] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.555703 6270 raft_consensus.cc:2258] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.556296 6270 ts_tablet_manager.cc:1905] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.556728 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_666c3308a327438e82946bd8c06b0953" } new_table_name: "default.Table_296151ac6be54c6487d713bcebc2d867" modify_external_catalogs: true
I20260928 10:43:59.556865 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_63fc7a3742ea42e28b3a0bb25584c00f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.557464 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63fc7a3742ea42e28b3a0bb25584c00f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:59.558359 5957 consensus_peers.cc:487] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a392670fdb5a4d4097c7edaf8f6642ce. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:43:59.558905 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.561213 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_861e45cccda8422f9bcc2ecb56c0da0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:59.561494 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.561764 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:59.561765 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_861e45cccda8422f9bcc2ecb56c0da0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.561954 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:43:59.562907 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 362ef9f9aa8641cca11c0a154882e1d4 consensus state has no leader
I20260928 10:43:59.563050 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet ab1277e4c47141ea9480987eef715528 (table default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]) successfully deleted
W20260928 10:43:59.563335 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 01433ce37b2c49cd858ea88877ca56da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01433ce37b2c49cd858ea88877ca56da already in progress: creating tablet
I20260928 10:43:59.563289 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f75884ab2dba4b54bc1311e2c5be5412" } new_table_name: "default.Table_e7cdd96b23534cf9a61ec1e66e419155" modify_external_catalogs: true
I20260928 10:43:59.563668 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1f6fe4271349432db8efda609d85d611 (table default.Table_b6a8b78145f2494aa8b0e49415c15f9d [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]) successfully deleted
I20260928 10:43:59.564239 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8fd16c3c602488693b9c88e13f98589" } new_table_name: "default.Table_32e4b27c2c494235acd8e4bd96b9270b" modify_external_catalogs: true
W20260928 10:43:59.565384 5955 leader_election.cc:341] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.565551 5955 leader_election.cc:302] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:43:59.565779 6564 raft_consensus.cc:2726] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:43:59.569108 5955 consensus_peers.cc:487] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a392670fdb5a4d4097c7edaf8f6642ce. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:43:59.569361 5955 consensus_peers.cc:487] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:43:59.573858 6271 raft_consensus.cc:348] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.574133 6271 raft_consensus.cc:374] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.574237 6271 raft_consensus.cc:729] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.567996 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.575457 6269 tablet_replica.cc:330] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.574436 6271 consensus_queue.cc:260] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:59.576042 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 67f29acce3604e458d1981aad87f2eb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f29acce3604e458d1981aad87f2eb9 already in progress: creating tablet
I20260928 10:43:59.576181 6269 raft_consensus.cc:2229] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.568183 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:59.576884 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e25db69b15eb445792e6168f99304bf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25db69b15eb445792e6168f99304bf2 already in progress: creating tablet
I20260928 10:43:59.577152 6574 raft_consensus.cc:504] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.578526 6275 ts_tablet_manager.cc:1428] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.039s user 0.000s sys 0.002s
I20260928 10:43:59.579016 6275 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:59.582278 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:43:59.582567 5883 raft_consensus.cc:2379] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:43:59.582799 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.576350 6269 raft_consensus.cc:2258] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.584034 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d103af0b1cb24cda882cc2e3d95a558d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:43:59.586787 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.587148 6275 tablet_bootstrap.cc:654] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.588554 6271 ts_tablet_manager.cc:1428] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260928 10:43:59.588860 6271 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:59.589861 6574 leader_election.cc:288] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:43:59.592864 5955 leader_election.cc:302] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:43:59.593989 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d40123712b17464e87023f69a6235640 consensus state has no leader
I20260928 10:43:59.594388 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8ab5057a6dd44d16a05cf47c02e20582" } modify_external_catalogs: true
I20260928 10:43:59.594619 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8ab5057a6dd44d16a05cf47c02e20582" } modify_external_catalogs: true
I20260928 10:43:59.595417 6574 raft_consensus.cc:2726] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.595654 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ba8abd00f2742a29fdc79059332b91d from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:59.596463 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9956318fe8ef4d1cbc92eda9caa98602 consensus state has no leader
I20260928 10:43:59.596829 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_aae329bcf05349da8b851e709092bed2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.597414 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aae329bcf05349da8b851e709092bed2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:59.600865 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85583238d6b54f1d89ff5b53b40e73bb consensus state has no leader
I20260928 10:43:59.604383 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d64c1af58d6a4dfcabd6eecb8c75d572
I20260928 10:43:59.606034 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet a8c53e9be06f4d1aa0fc7eaef2c10303 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:59.607424 6269 ts_tablet_manager.cc:1905] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.608186 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 9e05cdd590894adcb987ef3ac78bf416 from {username='slave'} at 127.0.0.1:45112
W20260928 10:43:59.609088 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ef1e7125d4e42f5b30f33bfa588511c consensus state has no leader
I20260928 10:43:59.592545 6591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.126:39997 every 8 connection(s)
I20260928 10:43:59.615051 6273 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.615401 6273 ts_tablet_manager.cc:1397] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.084s user 0.008s sys 0.007s
I20260928 10:43:59.615782 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.616986 6273 raft_consensus.cc:348] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.617427 6273 raft_consensus.cc:374] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.617632 6273 raft_consensus.cc:729] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.618041 6273 consensus_queue.cc:260] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.623322 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a8c53e9be06f4d1aa0fc7eaef2c10303
I20260928 10:43:59.623366 6271 tablet_bootstrap.cc:654] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.624368 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c67f960eb84426f9ebdfef33306a9d0) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.624754 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c67f960eb84426f9ebdfef33306a9d0) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.625473 5696 catalog_manager.cc:6565] ReplaceTablet: tablet a8c53e9be06f4d1aa0fc7eaef2c10303 deleted and replaced by tablet 3c67f960eb84426f9ebdfef33306a9d0
I20260928 10:43:59.628094 6273 ts_tablet_manager.cc:1428] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260928 10:43:59.628947 6273 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.628724 5695 catalog_manager.cc:5495] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:43:59.632715 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 490f8a4f1f9245cfab168b96511e18de (DEFAULT_TABLE table=default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.633164 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490f8a4f1f9245cfab168b96511e18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.633239 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 490f8a4f1f9245cfab168b96511e18de (DEFAULT_TABLE table=default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.633606 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490f8a4f1f9245cfab168b96511e18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.637110 6271 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:59.637573 6271 ts_tablet_manager.cc:1397] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.000s
I20260928 10:43:59.639556 6273 tablet_bootstrap.cc:654] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.644048 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 490f8a4f1f9245cfab168b96511e18de (DEFAULT_TABLE table=default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.641521 6271 raft_consensus.cc:348] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.644708 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490f8a4f1f9245cfab168b96511e18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.644924 6271 raft_consensus.cc:374] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.648337 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1ba8abd00f2742a29fdc79059332b91d
I20260928 10:43:59.648802 5698 catalog_manager.cc:6565] ReplaceTablet: tablet 1ba8abd00f2742a29fdc79059332b91d deleted and replaced by tablet 5afe4501ea584d44b511b89983e210e3
I20260928 10:43:59.650161 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba8abd00f2742a29fdc79059332b91d with delete_type TABLET_DATA_DELETED (replaced by tablet 5afe4501ea584d44b511b89983e210e3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.652477 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.653213 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.653954 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba8abd00f2742a29fdc79059332b91d with delete_type TABLET_DATA_DELETED (replaced by tablet 5afe4501ea584d44b511b89983e210e3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.654281 6271 raft_consensus.cc:729] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.654780 6271 consensus_queue.cc:260] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.657117 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 54b78fbf508f4e47bd31661e05dcaa16
I20260928 10:43:59.657570 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 54b78fbf508f4e47bd31661e05dcaa16 deleted and replaced by tablet 75539c390965493eaa69a0d1215fa922
I20260928 10:43:59.657802 6271 ts_tablet_manager.cc:1428] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260928 10:43:59.658123 6271 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:59.658897 6582 raft_consensus.cc:482] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.659148 6582 raft_consensus.cc:504] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.660538 6582 leader_election.cc:288] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:43:59.661248 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6f7476c814e0a9abf56b23c1e547d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:43:59.661809 5818 leader_election.cc:341] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.658918 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.662155 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c1e7257c8b114e80853ff0a108d2998a
I20260928 10:43:59.662955 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.663563 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.663697 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.664340 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6f7476c814e0a9abf56b23c1e547d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:43:59.665088 5817 leader_election.cc:341] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.665262 5817 leader_election.cc:302] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.665799 6582 raft_consensus.cc:2726] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.667438 5695 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_31f734bdbf584367a86b12dcf8e2b373 [id=7af448c554a042ab877113eb284d68c7]). Expected version 4 got 0
I20260928 10:43:59.669530 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.669569 6596 tablet.cc:1722] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:43:59.666458 6271 tablet_bootstrap.cc:654] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.670255 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.671557 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9e05cdd590894adcb987ef3ac78bf416
I20260928 10:43:59.672039 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 9e05cdd590894adcb987ef3ac78bf416 deleted and replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6
I20260928 10:43:59.672668 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.675266 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.675709 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.673331 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.673501 6582 raft_consensus.cc:482] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.677444 6582 raft_consensus.cc:504] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.677768 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.654240 6270 ts_tablet_manager.cc:1918] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.678619 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d841c2f9b844208173f982b9eb7818" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:43:59.678805 6270 log.cc:1196] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4ffa9fb5b11944b1b38e07bd43891773
I20260928 10:43:59.679268 6582 leader_election.cc:288] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:43:59.679673 5818 leader_election.cc:341] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.679750 6270 ts_tablet_manager.cc:1939] T 4ffa9fb5b11944b1b38e07bd43891773 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:59.680078 5850 tablet_service.cc:1467] Processing CreateTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 (DEFAULT_TABLE table=default.Table_fec7d4d51f114043944b5de668a91d15 [id=cfdc4695a4d8442b88b15f1a81a95c5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.680352 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d841c2f9b844208173f982b9eb7818" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.680486 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd65a860b00d4a7ba8ae92dde5818212. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:59.680889 5817 leader_election.cc:341] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.680881 5990 tablet_service.cc:1467] Processing CreateTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 (DEFAULT_TABLE table=default.Table_fec7d4d51f114043944b5de668a91d15 [id=cfdc4695a4d8442b88b15f1a81a95c5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.681036 5817 leader_election.cc:302] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.681237 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd65a860b00d4a7ba8ae92dde5818212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.681447 6582 raft_consensus.cc:2726] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.682682 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4ffa9fb5b11944b1b38e07bd43891773 (table default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]) successfully deleted
I20260928 10:43:59.683940 5987 tablet_service.cc:1467] Processing CreateTablet for tablet dddbd630c6d9446b9ff317c963cd00d3 (DEFAULT_TABLE table=default.Table_320ffa6517e14f969247ecdd0b4a7ca8 [id=2e6d97f53a504da991be069f05b29717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.684285 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dddbd630c6d9446b9ff317c963cd00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.685593 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 (DEFAULT_TABLE table=default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.685936 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d2c79118e44bca3540d3e3ff524a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.686144 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e1bf6b61428c4c59b89c1570bf86cdde" } modify_external_catalogs: true
I20260928 10:43:59.686324 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e1bf6b61428c4c59b89c1570bf86cdde" } modify_external_catalogs: true
I20260928 10:43:59.686834 5860 tablet_service.cc:1467] Processing CreateTablet for tablet dddbd630c6d9446b9ff317c963cd00d3 (DEFAULT_TABLE table=default.Table_320ffa6517e14f969247ecdd0b4a7ca8 [id=2e6d97f53a504da991be069f05b29717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.687186 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dddbd630c6d9446b9ff317c963cd00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.688527 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 (DEFAULT_TABLE table=default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.688843 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d2c79118e44bca3540d3e3ff524a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.689260 5988 tablet_service.cc:1467] Processing CreateTablet for tablet f95e1588a3d04142ab8d6bb257235dab (DEFAULT_TABLE table=default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.689581 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95e1588a3d04142ab8d6bb257235dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.699023 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 (DEFAULT_TABLE table=default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.699373 6125 tablet_service.cc:1467] Processing CreateTablet for tablet dddbd630c6d9446b9ff317c963cd00d3 (DEFAULT_TABLE table=default.Table_320ffa6517e14f969247ecdd0b4a7ca8 [id=2e6d97f53a504da991be069f05b29717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.699532 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d2c79118e44bca3540d3e3ff524a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.699824 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dddbd630c6d9446b9ff317c963cd00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.699039 6132 tablet_service.cc:1467] Processing CreateTablet for tablet f95e1588a3d04142ab8d6bb257235dab (DEFAULT_TABLE table=default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.700325 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95e1588a3d04142ab8d6bb257235dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.702821 6271 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:59.706976 6271 ts_tablet_manager.cc:1397] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.001s
I20260928 10:43:59.708189 6271 raft_consensus.cc:348] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.709372 6269 ts_tablet_manager.cc:1918] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.709986 6582 raft_consensus.cc:482] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:43:59.711233 6582 raft_consensus.cc:504] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.711863 6582 leader_election.cc:288] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:43:59.713668 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3cb9c554d363441b8006abc2d9bdd856
I20260928 10:43:59.715234 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.715548 6269 log.cc:1196] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0563f8c31f7d43b3b703593dbc562ad6
I20260928 10:43:59.716176 6271 raft_consensus.cc:374] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.716286 6271 raft_consensus.cc:729] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.716262 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:43:59.716531 6271 consensus_queue.cc:260] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.717100 6271 ts_tablet_manager.cc:1428] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:43:59.717388 6271 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:59.706763 6270 tablet_replica.cc:330] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.710664 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.712620 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:43:59.717499 5817 leader_election.cc:341] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.717796 5930 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:59.714756 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.718565 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.718638 6270 raft_consensus.cc:2229] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.718830 6270 raft_consensus.cc:2258] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:43:59.719158 5818 leader_election.cc:341] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:43:59.719331 5818 leader_election.cc:302] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:43:59.719159 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba8abd00f2742a29fdc79059332b91d with delete_type TABLET_DATA_DELETED (replaced by tablet 5afe4501ea584d44b511b89983e210e3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.719959 6270 ts_tablet_manager.cc:1905] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.720085 6582 raft_consensus.cc:2726] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:43:59.721956 6269 ts_tablet_manager.cc:1939] T 0563f8c31f7d43b3b703593dbc562ad6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:43:59.723830 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0563f8c31f7d43b3b703593dbc562ad6 (table default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]) successfully deleted
I20260928 10:43:59.725895 5930 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
W20260928 10:43:59.728312 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 67f29acce3604e458d1981aad87f2eb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f29acce3604e458d1981aad87f2eb9 already in progress: creating tablet
I20260928 10:43:59.729786 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.732028 6269 tablet_replica.cc:330] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:43:59.733053 6269 raft_consensus.cc:2229] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.735239 6128 tablet_service.cc:1467] Processing CreateTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 (DEFAULT_TABLE table=default.Table_fec7d4d51f114043944b5de668a91d15 [id=cfdc4695a4d8442b88b15f1a81a95c5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.738248 6270 ts_tablet_manager.cc:1918] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.738343 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd65a860b00d4a7ba8ae92dde5818212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.738399 6270 log.cc:1196] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/42b522152aa44e45969f37e3f65de554
I20260928 10:43:59.742534 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c67f960eb84426f9ebdfef33306a9d0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.745361 6271 tablet_bootstrap.cc:654] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.733814 6273 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.746982 6269 raft_consensus.cc:2258] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.747014 6273 ts_tablet_manager.cc:1397] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.118s user 0.012s sys 0.032s
I20260928 10:43:59.747927 6273 raft_consensus.cc:348] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.748229 6273 raft_consensus.cc:374] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.748298 6273 raft_consensus.cc:729] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.749142 6273 consensus_queue.cc:260] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.754204 6273 ts_tablet_manager.cc:1428] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:43:59.757966 6270 ts_tablet_manager.cc:1939] T 42b522152aa44e45969f37e3f65de554 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:59.759917 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_296151ac6be54c6487d713bcebc2d867" } modify_external_catalogs: true
I20260928 10:43:59.760182 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_296151ac6be54c6487d713bcebc2d867" } modify_external_catalogs: true
I20260928 10:43:59.760802 6273 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.761307 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 42b522152aa44e45969f37e3f65de554 (table default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]) successfully deleted
I20260928 10:43:59.762756 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e3bfd4162a934aa88b977518be6ad38b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.763339 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3bfd4162a934aa88b977518be6ad38b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.764406 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_64f2ffa93db34653b515aa6d668ed2a2" } modify_external_catalogs: true
I20260928 10:43:59.764636 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.765021 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa9fb5b11944b1b38e07bd43891773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.765270 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ade01600340b4495ac021240bf24c832"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.766451 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ade01600340b4495ac021240bf24c832 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.767020 6272 tablet_replica.cc:330] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:43:59.767023 6270 tablet_replica.cc:330] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.767261 6272 raft_consensus.cc:2229] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.767268 6270 raft_consensus.cc:2229] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:43:59.767541 6272 raft_consensus.cc:2258] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.767625 6270 raft_consensus.cc:2258] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.767892 6273 tablet_bootstrap.cc:654] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.768668 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_78298d55e7474d6da0c4ea464abb2b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.770772 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1ba8abd00f2742a29fdc79059332b91d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ba8abd00f2742a29fdc79059332b91d already in progress: creating tablet
W20260928 10:43:59.770995 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 54b78fbf508f4e47bd31661e05dcaa16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b78fbf508f4e47bd31661e05dcaa16 already in progress: creating tablet
W20260928 10:43:59.771169 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9e05cdd590894adcb987ef3ac78bf416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e05cdd590894adcb987ef3ac78bf416 already in progress: creating tablet
W20260928 10:43:59.771232 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78298d55e7474d6da0c4ea464abb2b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:59.771349 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c1e7257c8b114e80853ff0a108d2998a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1e7257c8b114e80853ff0a108d2998a already in progress: creating tablet
I20260928 10:43:59.768719 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bf2c9b1add4648609ed27c8ce7eaa68c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.772138 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf2c9b1add4648609ed27c8ce7eaa68c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.769140 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fcaab1ce2ab54b4e803c360b710e12fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.772578 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcaab1ce2ab54b4e803c360b710e12fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.770174 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_30b367f1c2f348008ce1ac1ea284079d" } new_table_name: "default.Table_19bc838ee7264d68bb6451efa0fce66f" modify_external_catalogs: true
I20260928 10:43:59.770592 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b2d22c89014245869ff6b541065015ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.773986 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2d22c89014245869ff6b541065015ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.774662 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.769229 6270 ts_tablet_manager.cc:1905] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.775663 5850 tablet_service.cc:1467] Processing CreateTablet for tablet f95e1588a3d04142ab8d6bb257235dab (DEFAULT_TABLE table=default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.776136 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95e1588a3d04142ab8d6bb257235dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.775825 6269 ts_tablet_manager.cc:1905] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.780606 6273 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.780757 6273 ts_tablet_manager.cc:1397] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20260928 10:43:59.781540 6273 raft_consensus.cc:348] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.781760 6273 raft_consensus.cc:374] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.781857 6273 raft_consensus.cc:729] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.781786 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_64f2ffa93db34653b515aa6d668ed2a2" } modify_external_catalogs: true
I20260928 10:43:59.783188 6273 consensus_queue.cc:260] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.783721 6273 ts_tablet_manager.cc:1428] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260928 10:43:59.784014 6273 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:43:59.785609 6273 tablet_bootstrap.cc:654] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:43:59.771529 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3cb9c554d363441b8006abc2d9bdd856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cb9c554d363441b8006abc2d9bdd856 already in progress: creating tablet
W20260928 10:43:59.788897 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8c53e9be06f4d1aa0fc7eaef2c10303 already in progress: creating tablet
I20260928 10:43:59.790853 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_18ea40c9c4d247179baafb67f810b161"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.791563 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18ea40c9c4d247179baafb67f810b161 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.793082 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d40123712b17464e87023f69a6235640
I20260928 10:43:59.795864 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c40c67db116d48bd969f06a5bd0febc1" } new_table_name: "default.Table_db5f2736588a497ca53d21f0deb71ae2" modify_external_catalogs: true
I20260928 10:43:59.794975 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.794407 6270 ts_tablet_manager.cc:1918] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:43:59.797907 6270 log.cc:1196] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a392670fdb5a4d4097c7edaf8f6642ce
I20260928 10:43:59.798667 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.799072 6270 ts_tablet_manager.cc:1939] T a392670fdb5a4d4097c7edaf8f6642ce P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:59.799407 6272 ts_tablet_manager.cc:1905] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.800516 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a392670fdb5a4d4097c7edaf8f6642ce (table default.Table_1c13a45c9a2248a9a00aea0ca2a8af55 [id=1d308dc2d8524d118ad5638a6dd12ccd]) successfully deleted
I20260928 10:43:59.800908 6271 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:43:59.801244 6271 ts_tablet_manager.cc:1397] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.084s user 0.007s sys 0.002s
W20260928 10:43:59.802276 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 440a50034c6b4110b74b1531a6b7790d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 440a50034c6b4110b74b1531a6b7790d already in progress: creating tablet
I20260928 10:43:59.802816 6271 raft_consensus.cc:348] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:59.803261 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4bfb47ad184148d595830276bad311dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bfb47ad184148d595830276bad311dc already in progress: creating tablet
I20260928 10:43:59.803918 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:43:59.803964 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f1a8f5241dd14684b5544e47d6cec9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a8f5241dd14684b5544e47d6cec9cc already in progress: creating tablet
W20260928 10:43:59.805359 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bd225da0b4b445c6ac03634d975e8396 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd225da0b4b445c6ac03634d975e8396 already in progress: creating tablet
W20260928 10:43:59.806116 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0563f8c31f7d43b3b703593dbc562ad6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0563f8c31f7d43b3b703593dbc562ad6 already in progress: creating tablet
W20260928 10:43:59.806936 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet dfd9b4092b1242b8a60974c445a2789a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfd9b4092b1242b8a60974c445a2789a already in progress: creating tablet
I20260928 10:43:59.809429 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b34ae7f4b0094611a67b40e6d1e9306c" } new_table_name: "default.Table_5199c77c44b746dba7428ddc716b0da3" modify_external_catalogs: true
I20260928 10:43:59.809708 6329 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.126:39997
I20260928 10:43:59.811110 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a054ca5f8f14a83aa001fe1b81ef734" } new_table_name: "default.Table_844c8f80dda04f47b0b920db9a814437" modify_external_catalogs: true
W20260928 10:43:59.812429 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1677f971c9384d519f1ce94da1b7ef2a consensus state has no leader
I20260928 10:43:59.812929 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_47dbd199fad2491596114b4eefdb2b68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:59.813862 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 971f8344436f4e60ac0152e811efea8d
I20260928 10:43:59.814291 6329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
I20260928 10:43:59.807196 6595 tablet.cc:1722] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:43:59.807646 6270 tablet_replica.cc:330] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.816053 6270 raft_consensus.cc:2229] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:43:59.816267 6270 raft_consensus.cc:2258] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.816167 6271 raft_consensus.cc:374] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.817077 6270 ts_tablet_manager.cc:1905] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.817013 6271 raft_consensus.cc:729] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.818715 6271 consensus_queue.cc:260] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.822748 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_818fbd013f2146f58d27d364c7e9e410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:43:59.825490 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 6329
W20260928 10:43:59.825681 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47dbd199fad2491596114b4eefdb2b68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:43:59.827157 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_818fbd013f2146f58d27d364c7e9e410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.832214 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 971f8344436f4e60ac0152e811efea8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:43:59.831501 6271 ts_tablet_manager.cc:1428] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260928 10:43:59.835225 6271 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:43:59.836103 6270 ts_tablet_manager.cc:1918] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.838366 6270 log.cc:1196] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8b0aee4f49a44bb7bf19b28d96040e65
I20260928 10:43:59.831261 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 971f8344436f4e60ac0152e811efea8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.842696 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 971f8344436f4e60ac0152e811efea8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.839129 6270 ts_tablet_manager.cc:1939] T 8b0aee4f49a44bb7bf19b28d96040e65 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:43:59.843441 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a25c7f3b94e94cafb3275a2e190be0ed consensus state has no leader
I20260928 10:43:59.843722 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2d2ea0962fda4292b0f84c4c0d6dd9dd" } new_table_name: "default.Table_992de79b82b84396a6afe0e91c2be532" modify_external_catalogs: true
I20260928 10:43:59.845072 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a303983e2e7f444886ff5e22fc9b1abf" } modify_external_catalogs: true
I20260928 10:43:59.845748 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a303983e2e7f444886ff5e22fc9b1abf" } modify_external_catalogs: true
I20260928 10:43:59.846387 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3bfd977507e84edebfadab9cc567bd3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:43:59.847317 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bfd977507e84edebfadab9cc567bd3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:43:59.850206 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 98bd99e7bdb647ceb9357f88affc45d9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:59.851461 6068 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:59.860471 6275 tablet_bootstrap.cc:492] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:43:59.860641 6275 ts_tablet_manager.cc:1397] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.282s user 0.003s sys 0.001s
W20260928 10:43:59.860993 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75539c390965493eaa69a0d1215fa922 has no consensus state
I20260928 10:43:59.861438 6275 raft_consensus.cc:348] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:43:59.861691 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84912292d6c34a3991bd0f885de240a8 consensus state has no leader
I20260928 10:43:59.865017 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96c0113a38234d5fa727f275b4dde281" } modify_external_catalogs: true
I20260928 10:43:59.865258 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96c0113a38234d5fa727f275b4dde281" } modify_external_catalogs: true
I20260928 10:43:59.866400 6601 sys_catalog.cc:263] Verifying existing consensus state
I20260928 10:43:59.871861 6601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Bootstrap starting.
I20260928 10:43:59.878068 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:43:59.881271 6275 raft_consensus.cc:374] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.881448 6275 raft_consensus.cc:729] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:43:59.881736 6275 consensus_queue.cc:260] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:43:59.882444 6275 ts_tablet_manager.cc:1428] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260928 10:43:59.884824 6601 log.cc:824] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Log is configured to *not* fsync() on all Append() calls
I20260928 10:43:59.885380 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:46336
I20260928 10:43:59.890470 6273 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:43:59.890803 6273 ts_tablet_manager.cc:1397] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.107s user 0.009s sys 0.004s
I20260928 10:43:59.893841 6273 raft_consensus.cc:348] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.894654 6273 raft_consensus.cc:374] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:43:59.894917 6273 raft_consensus.cc:729] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:43:59.895467 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 502d275d161945ce86626594ab0d89b3 consensus state has no leader
I20260928 10:43:59.895972 6275 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:43:59.897810 6275 tablet_bootstrap.cc:654] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.897097 6273 consensus_queue.cc:260] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:43:59.906277 5986 tablet_service.cc:1467] Processing CreateTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 (DEFAULT_TABLE table=default.Table_aae329bcf05349da8b851e709092bed2 [id=2f4692f3be284f3c81ec608ace7d6d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.906868 6272 ts_tablet_manager.cc:1918] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:43:59.907029 6272 log.cc:1196] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4ffa9fb5b11944b1b38e07bd43891773
I20260928 10:43:59.907451 6272 ts_tablet_manager.cc:1939] T 4ffa9fb5b11944b1b38e07bd43891773 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:43:59.908147 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 871fb70fea304b08bebce18c60998209 (DEFAULT_TABLE table=default.Table_2df1933315314f7394f4f47e678c4645 [id=3888c975417043cb8b36d7b70c48e612]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.910146 5861 tablet_service.cc:1467] Processing CreateTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f (DEFAULT_TABLE table=default.Table_861e45cccda8422f9bcc2ecb56c0da0f [id=2ac5e881f6e94b97a08cc5e7da381a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.910307 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 871fb70fea304b08bebce18c60998209 (DEFAULT_TABLE table=default.Table_2df1933315314f7394f4f47e678c4645 [id=3888c975417043cb8b36d7b70c48e612]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.910712 5860 tablet_service.cc:1467] Processing CreateTablet for tablet cc2990e37a9648669eb39a865392c9e7 (DEFAULT_TABLE table=default.Table_63fc7a3742ea42e28b3a0bb25584c00f [id=64216505cc384325a82a0907c922af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.911343 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet cf9361a96fdc44d7ac38a1d0d812eac0 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:59.912040 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 4b6db38f77f64cfe9a7802d5307aa949 from {username='slave'} at 127.0.0.1:45112
I20260928 10:43:59.912696 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4ffa9fb5b11944b1b38e07bd43891773 (table default.Table_0f27ea4cc7c04295af25a51c164d3998 [id=effee5e802a34b2cac16f3234df54726]) successfully deleted
W20260928 10:43:59.912935 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d64c1af58d6a4dfcabd6eecb8c75d572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d64c1af58d6a4dfcabd6eecb8c75d572 already in progress: creating tablet
W20260928 10:43:59.913204 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d40123712b17464e87023f69a6235640 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d40123712b17464e87023f69a6235640 already in progress: creating tablet
W20260928 10:43:59.913435 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 971f8344436f4e60ac0152e811efea8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 971f8344436f4e60ac0152e811efea8d already in progress: creating tablet
I20260928 10:43:59.915794 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7aa301bfbb4097b386a0d23cfa91e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.916522 6270 tablet_replica.cc:330] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:43:59.916778 6270 raft_consensus.cc:2229] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:43:59.917151 6270 raft_consensus.cc:2258] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:43:59.918813 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871fb70fea304b08bebce18c60998209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.919431 6126 tablet_service.cc:1467] Processing CreateTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 (DEFAULT_TABLE table=default.Table_aae329bcf05349da8b851e709092bed2 [id=2f4692f3be284f3c81ec608ace7d6d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.919893 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7aa301bfbb4097b386a0d23cfa91e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.921864 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 3b2cabf659dc48028605b39c92e1e451 (DEFAULT_TABLE table=default.Table_f60af5c4c3ac4b139003d1d9f56268d0 [id=3daf4c7bcf784fb0948e743ecec939ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.923090 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 37669fbe13614892a9b8cc2df4e10b4a (DEFAULT_TABLE table=default.Table_678f98b781d743d7a90db47d1a9bcb58 [id=c4f2acb80d99427b9232dc5e56d3365b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.923130 6123 tablet_service.cc:1467] Processing CreateTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f (DEFAULT_TABLE table=default.Table_861e45cccda8422f9bcc2ecb56c0da0f [id=2ac5e881f6e94b97a08cc5e7da381a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.923458 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf7a87b82424e25ae47d3f61c2ddb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.923849 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 25a2f20766024978a16b6bccd366a848 (DEFAULT_TABLE table=default.Table_0c283584d125415e848f4d61a2838a78 [id=2ce72178b0904798a75a6e756700bd26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.924873 5852 tablet_service.cc:1467] Processing CreateTablet for tablet a908ac5d44a74c05b35f6853ab769d91 (DEFAULT_TABLE table=default.Table_f3ec53daf068417ea2f10390d2736b66 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.925169 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 37669fbe13614892a9b8cc2df4e10b4a (DEFAULT_TABLE table=default.Table_678f98b781d743d7a90db47d1a9bcb58 [id=c4f2acb80d99427b9232dc5e56d3365b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.925890 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37669fbe13614892a9b8cc2df4e10b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.926440 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.926631 5859 tablet_service.cc:1467] Processing CreateTablet for tablet c1a659100a124506a411c929ddc31f10 (DEFAULT_TABLE table=default.Table_bab2604ba651431d8828e6a78a445930 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.926741 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 25a2f20766024978a16b6bccd366a848 (DEFAULT_TABLE table=default.Table_0c283584d125415e848f4d61a2838a78 [id=2ce72178b0904798a75a6e756700bd26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.926764 6129 tablet_service.cc:1467] Processing CreateTablet for tablet cc2990e37a9648669eb39a865392c9e7 (DEFAULT_TABLE table=default.Table_63fc7a3742ea42e28b3a0bb25584c00f [id=64216505cc384325a82a0907c922af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.927103 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25a2f20766024978a16b6bccd366a848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.927160 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 871fb70fea304b08bebce18c60998209 (DEFAULT_TABLE table=default.Table_2df1933315314f7394f4f47e678c4645 [id=3888c975417043cb8b36d7b70c48e612]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.927572 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 3b2cabf659dc48028605b39c92e1e451 (DEFAULT_TABLE table=default.Table_f60af5c4c3ac4b139003d1d9f56268d0 [id=3daf4c7bcf784fb0948e743ecec939ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.927990 6121 tablet_service.cc:1467] Processing CreateTablet for tablet a908ac5d44a74c05b35f6853ab769d91 (DEFAULT_TABLE table=default.Table_f3ec53daf068417ea2f10390d2736b66 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.928067 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 75e19b8189894e91a8be5a150f54cb6b (DEFAULT_TABLE table=default.Table_5aca2d8635034ce69a07c97d997a2c86 [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:59.918730 6577 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46336: Illegal state: RaftConsensus is not running: State = Stopped
I20260928 10:43:59.928932 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 5afe4501ea584d44b511b89983e210e3 (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.929700 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 75539c390965493eaa69a0d1215fa922 (DEFAULT_TABLE table=default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.929941 6270 ts_tablet_manager.cc:1905] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:43:59.930907 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871fb70fea304b08bebce18c60998209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.931912 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 59c67a02d7f84bed9c440c8c451ea4ff (DEFAULT_TABLE table=default.Table_ad2135ad3d3e47d38c8f863737165aea [id=5da24947876c4b628eb01c54da1c3347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.933171 5850 tablet_service.cc:1467] Processing CreateTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 (DEFAULT_TABLE table=default.Table_aae329bcf05349da8b851e709092bed2 [id=2f4692f3be284f3c81ec608ace7d6d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.933987 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 3c67f960eb84426f9ebdfef33306a9d0 (DEFAULT_TABLE table=default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.934918 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0584d6b80e43eb913c3932256cd89e (DEFAULT_TABLE table=default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.934461 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b2cabf659dc48028605b39c92e1e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.936029 5864 tablet_service.cc:1467] Processing CreateTablet for tablet a3a69d7cdda844c38fcd6a32604aecb6 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.936467 6273 ts_tablet_manager.cc:1428] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260928 10:43:59.938133 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a908ac5d44a74c05b35f6853ab769d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.938714 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2990e37a9648669eb39a865392c9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.942257 6270 ts_tablet_manager.cc:1918] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:43:59.942462 6270 log.cc:1196] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a8c53e9be06f4d1aa0fc7eaef2c10303
I20260928 10:43:59.942826 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf7a87b82424e25ae47d3f61c2ddb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.943112 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe0dd05136840ee91d0b2a415ad49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.943513 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7aa301bfbb4097b386a0d23cfa91e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.944084 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c67f960eb84426f9ebdfef33306a9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.944344 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e19b8189894e91a8be5a150f54cb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.944612 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25a2f20766024978a16b6bccd366a848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.944809 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75539c390965493eaa69a0d1215fa922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.945000 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afe4501ea584d44b511b89983e210e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.945199 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871fb70fea304b08bebce18c60998209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.945444 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2990e37a9648669eb39a865392c9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.948994 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a908ac5d44a74c05b35f6853ab769d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.949219 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37669fbe13614892a9b8cc2df4e10b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.950990 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c67a02d7f84bed9c440c8c451ea4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.952365 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0584d6b80e43eb913c3932256cd89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.953372 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 75539c390965493eaa69a0d1215fa922 (DEFAULT_TABLE table=default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.953600 6202 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:43:59.954627 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75539c390965493eaa69a0d1215fa922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.955231 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 3b2cabf659dc48028605b39c92e1e451 (DEFAULT_TABLE table=default.Table_f60af5c4c3ac4b139003d1d9f56268d0 [id=3daf4c7bcf784fb0948e743ecec939ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.955626 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b2cabf659dc48028605b39c92e1e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.956914 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8b0aee4f49a44bb7bf19b28d96040e65 (table default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]) successfully deleted
W20260928 10:43:59.957219 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c2635c7c47ba4383b6b0f07cd3b42f74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2635c7c47ba4383b6b0f07cd3b42f74 already in progress: creating tablet
W20260928 10:43:59.957494 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c5c1a1c5e22e455d91de92f0aa3535c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c1a1c5e22e455d91de92f0aa3535c7 already in progress: creating tablet
I20260928 10:43:59.957772 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 75e19b8189894e91a8be5a150f54cb6b (DEFAULT_TABLE table=default.Table_5aca2d8635034ce69a07c97d997a2c86 [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:43:59.957897 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 01433ce37b2c49cd858ea88877ca56da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01433ce37b2c49cd858ea88877ca56da already in progress: creating tablet
W20260928 10:43:59.958148 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e25db69b15eb445792e6168f99304bf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25db69b15eb445792e6168f99304bf2 already in progress: creating tablet
I20260928 10:43:59.958313 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e19b8189894e91a8be5a150f54cb6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:43:59.958312 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 67f29acce3604e458d1981aad87f2eb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f29acce3604e458d1981aad87f2eb9 already in progress: creating tablet
W20260928 10:43:59.958657 5687 catalog_manager.cc:4920] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): alter failed for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]): Illegal state: RaftConsensus is not running: State = Stopped
I20260928 10:43:59.958796 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 37669fbe13614892a9b8cc2df4e10b4a (DEFAULT_TABLE table=default.Table_678f98b781d743d7a90db47d1a9bcb58 [id=c4f2acb80d99427b9232dc5e56d3365b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.959144 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37669fbe13614892a9b8cc2df4e10b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.962369 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 25a2f20766024978a16b6bccd366a848 (DEFAULT_TABLE table=default.Table_0c283584d125415e848f4d61a2838a78 [id=2ce72178b0904798a75a6e756700bd26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.962814 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 5afe4501ea584d44b511b89983e210e3 (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.963069 5995 tablet_service.cc:1467] Processing CreateTablet for tablet a908ac5d44a74c05b35f6853ab769d91 (DEFAULT_TABLE table=default.Table_f3ec53daf068417ea2f10390d2736b66 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.963380 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 75539c390965493eaa69a0d1215fa922 (DEFAULT_TABLE table=default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.963625 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.963860 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 59c67a02d7f84bed9c440c8c451ea4ff (DEFAULT_TABLE table=default.Table_ad2135ad3d3e47d38c8f863737165aea [id=5da24947876c4b628eb01c54da1c3347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.964030 5988 tablet_service.cc:1467] Processing CreateTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f (DEFAULT_TABLE table=default.Table_861e45cccda8422f9bcc2ecb56c0da0f [id=2ac5e881f6e94b97a08cc5e7da381a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.964062 5984 tablet_service.cc:1467] Processing CreateTablet for tablet c1a659100a124506a411c929ddc31f10 (DEFAULT_TABLE table=default.Table_bab2604ba651431d8828e6a78a445930 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.964214 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 3c67f960eb84426f9ebdfef33306a9d0 (DEFAULT_TABLE table=default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.964322 5994 tablet_service.cc:1467] Processing CreateTablet for tablet cc2990e37a9648669eb39a865392c9e7 (DEFAULT_TABLE table=default.Table_63fc7a3742ea42e28b3a0bb25584c00f [id=64216505cc384325a82a0907c922af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.964636 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0584d6b80e43eb913c3932256cd89e (DEFAULT_TABLE table=default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.965025 6000 tablet_service.cc:1467] Processing CreateTablet for tablet a3a69d7cdda844c38fcd6a32604aecb6 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:43:59.962813 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25a2f20766024978a16b6bccd366a848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.965370 6271 tablet_bootstrap.cc:654] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:43:59.969118 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a908ac5d44a74c05b35f6853ab769d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.970749 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c67a02d7f84bed9c440c8c451ea4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.974447 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0584d6b80e43eb913c3932256cd89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.977244 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe0dd05136840ee91d0b2a415ad49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.979161 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3a69d7cdda844c38fcd6a32604aecb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.982724 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c67f960eb84426f9ebdfef33306a9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.986197 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf7a87b82424e25ae47d3f61c2ddb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.986699 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2990e37a9648669eb39a865392c9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.990157 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1a659100a124506a411c929ddc31f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:43:59.990859 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dd487bf423e44aa3b7c72ea54b5f2283" } modify_external_catalogs: true
I20260928 10:43:59.991122 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dd487bf423e44aa3b7c72ea54b5f2283" } modify_external_catalogs: true
I20260928 10:43:59.994831 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b577808dfde24cf88b354b7f3e01eb74" } modify_external_catalogs: true
I20260928 10:43:59.994935 6270 ts_tablet_manager.cc:1939] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:43:59.995019 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b577808dfde24cf88b354b7f3e01eb74" } modify_external_catalogs: true
I20260928 10:44:00.000010 6601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=9 ignored=0} inserts{seen=13 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260928 10:44:00.000561 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75539c390965493eaa69a0d1215fa922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.001273 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afe4501ea584d44b511b89983e210e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.004117 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:44:00.004221 6601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: Bootstrap complete.
I20260928 10:44:00.005077 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:00.005436 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 98bd99e7bdb647ceb9357f88affc45d9 deleted and replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7
I20260928 10:44:00.005761 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8a3443d4c6674342b4124156414dcc13
I20260928 10:44:00.010289 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 92912af8cba4453a8e3422896d586855 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.011353 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9f429f420bbd495c91b854218a0a06f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.011948 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f429f420bbd495c91b854218a0a06f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.019523 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4b6db38f77f64cfe9a7802d5307aa949
I20260928 10:44:00.019604 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:00.020004 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 4b6db38f77f64cfe9a7802d5307aa949 deleted and replaced by tablet adb1f2e6392b4329b5520d0e292d6f98
I20260928 10:44:00.025184 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_31d8e5b8c5614bee809b95acf1d8492f" } new_table_name: "default.Table_72cd726d99714c50bae48be33c177076" modify_external_catalogs: true
I20260928 10:44:00.025411 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_22bfb6af239a4abea551a6d34e6453d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.025977 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22bfb6af239a4abea551a6d34e6453d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.026557 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7cdd96b23534cf9a61ec1e66e419155" } modify_external_catalogs: true
I20260928 10:44:00.026750 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7cdd96b23534cf9a61ec1e66e419155" } modify_external_catalogs: true
I20260928 10:44:00.028855 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:00.029122 5687 catalog_manager.cc:4914] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): alter failed for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]),no further retry: Not found: Tablet not found: a8c53e9be06f4d1aa0fc7eaef2c10303
I20260928 10:44:00.029211 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:00.029197 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.029403 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.029683 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.029925 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.030768 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]) successfully deleted
I20260928 10:44:00.031039 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:00.031562 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1ba8abd00f2742a29fdc79059332b91d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ba8abd00f2742a29fdc79059332b91d already in progress: creating tablet
I20260928 10:44:00.031705 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 59c67a02d7f84bed9c440c8c451ea4ff (DEFAULT_TABLE table=default.Table_ad2135ad3d3e47d38c8f863737165aea [id=5da24947876c4b628eb01c54da1c3347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.032192 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c67a02d7f84bed9c440c8c451ea4ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:00.033679 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c1e7257c8b114e80853ff0a108d2998a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1e7257c8b114e80853ff0a108d2998a already in progress: creating tablet
W20260928 10:44:00.034428 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 54b78fbf508f4e47bd31661e05dcaa16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b78fbf508f4e47bd31661e05dcaa16 already in progress: creating tablet
I20260928 10:44:00.034580 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 92912af8cba4453a8e3422896d586855
I20260928 10:44:00.035099 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 92912af8cba4453a8e3422896d586855 deleted and replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621
I20260928 10:44:00.036382 6270 tablet_replica.cc:330] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:00.036657 6270 raft_consensus.cc:2229] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.036933 6270 raft_consensus.cc:2258] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.037859 6270 ts_tablet_manager.cc:1905] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.038353 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 92912af8cba4453a8e3422896d586855 with delete_type TABLET_DATA_DELETED (replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:00.040802 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8242d0647d1b4f28a5f1ccf36b00d616 consensus state has no leader
I20260928 10:44:00.042694 6130 tablet_service.cc:1467] Processing CreateTablet for tablet c1a659100a124506a411c929ddc31f10 (DEFAULT_TABLE table=default.Table_bab2604ba651431d8828e6a78a445930 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.045049 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1a6ada6f154c48509e5e70d57c95377c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.045760 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a6ada6f154c48509e5e70d57c95377c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.046772 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.047334 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.049062 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ddb5219dc9654884a3cb905f60474969"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.049708 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddb5219dc9654884a3cb905f60474969 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.047106 6601 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:44:00.053048 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_771449d5cc0d4eb2b2ed9241efa22ed6" } new_table_name: "default.Table_1f7d2400d1014db09fdc8caf288adcd4" modify_external_catalogs: true
I20260928 10:44:00.056535 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bcf12c0441964bec8f8b7d378ca8977f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.057163 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcf12c0441964bec8f8b7d378ca8977f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.057518 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 85583238d6b54f1d89ff5b53b40e73bb
I20260928 10:44:00.058329 6270 ts_tablet_manager.cc:1918] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.058935 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.059454 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.060881 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.063141 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 75e19b8189894e91a8be5a150f54cb6b (DEFAULT_TABLE table=default.Table_5aca2d8635034ce69a07c97d997a2c86 [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.059196 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.063973 6270 log.cc:1196] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f57cd5585604424d92b8ce2522085567
I20260928 10:44:00.064872 6270 ts_tablet_manager.cc:1939] T f57cd5585604424d92b8ce2522085567 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:00.065415 6601 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2eb817eda984ab99ec4704c47699846, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.067338 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d06d706cc34a4fa4b92c2db3952f39f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.067951 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d06d706cc34a4fa4b92c2db3952f39f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.067528 6601 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:44:00.068383 6575 raft_consensus.cc:482] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.068580 6575 raft_consensus.cc:504] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.069350 6575 leader_election.cc:288] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.069253 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7265fb6e45c84eb5b54864c269f7f0d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.069772 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7265fb6e45c84eb5b54864c269f7f0d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.070969 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_764ce3d2e3fd4daab9c2f8859b5ddfe8" } new_table_name: "default.Table_a8807488d3d1426ea48e12acc8a1dcfc" modify_external_catalogs: true
I20260928 10:44:00.072387 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fcaab1ce2ab54b4e803c360b710e12fd" } new_table_name: "default.Table_06078e7cac34487a94b8b2e5291896bb" modify_external_catalogs: true
I20260928 10:44:00.074184 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f57cd5585604424d92b8ce2522085567 (table default.Table_333faec6e5864a4982d5c0743c880176 [id=6c9610724d3341d193cf34cdee8780b7]) successfully deleted
W20260928 10:44:00.081485 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9e05cdd590894adcb987ef3ac78bf416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e05cdd590894adcb987ef3ac78bf416 already in progress: creating tablet
W20260928 10:44:00.085665 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3cb9c554d363441b8006abc2d9bdd856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cb9c554d363441b8006abc2d9bdd856 already in progress: creating tablet
W20260928 10:44:00.089179 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d64c1af58d6a4dfcabd6eecb8c75d572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d64c1af58d6a4dfcabd6eecb8c75d572 already in progress: creating tablet
I20260928 10:44:00.091208 6270 tablet_replica.cc:330] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:00.091770 6270 raft_consensus.cc:2229] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.092289 6270 raft_consensus.cc:2258] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.093772 6270 ts_tablet_manager.cc:1905] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.100414 6612 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:00.101696 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1a659100a124506a411c929ddc31f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.102092 6612 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:44:00.103957 6582 raft_consensus.cc:482] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.112933 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe0dd05136840ee91d0b2a415ad49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.114866 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3a69d7cdda844c38fcd6a32604aecb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.120926 6269 ts_tablet_manager.cc:1918] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.122007 6601 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 10:44:00.124927 6582 raft_consensus.cc:504] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.125569 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.126027 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.129524 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 3c67f960eb84426f9ebdfef33306a9d0 (DEFAULT_TABLE table=default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.135216 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 5afe4501ea584d44b511b89983e210e3 (DEFAULT_TABLE table=default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.138027 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0584d6b80e43eb913c3932256cd89e (DEFAULT_TABLE table=default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.144382 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e19b8189894e91a8be5a150f54cb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.147352 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16f7d561b10e46609f22ce17b323fb23" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.143455 6133 tablet_service.cc:1467] Processing CreateTablet for tablet a3a69d7cdda844c38fcd6a32604aecb6 (DEFAULT_TABLE table=default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.148207 6275 tablet_bootstrap.cc:492] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.150146 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c93507a0bf14c8383794b34ba1702fd with delete_type TABLET_DATA_DELETED (replaced by tablet 0e9583b5637a428db383320d98a7a280) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.156724 6272 tablet_replica.cc:330] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:00.156975 6272 raft_consensus.cc:2229] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.157168 6272 raft_consensus.cc:2258] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.158869 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_67cf9eac75a94f95a5dc8a009d27f6b3" } new_table_name: "default.Table_2e92501b07184f8d9021b31cc4f752fb" modify_external_catalogs: true
I20260928 10:44:00.159169 6272 ts_tablet_manager.cc:1905] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.159596 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e40f72ff466e4befb74290fd39285119" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.159766 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eb4c3825bbaa466480697ebfb8b81161"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.160362 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb4c3825bbaa466480697ebfb8b81161 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.160614 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0584d6b80e43eb913c3932256cd89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.160933 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3a69d7cdda844c38fcd6a32604aecb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.161206 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afe4501ea584d44b511b89983e210e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.161523 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c67f960eb84426f9ebdfef33306a9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.174257 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1a659100a124506a411c929ddc31f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.129372 6273 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.129477 6269 log.cc:1196] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/10f6f7476c814e0a9abf56b23c1e547d
I20260928 10:44:00.142225 6582 leader_election.cc:288] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:00.186317 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16510244612242f796910cf28e367da9 consensus state has no leader
I20260928 10:44:00.202080 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.205894 6275 ts_tablet_manager.cc:1397] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.307s user 0.018s sys 0.013s
I20260928 10:44:00.208057 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_752e3c917c88427c89c7b474aa6e2142" } modify_external_catalogs: true
I20260928 10:44:00.208734 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_752e3c917c88427c89c7b474aa6e2142" } modify_external_catalogs: true
I20260928 10:44:00.208549 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0d36f9f8ba214574854051d92467ff92" } modify_external_catalogs: true
I20260928 10:44:00.209318 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0d36f9f8ba214574854051d92467ff92" } modify_external_catalogs: true
I20260928 10:44:00.214592 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.209861 6275 raft_consensus.cc:348] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.219153 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.221700 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d06d706cc34a4fa4b92c2db3952f39f3" } modify_external_catalogs: true
I20260928 10:44:00.221942 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d06d706cc34a4fa4b92c2db3952f39f3" } modify_external_catalogs: true
I20260928 10:44:00.223483 6275 raft_consensus.cc:374] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.228339 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.228855 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.230412 6275 raft_consensus.cc:729] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.231243 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b2cabf659dc48028605b39c92e1e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.231626 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ccc54fc0e3d24f22a89149b227256f81" } modify_external_catalogs: true
I20260928 10:44:00.231850 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ccc54fc0e3d24f22a89149b227256f81" } modify_external_catalogs: true
I20260928 10:44:00.233114 6275 consensus_queue.cc:260] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.233737 6275 ts_tablet_manager.cc:1428] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260928 10:44:00.237599 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_701859c27b854998933b0dd33fe2a2a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.238226 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_701859c27b854998933b0dd33fe2a2a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.242547 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.245263 6275 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.245517 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.245533 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9afdecc58f0a43359450f328ef0633f5" } new_table_name: "default.Table_eda004e06ddd4668bbe3d0d4838c4578" modify_external_catalogs: true
I20260928 10:44:00.245579 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.246126 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.244517 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.246166 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:00.249398 5817 leader_election.cc:341] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:00.249614 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 89189.9us
I20260928 10:44:00.250542 6582 raft_consensus.cc:482] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.250715 6582 raft_consensus.cc:504] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.251411 6582 leader_election.cc:288] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.252189 6269 ts_tablet_manager.cc:1939] T 10f6f7476c814e0a9abf56b23c1e547d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:00.254598 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 10f6f7476c814e0a9abf56b23c1e547d (table default.Table_d567147d0d8c4ca4a12c66f2646477de [id=8780ec83a2e047bb8d762c1bc472e96e]) successfully deleted
W20260928 10:44:00.254938 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e25db69b15eb445792e6168f99304bf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25db69b15eb445792e6168f99304bf2 already in progress: creating tablet
W20260928 10:44:00.255146 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d64c1af58d6a4dfcabd6eecb8c75d572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d64c1af58d6a4dfcabd6eecb8c75d572 already in progress: creating tablet
I20260928 10:44:00.255476 6582 raft_consensus.cc:482] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.255633 6582 raft_consensus.cc:504] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.256569 6582 leader_election.cc:288] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.257256 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.261494 6269 tablet_replica.cc:330] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:00.262550 6269 raft_consensus.cc:2229] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.262822 6269 raft_consensus.cc:2258] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:00.263059 5955 consensus_peers.cc:487] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:00.263688 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 92912af8cba4453a8e3422896d586855 with delete_type TABLET_DATA_DELETED (replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:00.266846 5957 leader_election.cc:341] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 16f7d561b10e46609f22ce17b323fb23
I20260928 10:44:00.267953 6269 ts_tablet_manager.cc:1905] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:00.268735 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 114486us
W20260928 10:44:00.269639 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 160716us
W20260928 10:44:00.271859 5955 leader_election.cc:341] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.274690 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e40f72ff466e4befb74290fd39285119" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.275302 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28eb4bef35cc413ebbdc177de1d7b057" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.275609 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4528bf643664da29496849c94e6dd2e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:00.276319 5818 leader_election.cc:341] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.276486 5818 leader_election.cc:302] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:00.276865 5818 leader_election.cc:341] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.276996 6273 tablet_bootstrap.cc:654] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:00.277069 5818 leader_election.cc:341] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.278071 5955 leader_election.cc:302] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:00.278138 6582 raft_consensus.cc:2726] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.281486 6575 raft_consensus.cc:2726] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.298606 6575 consensus_queue.cc:1035] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:00.299504 6271 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:00.299743 6271 ts_tablet_manager.cc:1397] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.465s user 0.057s sys 0.068s
I20260928 10:44:00.301119 6271 raft_consensus.cc:348] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.301561 6271 raft_consensus.cc:374] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.301709 6271 raft_consensus.cc:729] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.302743 6271 consensus_queue.cc:260] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.308013 6270 ts_tablet_manager.cc:1918] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.308190 6270 log.cc:1196] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/cf9361a96fdc44d7ac38a1d0d812eac0
I20260928 10:44:00.308606 6270 ts_tablet_manager.cc:1939] T cf9361a96fdc44d7ac38a1d0d812eac0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:00.309098 6271 ts_tablet_manager.cc:1428] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:44:00.309715 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet cf9361a96fdc44d7ac38a1d0d812eac0 (table default.Table_d317ef6e443b4c10b5972fe1ad8e93ea [id=d8bb5aee4ea44ee3b1eb058e062c389d]) successfully deleted
I20260928 10:44:00.313741 6271 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:00.318107 6271 tablet_bootstrap.cc:654] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.319600 6273 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.320713 6273 ts_tablet_manager.cc:1397] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.364s user 0.003s sys 0.007s
W20260928 10:44:00.323980 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efa178fc1e344069b086003d39f1b848 consensus state has no leader
W20260928 10:44:00.324759 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed7cd14e0039402ea51f34e8b88e2605 has no consensus state
I20260928 10:44:00.325120 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4f6a4e302e974b1eb5f7a129221e1d6f" } modify_external_catalogs: true
I20260928 10:44:00.325373 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4f6a4e302e974b1eb5f7a129221e1d6f" } modify_external_catalogs: true
I20260928 10:44:00.323508 6273 raft_consensus.cc:348] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.325942 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a8e76b8804da448caf6371b096913891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.326205 6273 raft_consensus.cc:374] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.326336 6273 raft_consensus.cc:729] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:00.326555 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8e76b8804da448caf6371b096913891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.327838 6273 consensus_queue.cc:260] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.328027 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.327077 6269 ts_tablet_manager.cc:1918] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:00.328204 6269 log.cc:1196] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a8c53e9be06f4d1aa0fc7eaef2c10303
I20260928 10:44:00.330616 6269 ts_tablet_manager.cc:1939] T a8c53e9be06f4d1aa0fc7eaef2c10303 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:00.331341 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]) successfully deleted
I20260928 10:44:00.331867 6273 ts_tablet_manager.cc:1428] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:44:00.332211 6273 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.338779 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 96cc330167fa476a91a05be3f7e753e0 (DEFAULT_TABLE table=default.Table_bf2c9b1add4648609ed27c8ce7eaa68c [id=e7c7cf56a9574328b86d27598281c40b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.339537 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cc330167fa476a91a05be3f7e753e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.340662 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 2d71edffecf044ba9cec14a70683a56f (DEFAULT_TABLE table=default.Table_47dbd199fad2491596114b4eefdb2b68 [id=b79d417448e74edd9a9155b79a77f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.341147 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d71edffecf044ba9cec14a70683a56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.344270 5863 tablet_service.cc:1467] Processing CreateTablet for tablet e9e0bac650904b8f81474ba2dac9c04f (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.344679 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e0bac650904b8f81474ba2dac9c04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.346752 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 (DEFAULT_TABLE table=default.Table_78298d55e7474d6da0c4ea464abb2b15 [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.347162 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 383eb18f1c0c46209ff5b47e468b9950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.348459 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 (DEFAULT_TABLE table=default.Table_b2d22c89014245869ff6b541065015ed [id=94470e00e4224cc8b417e3356ffe1dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.348958 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b58d0c904a423f9801a883a2a2dfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.349577 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (DEFAULT_TABLE table=default.Table_3bfd977507e84edebfadab9cc567bd3f [id=5b8a74dc9dfd4b2685d2d688454e9670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.350035 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.350705 5852 tablet_service.cc:1467] Processing CreateTablet for tablet f5a00b74133a406996820adcb71194df (DEFAULT_TABLE table=default.Table_e3bfd4162a934aa88b977518be6ad38b [id=0f450c671cde42699489fc5d5f4a99c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.350965 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (DEFAULT_TABLE table=default.Table_818fbd013f2146f58d27d364c7e9e410 [id=43fdc25832e9430e9b57f1dd89d59301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.351082 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5a00b74133a406996820adcb71194df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.351120 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 96cc330167fa476a91a05be3f7e753e0 (DEFAULT_TABLE table=default.Table_bf2c9b1add4648609ed27c8ce7eaa68c [id=e7c7cf56a9574328b86d27598281c40b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.351320 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b67cd4597914a1483fe2bad4de4a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.351765 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cc330167fa476a91a05be3f7e753e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.354907 5996 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cd14e0039402ea51f34e8b88e2605 (DEFAULT_TABLE table=default.Table_06078e7cac34487a94b8b2e5291896bb [id=4f40ed0655ac4f5ebe6585bbe58b6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.355610 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cd14e0039402ea51f34e8b88e2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.356961 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 57b7976063024775b9dde91b32010754 (DEFAULT_TABLE table=default.Table_18ea40c9c4d247179baafb67f810b161 [id=57eb67151ca647bf9621b98e90aa2a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.357651 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b7976063024775b9dde91b32010754. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:00.358687 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet efa178fc1e344069b086003d39f1b848 (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet efa178fc1e344069b086003d39f1b848 consensus state has no leader
I20260928 10:44:00.362061 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 92912af8cba4453a8e3422896d586855 with delete_type TABLET_DATA_DELETED (replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.363787 5984 tablet_service.cc:1467] Processing CreateTablet for tablet e9e0bac650904b8f81474ba2dac9c04f (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.364245 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e0bac650904b8f81474ba2dac9c04f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:00.365273 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 463cf5ecb52d40069b564698433c6781 consensus state has no leader
I20260928 10:44:00.366997 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b8e5fedeb2f242fca078d64788bf6c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.367627 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8e5fedeb2f242fca078d64788bf6c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.368808 6118 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cd14e0039402ea51f34e8b88e2605 (DEFAULT_TABLE table=default.Table_06078e7cac34487a94b8b2e5291896bb [id=4f40ed0655ac4f5ebe6585bbe58b6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.369088 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (DEFAULT_TABLE table=default.Table_3bfd977507e84edebfadab9cc567bd3f [id=5b8a74dc9dfd4b2685d2d688454e9670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.370776 5857 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cd14e0039402ea51f34e8b88e2605 (DEFAULT_TABLE table=default.Table_06078e7cac34487a94b8b2e5291896bb [id=4f40ed0655ac4f5ebe6585bbe58b6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.372546 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cd14e0039402ea51f34e8b88e2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.374581 5999 tablet_service.cc:1467] Processing CreateTablet for tablet f5a00b74133a406996820adcb71194df (DEFAULT_TABLE table=default.Table_e3bfd4162a934aa88b977518be6ad38b [id=0f450c671cde42699489fc5d5f4a99c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.374945 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5a00b74133a406996820adcb71194df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.375478 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 (DEFAULT_TABLE table=default.Table_b2d22c89014245869ff6b541065015ed [id=94470e00e4224cc8b417e3356ffe1dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.378517 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 (DEFAULT_TABLE table=default.Table_78298d55e7474d6da0c4ea464abb2b15 [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.379729 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 2d71edffecf044ba9cec14a70683a56f (DEFAULT_TABLE table=default.Table_47dbd199fad2491596114b4eefdb2b68 [id=b79d417448e74edd9a9155b79a77f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.380195 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (DEFAULT_TABLE table=default.Table_3bfd977507e84edebfadab9cc567bd3f [id=5b8a74dc9dfd4b2685d2d688454e9670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.382544 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 383eb18f1c0c46209ff5b47e468b9950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.382588 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7c7420744fac446aa019cdc18caea501"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.383158 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c7420744fac446aa019cdc18caea501 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.383177 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d71edffecf044ba9cec14a70683a56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.384488 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (DEFAULT_TABLE table=default.Table_818fbd013f2146f58d27d364c7e9e410 [id=43fdc25832e9430e9b57f1dd89d59301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.389640 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28eb4bef35cc413ebbdc177de1d7b057" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.391634 5817 leader_election.cc:341] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.391795 5817 leader_election.cc:302] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:00.392302 6582 raft_consensus.cc:2726] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.370590 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4528bf643664da29496849c94e6dd2e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.393358 5817 leader_election.cc:341] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.393474 5817 leader_election.cc:302] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:00.393875 6582 raft_consensus.cc:2726] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.394332 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.395744 5694 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet cf5cac3f157343db903fefbeabc97f0d
I20260928 10:44:00.395685 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 2d71edffecf044ba9cec14a70683a56f (DEFAULT_TABLE table=default.Table_47dbd199fad2491596114b4eefdb2b68 [id=b79d417448e74edd9a9155b79a77f61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.395332 6132 tablet_service.cc:1467] Processing CreateTablet for tablet e9e0bac650904b8f81474ba2dac9c04f (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.398487 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.399575 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.399758 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 (DEFAULT_TABLE table=default.Table_78298d55e7474d6da0c4ea464abb2b15 [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.400105 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (DEFAULT_TABLE table=default.Table_818fbd013f2146f58d27d364c7e9e410 [id=43fdc25832e9430e9b57f1dd89d59301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.401908 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_876356586bbc4fa09b7cd43884e6ff24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.398375 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 96cc330167fa476a91a05be3f7e753e0 (DEFAULT_TABLE table=default.Table_bf2c9b1add4648609ed27c8ce7eaa68c [id=e7c7cf56a9574328b86d27598281c40b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.402333 6124 tablet_service.cc:1467] Processing CreateTablet for tablet f5a00b74133a406996820adcb71194df (DEFAULT_TABLE table=default.Table_e3bfd4162a934aa88b977518be6ad38b [id=0f450c671cde42699489fc5d5f4a99c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:00.402540 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_876356586bbc4fa09b7cd43884e6ff24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.392961 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 57b7976063024775b9dde91b32010754 (DEFAULT_TABLE table=default.Table_18ea40c9c4d247179baafb67f810b161 [id=57eb67151ca647bf9621b98e90aa2a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.407320 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cd14e0039402ea51f34e8b88e2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.405194 6525 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.10->[1.11-1.467] Dedup: 1.14->[1.15-1.467]
W20260928 10:44:00.409727 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d40123712b17464e87023f69a6235640 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d40123712b17464e87023f69a6235640 already in progress: creating tablet
I20260928 10:44:00.409794 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d71edffecf044ba9cec14a70683a56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.410087 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b67cd4597914a1483fe2bad4de4a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.410290 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cc330167fa476a91a05be3f7e753e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.410874 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 57b7976063024775b9dde91b32010754 (DEFAULT_TABLE table=default.Table_18ea40c9c4d247179baafb67f810b161 [id=57eb67151ca647bf9621b98e90aa2a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.411252 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b58d0c904a423f9801a883a2a2dfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.413280 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b7976063024775b9dde91b32010754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.414220 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b67cd4597914a1483fe2bad4de4a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.416442 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 (DEFAULT_TABLE table=default.Table_b2d22c89014245869ff6b541065015ed [id=94470e00e4224cc8b417e3356ffe1dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.420303 6269 tablet_replica.cc:330] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:00.427209 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 383eb18f1c0c46209ff5b47e468b9950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.432914 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_67ff90909aa94822929782b78faf711f" } new_table_name: "default.Table_61f4d2d6955a481097b344272b388925" modify_external_catalogs: true
W20260928 10:44:00.434286 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet adb1f2e6392b4329b5520d0e292d6f98 has no consensus state
I20260928 10:44:00.434762 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6cf56fe048a6439b8252398f6bb6e503"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.435011 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b7976063024775b9dde91b32010754. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:00.435338 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cf56fe048a6439b8252398f6bb6e503 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.437884 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b58d0c904a423f9801a883a2a2dfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.440374 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5a00b74133a406996820adcb71194df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.443382 6275 tablet_bootstrap.cc:654] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.444501 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5b4574fdeb284c7993e1f8dc100e9222"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.445122 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b4574fdeb284c7993e1f8dc100e9222 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:00.450299 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 971f8344436f4e60ac0152e811efea8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 971f8344436f4e60ac0152e811efea8d already in progress: creating tablet
I20260928 10:44:00.465839 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e0bac650904b8f81474ba2dac9c04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.471395 6355 consensus_queue.cc:1035] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:00.472106 6269 raft_consensus.cc:2229] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.475868 6269 raft_consensus.cc:2258] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.476404 6269 ts_tablet_manager.cc:1905] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.498133 6270 tablet_replica.cc:330] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:00.498529 6270 raft_consensus.cc:2229] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.499979 6575 raft_consensus.cc:482] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.501022 6575 raft_consensus.cc:504] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.501678 6575 leader_election.cc:288] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.502406 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:00.503053 6272 ts_tablet_manager.cc:1918] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.503111 6270 raft_consensus.cc:2258] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.503679 6270 ts_tablet_manager.cc:1905] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.511538 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.512401 5955 leader_election.cc:341] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.512394 5883 raft_consensus.cc:2454] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:00.513167 5957 leader_election.cc:302] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:00.514041 5883 raft_consensus.cc:1261] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 4dab87557ec9445dbe35ea05e3561a94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:00.514858 6355 consensus_queue.cc:1035] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:00.515993 6575 raft_consensus.cc:2781] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:00.516129 6575 raft_consensus.cc:482] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:00.516207 6575 raft_consensus.cc:3037] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:00.518051 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 45a00a2c4692459cbdd0628af0184f09
I20260928 10:44:00.519497 6575 raft_consensus.cc:504] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.520421 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:00.521129 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:00.521772 5955 leader_election.cc:341] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.522053 6575 leader_election.cc:288] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.523422 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_afd6eb9c78464f419465f6375df9d5cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.523648 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_81202df4ff1046078af574bab4d9d26f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.524085 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afd6eb9c78464f419465f6375df9d5cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.524132 6272 log.cc:1196] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4c93507a0bf14c8383794b34ba1702fd
W20260928 10:44:00.524087 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81202df4ff1046078af574bab4d9d26f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.526243 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.526614 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.528682 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:00.529265 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet bd225da0b4b445c6ac03634d975e8396 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.529764 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet efa178fc1e344069b086003d39f1b848 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.531291 6272 ts_tablet_manager.cc:1939] T 4c93507a0bf14c8383794b34ba1702fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:00.531683 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.534795 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4c93507a0bf14c8383794b34ba1702fd (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
W20260928 10:44:00.535194 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 39cbecd1c19541f28bd32b7c46f2df61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39cbecd1c19541f28bd32b7c46f2df61 already in progress: creating tablet
I20260928 10:44:00.535794 6271 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
W20260928 10:44:00.535938 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 98bd99e7bdb647ceb9357f88affc45d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98bd99e7bdb647ceb9357f88affc45d9 already in progress: creating tablet
W20260928 10:44:00.536139 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4b6db38f77f64cfe9a7802d5307aa949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b6db38f77f64cfe9a7802d5307aa949 already in progress: creating tablet
I20260928 10:44:00.536167 6271 ts_tablet_manager.cc:1397] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.222s user 0.020s sys 0.016s
W20260928 10:44:00.536875 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f95e1588a3d04142ab8d6bb257235dab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95e1588a3d04142ab8d6bb257235dab already in progress: creating tablet
W20260928 10:44:00.537094 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet dbd5d1ccd2e54f3884af3af327bb892e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd5d1ccd2e54f3884af3af327bb892e already in progress: creating tablet
W20260928 10:44:00.537299 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 85583238d6b54f1d89ff5b53b40e73bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85583238d6b54f1d89ff5b53b40e73bb already in progress: creating tablet
W20260928 10:44:00.537493 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 92912af8cba4453a8e3422896d586855 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92912af8cba4453a8e3422896d586855 already in progress: creating tablet
I20260928 10:44:00.537364 6271 raft_consensus.cc:348] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:00.537688 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8a3443d4c6674342b4124156414dcc13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3443d4c6674342b4124156414dcc13 already in progress: creating tablet
I20260928 10:44:00.537827 6271 raft_consensus.cc:374] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:00.537890 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 44bc6831f9354ddb81212bc107efdf68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bc6831f9354ddb81212bc107efdf68 already in progress: creating tablet
I20260928 10:44:00.538019 6271 raft_consensus.cc:729] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.538851 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.538343 6271 consensus_queue.cc:260] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.542387 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780707959e0e48d6a83b22e6479a5884" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:00.544237 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.544445 5882 raft_consensus.cc:3037] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:00.544665 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.547942 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:00.548137 6621 log.cc:924] Time spent T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260928 10:44:00.548928 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:00.550380 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:00.551079 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet f1f8e172c5bf406196574895e5e5e3c7 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.554311 5882 raft_consensus.cc:2454] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:00.555529 5957 leader_election.cc:302] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:00.556007 6575 raft_consensus.cc:2781] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:00.556139 6575 raft_consensus.cc:686] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:00.556419 6575 consensus_queue.cc:237] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.538594 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.563297 6271 ts_tablet_manager.cc:1428] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260928 10:44:00.563715 6271 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:00.565402 6271 tablet_bootstrap.cc:654] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.570592 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.573324 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.573694 6270 ts_tablet_manager.cc:1918] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.576104 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:44:00.576715 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 104a223ec6ef47988d0aa3335a1f81de from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.578164 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8c92519ebd044d35b76f6f708668ae19" } new_table_name: "default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9" modify_external_catalogs: true
W20260928 10:44:00.582000 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d22260b5f20d47ad99d612ed5a7c022c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d22260b5f20d47ad99d612ed5a7c022c already in progress: creating tablet
I20260928 10:44:00.583644 6273 tablet_bootstrap.cc:654] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.585659 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.598064 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39]). Expected version 1 got 0
I20260928 10:44:00.598853 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3e98e3a878de4461bb9ad47b99d2ffc0" } new_table_name: "default.Table_534373dcfd75430c9608190a3979421a" modify_external_catalogs: true
W20260928 10:44:00.600870 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 122fbbe54c174c4ea9cf38698debcb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 122fbbe54c174c4ea9cf38698debcb27 already in progress: creating tablet
I20260928 10:44:00.602375 6270 log.cc:1196] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/16f7d561b10e46609f22ce17b323fb23
I20260928 10:44:00.589461 6271 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:00.602711 6271 ts_tablet_manager.cc:1397] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260928 10:44:00.579437 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.604417 6271 raft_consensus.cc:348] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.604691 6271 raft_consensus.cc:374] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.604779 6271 raft_consensus.cc:729] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.605008 6271 consensus_queue.cc:260] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.607918 6269 ts_tablet_manager.cc:1918] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.608116 6269 log.cc:1196] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c4528bf643664da29496849c94e6dd2e
I20260928 10:44:00.608561 6269 ts_tablet_manager.cc:1939] T c4528bf643664da29496849c94e6dd2e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:00.609568 6269 tablet_replica.cc:330] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:00.609736 6270 ts_tablet_manager.cc:1939] T 16f7d561b10e46609f22ce17b323fb23 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:00.609724 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c4528bf643664da29496849c94e6dd2e (table default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]) successfully deleted
I20260928 10:44:00.610836 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 16f7d561b10e46609f22ce17b323fb23 (table default.Table_2e92501b07184f8d9021b31cc4f752fb [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
W20260928 10:44:00.612541 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4b6db38f77f64cfe9a7802d5307aa949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b6db38f77f64cfe9a7802d5307aa949 already in progress: creating tablet
I20260928 10:44:00.614039 6269 raft_consensus.cc:2229] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.614224 6269 raft_consensus.cc:2258] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:00.614255 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8a3443d4c6674342b4124156414dcc13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3443d4c6674342b4124156414dcc13 already in progress: creating tablet
I20260928 10:44:00.614761 6269 ts_tablet_manager.cc:1905] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:00.616969 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f95e1588a3d04142ab8d6bb257235dab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95e1588a3d04142ab8d6bb257235dab already in progress: creating tablet
W20260928 10:44:00.617338 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 98bd99e7bdb647ceb9357f88affc45d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98bd99e7bdb647ceb9357f88affc45d9 already in progress: creating tablet
W20260928 10:44:00.617811 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 39cbecd1c19541f28bd32b7c46f2df61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39cbecd1c19541f28bd32b7c46f2df61 already in progress: creating tablet
W20260928 10:44:00.619160 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet dbd5d1ccd2e54f3884af3af327bb892e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd5d1ccd2e54f3884af3af327bb892e already in progress: creating tablet
W20260928 10:44:00.619638 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 92912af8cba4453a8e3422896d586855 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92912af8cba4453a8e3422896d586855 already in progress: creating tablet
I20260928 10:44:00.622301 6271 ts_tablet_manager.cc:1428] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.019s user 0.004s sys 0.004s
I20260928 10:44:00.622727 6271 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:00.624526 6271 tablet_bootstrap.cc:654] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.627508 6270 tablet_replica.cc:330] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:00.627509 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 85583238d6b54f1d89ff5b53b40e73bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85583238d6b54f1d89ff5b53b40e73bb already in progress: creating tablet
I20260928 10:44:00.628046 6270 raft_consensus.cc:2229] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:00.629545 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 45a00a2c4692459cbdd0628af0184f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a00a2c4692459cbdd0628af0184f09 already in progress: creating tablet
I20260928 10:44:00.631124 6270 raft_consensus.cc:2258] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.632743 6270 ts_tablet_manager.cc:1905] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.633572 6271 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:00.635030 6271 ts_tablet_manager.cc:1397] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260928 10:44:00.635677 6273 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.635921 6273 ts_tablet_manager.cc:1397] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.304s user 0.004s sys 0.005s
I20260928 10:44:00.636729 6275 tablet_bootstrap.cc:492] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.636931 6275 ts_tablet_manager.cc:1397] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.399s user 0.031s sys 0.042s
I20260928 10:44:00.637789 6275 raft_consensus.cc:348] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.638096 6275 raft_consensus.cc:374] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.638255 6275 raft_consensus.cc:729] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.638612 6275 consensus_queue.cc:260] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.636264 6271 raft_consensus.cc:348] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.640530 6271 raft_consensus.cc:374] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.640686 6271 raft_consensus.cc:729] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.642078 6271 consensus_queue.cc:260] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.635728 6269 ts_tablet_manager.cc:1918] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.644613 6269 log.cc:1196] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e40f72ff466e4befb74290fd39285119
I20260928 10:44:00.645627 6269 ts_tablet_manager.cc:1939] T e40f72ff466e4befb74290fd39285119 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:44:00.648554 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb5eed4318fe482789fee32e24a49bfc consensus state has no leader
I20260928 10:44:00.648976 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 9fe0dd05136840ee91d0b2a415ad49fc from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.650040 6271 ts_tablet_manager.cc:1428] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 10:44:00.650548 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e40f72ff466e4befb74290fd39285119 (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
W20260928 10:44:00.652770 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 54b78fbf508f4e47bd31661e05dcaa16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b78fbf508f4e47bd31661e05dcaa16 already in progress: creating tablet
I20260928 10:44:00.636698 6273 raft_consensus.cc:348] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.653573 6273 raft_consensus.cc:374] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.653713 6273 raft_consensus.cc:729] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:00.654117 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c1e7257c8b114e80853ff0a108d2998a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1e7257c8b114e80853ff0a108d2998a already in progress: creating tablet
I20260928 10:44:00.654074 6273 consensus_queue.cc:260] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.654917 6270 ts_tablet_manager.cc:1918] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:00.661053 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9e05cdd590894adcb987ef3ac78bf416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e05cdd590894adcb987ef3ac78bf416 already in progress: creating tablet
I20260928 10:44:00.663192 6269 tablet_replica.cc:330] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:00.663431 6269 raft_consensus.cc:2229] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.663493 6270 log.cc:1196] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/68fe24b61d424274b407327f130bb020
I20260928 10:44:00.663776 6269 raft_consensus.cc:2258] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.663929 6270 ts_tablet_manager.cc:1939] T 68fe24b61d424274b407327f130bb020 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:00.664621 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 68fe24b61d424274b407327f130bb020 (table default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]) successfully deleted
I20260928 10:44:00.658102 6271 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:00.665382 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 44bc6831f9354ddb81212bc107efdf68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bc6831f9354ddb81212bc107efdf68 already in progress: creating tablet
W20260928 10:44:00.665637 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 45a00a2c4692459cbdd0628af0184f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a00a2c4692459cbdd0628af0184f09 already in progress: creating tablet
W20260928 10:44:00.665848 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d22260b5f20d47ad99d612ed5a7c022c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d22260b5f20d47ad99d612ed5a7c022c already in progress: creating tablet
W20260928 10:44:00.666051 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 122fbbe54c174c4ea9cf38698debcb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 122fbbe54c174c4ea9cf38698debcb27 already in progress: creating tablet
I20260928 10:44:00.666728 6271 tablet_bootstrap.cc:654] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.666926 6269 ts_tablet_manager.cc:1905] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.681370 6273 ts_tablet_manager.cc:1428] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20260928 10:44:00.682523 6639 raft_consensus.cc:482] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.682776 5930 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:44:00.682863 6639 raft_consensus.cc:504] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.684108 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c7a51b960f24a2fbc3f0e851c98b9f9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.684819 5955 leader_election.cc:341] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.685547 6639 leader_election.cc:288] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:00.686246 5957 leader_election.cc:341] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 6c7a51b960f24a2fbc3f0e851c98b9f9
I20260928 10:44:00.686388 5957 leader_election.cc:302] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:00.686868 6639 raft_consensus.cc:2726] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:00.694427 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 56984.6us
I20260928 10:44:00.697715 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f1f8e172c5bf406196574895e5e5e3c7
I20260928 10:44:00.698222 5702 catalog_manager.cc:6565] ReplaceTablet: tablet f1f8e172c5bf406196574895e5e5e3c7 deleted and replaced by tablet b1cdff9f01974354a81179dd9bd5a26e
I20260928 10:44:00.698786 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet efa178fc1e344069b086003d39f1b848
I20260928 10:44:00.699236 5697 catalog_manager.cc:6565] ReplaceTablet: tablet efa178fc1e344069b086003d39f1b848 deleted and replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd
I20260928 10:44:00.700117 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b1cdff9f01974354a81179dd9bd5a26e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.700412 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:00.700623 6270 tablet_replica.cc:330] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:00.700803 6270 raft_consensus.cc:2229] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:00.701193 6270 raft_consensus.cc:2258] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.701777 6270 ts_tablet_manager.cc:1905] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.702615 6582 raft_consensus.cc:482] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.702627 6644 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:00.702836 6582 raft_consensus.cc:504] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.703563 6582 leader_election.cc:288] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.704357 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b1cdff9f01974354a81179dd9bd5a26e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.707851 6616 raft_consensus.cc:482] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.708057 6616 raft_consensus.cc:504] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.708796 6616 leader_election.cc:288] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.708971 6616 raft_consensus.cc:482] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.709089 6616 raft_consensus.cc:504] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.709365 6270 ts_tablet_manager.cc:1918] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:00.709501 6270 log.cc:1196] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f1f8e172c5bf406196574895e5e5e3c7
I20260928 10:44:00.709537 6616 leader_election.cc:288] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.709909 6270 ts_tablet_manager.cc:1939] T f1f8e172c5bf406196574895e5e5e3c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:00.710462 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.711167 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.711848 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet f1f8e172c5bf406196574895e5e5e3c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b1cdff9f01974354a81179dd9bd5a26e) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.712138 6272 tablet_replica.cc:330] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:00.712205 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c957158dbd949e88554e70fe6146089 consensus state has no leader
I20260928 10:44:00.712314 6272 raft_consensus.cc:2229] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.712550 6272 raft_consensus.cc:2258] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:00.712894 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet efa178fc1e344069b086003d39f1b848 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa178fc1e344069b086003d39f1b848 already in progress: creating tablet
I20260928 10:44:00.713132 6272 ts_tablet_manager.cc:1905] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.713335 6273 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:00.713388 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6b418bbb3364006b097e3a78edf5f55 consensus state has no leader
I20260928 10:44:00.713716 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_31f734bdbf584367a86b12dcf8e2b373" } new_table_name: "default.Table_5bf4b815e871428f8f85595af83573b5" modify_external_catalogs: true
I20260928 10:44:00.713933 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f60af5c4c3ac4b139003d1d9f56268d0" } new_table_name: "default.Table_7718e29c75cb41aa8192e35389ac9259" modify_external_catalogs: true
I20260928 10:44:00.715160 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_698c7b8d184d4d3ea24a82759664b00a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.715297 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99" } modify_external_catalogs: true
I20260928 10:44:00.715462 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99" } modify_external_catalogs: true
I20260928 10:44:00.717165 6273 tablet_bootstrap.cc:654] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.719201 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
W20260928 10:44:00.719864 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet efa178fc1e344069b086003d39f1b848 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa178fc1e344069b086003d39f1b848 already in progress: creating tablet
I20260928 10:44:00.720309 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ea33fe07f324842823f5f69dcbeec2b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.720444 6272 ts_tablet_manager.cc:1918] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:00.720587 6272 log.cc:1196] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f1f8e172c5bf406196574895e5e5e3c7
I20260928 10:44:00.720499 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ea33fe07f324842823f5f69dcbeec2b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.720786 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.721028 6272 ts_tablet_manager.cc:1939] T f1f8e172c5bf406196574895e5e5e3c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:00.721087 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.721179 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ccd6efe3854d65995b17a38d81eaa5" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.721549 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ccd6efe3854d65995b17a38d81eaa5" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.722002 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
W20260928 10:44:00.721995 5817 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:00.722358 5817 leader_election.cc:341] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.722241 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_74b56feae3a142d1931815dd8a85abc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.722815 5817 leader_election.cc:341] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:00.724025 5818 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.724150 5818 leader_election.cc:302] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:00.724609 5818 leader_election.cc:341] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.724718 5818 leader_election.cc:302] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:00.725095 5818 leader_election.cc:341] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.725204 5818 leader_election.cc:302] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:00.725776 6582 raft_consensus.cc:2726] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.725978 6582 raft_consensus.cc:2726] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.726125 6582 raft_consensus.cc:2726] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:00.728396 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_04b8310373fe46d29d461a489ceba2c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:00.732168 6275 ts_tablet_manager.cc:1428] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.094s user 0.010s sys 0.014s
I20260928 10:44:00.732573 6275 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.733425 6273 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:00.737699 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_698c7b8d184d4d3ea24a82759664b00a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.739355 6273 ts_tablet_manager.cc:1397] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
I20260928 10:44:00.740933 6273 raft_consensus.cc:348] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.741315 6273 raft_consensus.cc:374] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.741478 6273 raft_consensus.cc:729] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.741701 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:00.741778 6273 consensus_queue.cc:260] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.742527 6273 ts_tablet_manager.cc:1428] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:00.742900 6273 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:00.744102 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74b56feae3a142d1931815dd8a85abc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.744799 6273 tablet_bootstrap.cc:654] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.746201 6275 tablet_bootstrap.cc:654] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.750833 6068 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
W20260928 10:44:00.752496 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04b8310373fe46d29d461a489ceba2c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.758603 6275 tablet_bootstrap.cc:492] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.758934 6275 ts_tablet_manager.cc:1397] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20260928 10:44:00.760470 6275 raft_consensus.cc:348] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.761250 6275 raft_consensus.cc:374] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.761544 6275 raft_consensus.cc:729] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.762071 6275 consensus_queue.cc:260] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.765950 6275 ts_tablet_manager.cc:1428] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:00.769132 6275 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.769452 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c53e9be06f4d1aa0fc7eaef2c10303 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c67f960eb84426f9ebdfef33306a9d0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.769819 6272 tablet_replica.cc:330] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:00.770169 6272 raft_consensus.cc:2229] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.771652 6272 raft_consensus.cc:2258] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.772495 6273 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.772665 6273 ts_tablet_manager.cc:1397] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.009s
I20260928 10:44:00.773629 6272 ts_tablet_manager.cc:1905] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.773996 6273 raft_consensus.cc:348] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.774255 6273 raft_consensus.cc:374] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.774339 6273 raft_consensus.cc:729] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.774618 6273 consensus_queue.cc:260] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.775146 6273 ts_tablet_manager.cc:1428] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:00.775457 6273 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.776978 6273 tablet_bootstrap.cc:654] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.780133 6272 ts_tablet_manager.cc:1918] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.781064 6272 log.cc:1196] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a8c53e9be06f4d1aa0fc7eaef2c10303
I20260928 10:44:00.781446 6272 ts_tablet_manager.cc:1939] T a8c53e9be06f4d1aa0fc7eaef2c10303 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:00.780947 6275 tablet_bootstrap.cc:654] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.791361 6630 raft_consensus.cc:482] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.791534 6630 raft_consensus.cc:504] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.792007 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a8c53e9be06f4d1aa0fc7eaef2c10303 (table default.Table_40542c2360704c5ca950edfd1e8274e2 [id=6677562fe2604addb84af531539cbebd]) successfully deleted
I20260928 10:44:00.792193 6630 leader_election.cc:288] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:00.793103 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:00.795092 6628 raft_consensus.cc:482] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.795279 6628 raft_consensus.cc:504] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.796088 6628 leader_election.cc:288] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:00.796871 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8854c8a8e4024c6db4cb6b21d6ae021f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.797611 5955 leader_election.cc:341] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.801690 6275 tablet_bootstrap.cc:492] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.801862 6275 ts_tablet_manager.cc:1397] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.003s
I20260928 10:44:00.802650 6275 raft_consensus.cc:348] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.802892 6275 raft_consensus.cc:374] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.802976 6275 raft_consensus.cc:729] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.805650 6646 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:00.810815 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 85693.5us
I20260928 10:44:00.812849 6273 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.813009 6273 ts_tablet_manager.cc:1397] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.001s
I20260928 10:44:00.813803 6273 raft_consensus.cc:348] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.814059 6273 raft_consensus.cc:374] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.814149 6273 raft_consensus.cc:729] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.814375 6273 consensus_queue.cc:260] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.814956 6273 ts_tablet_manager.cc:1428] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:00.815279 6273 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.817193 6273 tablet_bootstrap.cc:654] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.819293 6273 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.819550 6273 ts_tablet_manager.cc:1397] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:44:00.820360 6273 raft_consensus.cc:348] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.820691 6273 raft_consensus.cc:374] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.820796 6273 raft_consensus.cc:729] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.821100 6273 consensus_queue.cc:260] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:00.824366 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b2cabf659dc48028605b39c92e1e451 consensus state has no leader
I20260928 10:44:00.824528 5698 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_1afd47c3d1274725a90186611c2d3414 [id=cf392bda49fa4d0f925d9b807d1b2d39] alter complete (version 1)
I20260928 10:44:00.825600 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_701859c27b854998933b0dd33fe2a2a8" } modify_external_catalogs: true
I20260928 10:44:00.825572 6275 consensus_queue.cc:260] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.825824 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_701859c27b854998933b0dd33fe2a2a8" } modify_external_catalogs: true
I20260928 10:44:00.826215 6275 ts_tablet_manager.cc:1428] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260928 10:44:00.826587 6275 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.827319 6202 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:44:00.829326 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d" } modify_external_catalogs: true
I20260928 10:44:00.829592 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d" } modify_external_catalogs: true
I20260928 10:44:00.832518 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_47dbd199fad2491596114b4eefdb2b68" } modify_external_catalogs: true
I20260928 10:44:00.834067 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_47dbd199fad2491596114b4eefdb2b68" } modify_external_catalogs: true
I20260928 10:44:00.834941 6273 ts_tablet_manager.cc:1428] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 10:44:00.835335 6273 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.836045 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 75e19b8189894e91a8be5a150f54cb6b from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:00.836979 6273 tablet_bootstrap.cc:654] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.841969 5693 catalog_manager.cc:5495] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:00.842370 6273 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.842552 6273 ts_tablet_manager.cc:1397] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260928 10:44:00.842455 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_31f734bdbf584367a86b12dcf8e2b373 [id=7af448c554a042ab877113eb284d68c7]). Expected version 4 got 0
I20260928 10:44:00.843497 6612 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef695111ecc46a1bc1439b0b1a282bf. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:00.844050 6612 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:44:00.843931 6273 raft_consensus.cc:348] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.844178 6273 raft_consensus.cc:374] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.844308 6273 raft_consensus.cc:729] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.844563 6273 consensus_queue.cc:260] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.845542 6273 ts_tablet_manager.cc:1428] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 10:44:00.846053 6273 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.846411 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 22f47338950743eb8a06e779a3ca5c69 (DEFAULT_TABLE table=default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d [id=338060758dcb4f57bde86aa3da0dce31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.846905 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f47338950743eb8a06e779a3ca5c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.848162 6275 tablet_bootstrap.cc:654] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.848752 6273 tablet_bootstrap.cc:654] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.855028 6275 tablet_bootstrap.cc:492] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.855218 6275 ts_tablet_manager.cc:1397] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260928 10:44:00.855137 6548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:00.855432 6548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:44:00.856017 6275 raft_consensus.cc:348] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.857393 6628 raft_consensus.cc:482] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.857577 6628 raft_consensus.cc:504] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.858302 6628 leader_election.cc:288] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:00.860293 6273 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.860563 6273 ts_tablet_manager.cc:1397] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260928 10:44:00.861763 6273 raft_consensus.cc:348] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.862145 6273 raft_consensus.cc:374] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.862267 6273 raft_consensus.cc:729] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.862651 6273 consensus_queue.cc:260] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.863818 6273 ts_tablet_manager.cc:1428] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:00.864324 6273 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.866540 6273 tablet_bootstrap.cc:654] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.859150 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0acf2685688e4e108bba66842acedbb9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:00.867707 6275 raft_consensus.cc:374] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.867812 6275 raft_consensus.cc:729] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:00.868278 5955 leader_election.cc:341] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.868413 6275 consensus_queue.cc:260] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.869463 6275 ts_tablet_manager.cc:1428] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260928 10:44:00.872711 6275 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.875077 6647 raft_consensus.cc:482] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.875252 6647 raft_consensus.cc:504] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.876035 6275 tablet_bootstrap.cc:654] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.876410 6647 leader_election.cc:288] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.877375 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a51d9a67e15479587ab2d5a492bb7c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.877991 5817 leader_election.cc:341] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.878697 6273 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.878918 6273 ts_tablet_manager.cc:1397] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20260928 10:44:00.880036 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 30fb3f88e66b4f8582fb348e035af290 (DEFAULT_TABLE table=default.Table_7265fb6e45c84eb5b54864c269f7f0d5 [id=0421ba0c7a0941238c82bc009a1daead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.880455 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30fb3f88e66b4f8582fb348e035af290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.880151 6273 raft_consensus.cc:348] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.880604 6273 raft_consensus.cc:374] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.880738 6273 raft_consensus.cc:729] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.881093 6273 consensus_queue.cc:260] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.882043 6273 ts_tablet_manager.cc:1428] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:00.882465 6273 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.884599 6273 tablet_bootstrap.cc:654] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.893198 6275 tablet_bootstrap.cc:492] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.894133 6275 ts_tablet_manager.cc:1397] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260928 10:44:00.894883 6273 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.895113 6273 ts_tablet_manager.cc:1397] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260928 10:44:00.895793 6275 raft_consensus.cc:348] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.896256 6273 raft_consensus.cc:348] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.896652 6275 raft_consensus.cc:374] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.896654 6273 raft_consensus.cc:374] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.896751 6273 raft_consensus.cc:729] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.896884 6275 raft_consensus.cc:729] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.897296 6275 consensus_queue.cc:260] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.897357 6273 consensus_queue.cc:260] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.898129 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 503a4bcb9d37441aadf66b45238a3737 (DEFAULT_TABLE table=default.Table_bcf12c0441964bec8f8b7d378ca8977f [id=9efb880407fa43a4afcbdff554229099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.898582 6275 ts_tablet_manager.cc:1428] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:00.898530 6273 ts_tablet_manager.cc:1428] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:44:00.899142 6273 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.899523 6275 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.901479 6275 tablet_bootstrap.cc:654] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.901512 6273 tablet_bootstrap.cc:654] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.914824 5991 tablet_service.cc:1467] Processing CreateTablet for tablet ee0b7f3bd78a49368abc13ab9e171880 (DEFAULT_TABLE table=default.Table_1a6ada6f154c48509e5e70d57c95377c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.915735 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0b7f3bd78a49368abc13ab9e171880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.922255 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 22f47338950743eb8a06e779a3ca5c69 (DEFAULT_TABLE table=default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d [id=338060758dcb4f57bde86aa3da0dce31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.922845 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f47338950743eb8a06e779a3ca5c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.931556 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 503a4bcb9d37441aadf66b45238a3737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.936271 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 30fb3f88e66b4f8582fb348e035af290 (DEFAULT_TABLE table=default.Table_7265fb6e45c84eb5b54864c269f7f0d5 [id=0421ba0c7a0941238c82bc009a1daead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.936784 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30fb3f88e66b4f8582fb348e035af290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.942377 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 503a4bcb9d37441aadf66b45238a3737 (DEFAULT_TABLE table=default.Table_bcf12c0441964bec8f8b7d378ca8977f [id=9efb880407fa43a4afcbdff554229099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.942886 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 503a4bcb9d37441aadf66b45238a3737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.945516 6136 tablet_service.cc:1467] Processing CreateTablet for tablet ee0b7f3bd78a49368abc13ab9e171880 (DEFAULT_TABLE table=default.Table_1a6ada6f154c48509e5e70d57c95377c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.945994 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0b7f3bd78a49368abc13ab9e171880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.954962 6275 tablet_bootstrap.cc:492] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:00.955179 6275 ts_tablet_manager.cc:1397] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260928 10:44:00.956032 6275 raft_consensus.cc:348] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.956359 6275 raft_consensus.cc:374] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.956449 6275 raft_consensus.cc:729] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.956713 6275 consensus_queue.cc:260] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.957295 6275 ts_tablet_manager.cc:1428] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:00.957639 6275 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:00.959316 6275 tablet_bootstrap.cc:654] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:00.961431 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0a3d035581da47abb64156066e53fa67
I20260928 10:44:00.962245 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8fbb02cd83954bd2ad721b776064fa23" } modify_external_catalogs: true
I20260928 10:44:00.962467 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8fbb02cd83954bd2ad721b776064fa23" } modify_external_catalogs: true
I20260928 10:44:00.964601 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3d035581da47abb64156066e53fa67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:00.965384 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0a3d035581da47abb64156066e53fa67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a3d035581da47abb64156066e53fa67 already in progress: creating tablet
I20260928 10:44:00.965737 6269 ts_tablet_manager.cc:1918] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:00.965876 6269 log.cc:1196] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/b2d841c2f9b844208173f982b9eb7818
I20260928 10:44:00.968492 5698 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2f68d4cdc9754c309516fb236a12a6df
I20260928 10:44:00.968990 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a89653eaa7ec4ee3abdd48beaad49fce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:00.970150 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a89653eaa7ec4ee3abdd48beaad49fce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:00.971760 6271 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:00.971980 6271 ts_tablet_manager.cc:1397] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.322s user 0.017s sys 0.038s
I20260928 10:44:00.972815 6271 raft_consensus.cc:348] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.973114 6271 raft_consensus.cc:374] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.973243 6271 raft_consensus.cc:729] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.973546 6271 consensus_queue.cc:260] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:00.974291 6271 ts_tablet_manager.cc:1428] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:00.978406 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3d035581da47abb64156066e53fa67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:00.981794 6647 raft_consensus.cc:482] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:00.982111 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:00.982299 6647 raft_consensus.cc:504] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:00.982679 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6037e24ee6ba4399b6100ab27c4ed621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:00.982926 6647 leader_election.cc:288] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:00.983515 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99202cf0cfac40b2aa54b10b4d96939d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:00.984032 5817 leader_election.cc:341] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:00.984921 6269 ts_tablet_manager.cc:1939] T b2d841c2f9b844208173f982b9eb7818 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:00.985699 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 357) took 1308 ms. Trace:
I20260928 10:44:00.985855 6269 rpcz_store.cc:276] 0928 10:43:59.677620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.677672 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:00.663086 (+985414us) ts_tablet_manager.cc:1145] Deleting tablet b2d841c2f9b844208173f982b9eb7818
0928 10:44:00.663099 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:00.681957 (+ 18858us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:00.965586 (+283629us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:00.985662 (+ 20076us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985198}
I20260928 10:44:00.986328 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 361) took 1271 ms. Trace:
I20260928 10:44:00.986442 6269 rpcz_store.cc:276] 0928 10:43:59.715057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.715135 (+ 78us) service_pool.cc:227] Handling call
0928 10:44:00.986195 (+1271060us) ts_tablet_manager.cc:1145] Deleting tablet 3cb9c554d363441b8006abc2d9bdd856
0928 10:44:00.986214 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:00.986304 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270825}
I20260928 10:44:00.986717 6269 tablet_replica.cc:330] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:00.986910 6269 raft_consensus.cc:2229] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:00.987047 6269 raft_consensus.cc:2258] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:00.987588 6269 ts_tablet_manager.cc:1905] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:00.991074 6273 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:00.991218 6273 ts_tablet_manager.cc:1397] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.008s
I20260928 10:44:00.991940 6273 raft_consensus.cc:348] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.992158 6273 raft_consensus.cc:374] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:00.992244 6273 raft_consensus.cc:729] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:00.992516 6273 consensus_queue.cc:260] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:00.993148 6273 ts_tablet_manager.cc:1428] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:00.993418 6273 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:00.994997 6273 tablet_bootstrap.cc:654] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:01.002503 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0a3d035581da47abb64156066e53fa67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a3d035581da47abb64156066e53fa67 already in progress: creating tablet
I20260928 10:44:01.003111 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:01.003615 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 104a223ec6ef47988d0aa3335a1f81de deleted and replaced by tablet 29a1be37ede84ea485182044be92b8c6
I20260928 10:44:01.009522 6630 raft_consensus.cc:482] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.009740 6630 raft_consensus.cc:504] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.010413 6630 leader_election.cc:288] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:01.012737 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 78295825061a4d75984e2d6e110e1c55 (DEFAULT_TABLE table=default.Table_9f429f420bbd495c91b854218a0a06f5 [id=86988e047ddc41758ee67111b73d0012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.013365 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78295825061a4d75984e2d6e110e1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.013700 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 22f47338950743eb8a06e779a3ca5c69
I20260928 10:44:01.014371 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2d71edffecf044ba9cec14a70683a56f
I20260928 10:44:01.015614 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_31f734bdbf584367a86b12dcf8e2b373 [id=7af448c554a042ab877113eb284d68c7]). Expected version 4 got 0
I20260928 10:44:01.016657 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.016968 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:01.017284 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.017556 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6037e24ee6ba4399b6100ab27c4ed621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.019582 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_68c20471e3394f65b7e4c48b74edac58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.020151 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68c20471e3394f65b7e4c48b74edac58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.024971 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.025879 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f47338950743eb8a06e779a3ca5c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:01.026639 6090 leader_election.cc:341] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 42b522152aa44e45969f37e3f65de554
I20260928 10:44:01.026676 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 22f47338950743eb8a06e779a3ca5c69 (DEFAULT_TABLE table=default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d [id=338060758dcb4f57bde86aa3da0dce31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.027112 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f47338950743eb8a06e779a3ca5c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.029414 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 (DEFAULT_TABLE table=default.Table_ddb5219dc9654884a3cb905f60474969 [id=7555cadaf1a648b1b99aa958641aa949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.034915 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3d035581da47abb64156066e53fa67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.035089 6155 raft_consensus.cc:3037] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:01.034917 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 503a4bcb9d37441aadf66b45238a3737 (DEFAULT_TABLE table=default.Table_bcf12c0441964bec8f8b7d378ca8977f [id=9efb880407fa43a4afcbdff554229099]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:01.035135 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 22f47338950743eb8a06e779a3ca5c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22f47338950743eb8a06e779a3ca5c69 already in progress: creating tablet
I20260928 10:44:01.035178 5860 tablet_service.cc:1467] Processing CreateTablet for tablet ee0b7f3bd78a49368abc13ab9e171880 (DEFAULT_TABLE table=default.Table_1a6ada6f154c48509e5e70d57c95377c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.035555 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 503a4bcb9d37441aadf66b45238a3737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.036180 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 75e19b8189894e91a8be5a150f54cb6b
I20260928 10:44:01.038143 6155 raft_consensus.cc:1261] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:01.039088 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0b7f3bd78a49368abc13ab9e171880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.039477 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b4c8b5f8eede428da452daeb16948828" } new_table_name: "default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e" modify_external_catalogs: true
I20260928 10:44:01.041054 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet b2d841c2f9b844208173f982b9eb7818 (table default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]) successfully deleted
W20260928 10:44:01.041301 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 3cb9c554d363441b8006abc2d9bdd856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cb9c554d363441b8006abc2d9bdd856 already in progress: creating tablet
I20260928 10:44:01.042016 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6c902309876c48ae976ee0fb5e3d43c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.043087 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d8be5cda7ca54bef9c60c4c1bc88a460"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.043624 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8be5cda7ca54bef9c60c4c1bc88a460 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:01.044739 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c902309876c48ae976ee0fb5e3d43c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.045975 6630 raft_consensus.cc:482] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.046152 6630 raft_consensus.cc:504] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.047398 6630 leader_election.cc:288] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:01.048256 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 75e19b8189894e91a8be5a150f54cb6b deleted and replaced by tablet c22cc964ceb741febfd3d1322ae05289
I20260928 10:44:01.049048 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2791ed0f44e341b6bf437f3eaa4b97a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.050092 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2791ed0f44e341b6bf437f3eaa4b97a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.050756 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 30fb3f88e66b4f8582fb348e035af290 (DEFAULT_TABLE table=default.Table_7265fb6e45c84eb5b54864c269f7f0d5 [id=0421ba0c7a0941238c82bc009a1daead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.049542 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_409bf812ca684359b4bf9c0e9858ba1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.051374 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30fb3f88e66b4f8582fb348e035af290. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:01.051585 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_409bf812ca684359b4bf9c0e9858ba1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.055768 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 78295825061a4d75984e2d6e110e1c55 (DEFAULT_TABLE table=default.Table_9f429f420bbd495c91b854218a0a06f5 [id=86988e047ddc41758ee67111b73d0012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.056211 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78295825061a4d75984e2d6e110e1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.058656 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.059072 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.060465 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9fc7685a7541219b7207dc38b604e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.062007 6574 consensus_queue.cc:1035] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260928 10:44:01.065213 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 (DEFAULT_TABLE table=default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.065981 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6037e24ee6ba4399b6100ab27c4ed621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.066643 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.067600 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.068600 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.069048 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.069195 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.069432 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.069824 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f47338950743eb8a06e779a3ca5c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.070176 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:01.070442 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2d71edffecf044ba9cec14a70683a56f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d71edffecf044ba9cec14a70683a56f already in progress: creating tablet
I20260928 10:44:01.070588 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.070905 6270 tablet_replica.cc:330] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.070953 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e19b8189894e91a8be5a150f54cb6b with delete_type TABLET_DATA_DELETED (replaced by tablet c22cc964ceb741febfd3d1322ae05289) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.071977 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 (DEFAULT_TABLE table=default.Table_ddb5219dc9654884a3cb905f60474969 [id=7555cadaf1a648b1b99aa958641aa949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.072448 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9fc7685a7541219b7207dc38b604e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.073478 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e19b8189894e91a8be5a150f54cb6b with delete_type TABLET_DATA_DELETED (replaced by tablet c22cc964ceb741febfd3d1322ae05289) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:01.074213 6090 leader_election.cc:341] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 1f6fe4271349432db8efda609d85d611
I20260928 10:44:01.074391 6270 raft_consensus.cc:2229] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.074604 6270 raft_consensus.cc:2258] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.075405 6270 ts_tablet_manager.cc:1905] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.081233 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.092756 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 (DEFAULT_TABLE table=default.Table_ddb5219dc9654884a3cb905f60474969 [id=7555cadaf1a648b1b99aa958641aa949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.093443 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9fc7685a7541219b7207dc38b604e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.119015 6647 raft_consensus.cc:482] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.119225 6647 raft_consensus.cc:504] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.120412 6647 leader_election.cc:288] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.121155 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733ca22794da4015bbe09ed6c374ad05" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.121841 5817 leader_election.cc:341] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.122519 6270 ts_tablet_manager.cc:1918] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.122445 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 78295825061a4d75984e2d6e110e1c55 (DEFAULT_TABLE table=default.Table_9f429f420bbd495c91b854218a0a06f5 [id=86988e047ddc41758ee67111b73d0012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.122812 6270 log.cc:1196] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/0acf2685688e4e108bba66842acedbb9
I20260928 10:44:01.122961 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78295825061a4d75984e2d6e110e1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.123353 6270 ts_tablet_manager.cc:1939] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:01.124017 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 104a223ec6ef47988d0aa3335a1f81de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104a223ec6ef47988d0aa3335a1f81de already in progress: creating tablet
I20260928 10:44:01.126760 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a0adec506e4ca9b10989f18d6c0c22" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:01.126758 6674 tablet.cc:1722] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260928 10:44:01.132560 5957 leader_election.cc:341] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8854c8a8e4024c6db4cb6b21d6ae021f
I20260928 10:44:01.132759 5957 leader_election.cc:302] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:01.133082 6639 raft_consensus.cc:2726] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.133674 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99202cf0cfac40b2aa54b10b4d96939d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.134200 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733ca22794da4015bbe09ed6c374ad05" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.134599 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a51d9a67e15479587ab2d5a492bb7c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.140743 6647 raft_consensus.cc:482] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.140950 6647 raft_consensus.cc:504] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.141549 6647 leader_election.cc:288] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.144492 6673 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:01.145474 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 0acf2685688e4e108bba66842acedbb9 (table default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]) successfully deleted
W20260928 10:44:01.145844 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 104a223ec6ef47988d0aa3335a1f81de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104a223ec6ef47988d0aa3335a1f81de already in progress: creating tablet
W20260928 10:44:01.146097 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 75e19b8189894e91a8be5a150f54cb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75e19b8189894e91a8be5a150f54cb6b already in progress: creating tablet
I20260928 10:44:01.127817 6644 tablet.cc:1722] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 10:44:01.132851 6091 leader_election.cc:302] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:01.152074 6091 leader_election.cc:341] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 42b522152aa44e45969f37e3f65de554
I20260928 10:44:01.152249 6091 leader_election.cc:302] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:01.152547 6637 raft_consensus.cc:2726] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.152607 6091 leader_election.cc:341] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1f6fe4271349432db8efda609d85d611
I20260928 10:44:01.136415 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.136600 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b522152aa44e45969f37e3f65de554 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.152753 6091 leader_election.cc:302] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:01.152812 6637 raft_consensus.cc:2726] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.152964 6637 raft_consensus.cc:2726] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.136895 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e19b8189894e91a8be5a150f54cb6b with delete_type TABLET_DATA_DELETED (replaced by tablet c22cc964ceb741febfd3d1322ae05289) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.134868 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f47338950743eb8a06e779a3ca5c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.153208 6272 tablet_replica.cc:330] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.153414 6272 raft_consensus.cc:2229] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.153605 6272 raft_consensus.cc:2258] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.154510 6272 ts_tablet_manager.cc:1905] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.154911 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.155592 5817 leader_election.cc:341] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.157884 5884 raft_consensus.cc:1261] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:01.158674 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.159834 6639 consensus_queue.cc:1035] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:01.160733 5818 leader_election.cc:341] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.160951 5818 leader_election.cc:302] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.161250 6647 raft_consensus.cc:2726] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.161648 5818 leader_election.cc:341] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.167953 5818 leader_election.cc:302] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.168337 6647 raft_consensus.cc:2726] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.168865 5818 leader_election.cc:341] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.169075 5818 leader_election.cc:302] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.169363 6647 raft_consensus.cc:2726] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.169773 5818 leader_election.cc:341] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.169939 5818 leader_election.cc:302] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.171873 6273 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.172129 6273 ts_tablet_manager.cc:1397] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.179s user 0.005s sys 0.001s
I20260928 10:44:01.173178 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0aee4f49a44bb7bf19b28d96040e65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.173815 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9361a96fdc44d7ac38a1d0d812eac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.174371 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6fe4271349432db8efda609d85d611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.176499 6639 raft_consensus.cc:482] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.176669 6639 raft_consensus.cc:504] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.177366 6639 leader_election.cc:288] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:01.177927 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3d035581da47abb64156066e53fa67" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.178515 5955 leader_election.cc:341] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:01.178879 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2d71edffecf044ba9cec14a70683a56f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d71edffecf044ba9cec14a70683a56f already in progress: creating tablet
I20260928 10:44:01.181083 6002 tablet_service.cc:1467] Processing CreateTablet for tablet adb1f2e6392b4329b5520d0e292d6f98 (DEFAULT_TABLE table=default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.181542 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb1f2e6392b4329b5520d0e292d6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.200367 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:01.200862 5701 catalog_manager.cc:6565] ReplaceTablet: tablet 9fe0dd05136840ee91d0b2a415ad49fc deleted and replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406
I20260928 10:44:01.202725 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:01.204384 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7]). Expected version 5 got 0
I20260928 10:44:01.204682 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.206353 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7265fb6e45c84eb5b54864c269f7f0d5" } new_table_name: "default.Table_4a0284bba8ca439b994fe58c3a2f38e2" modify_external_catalogs: true
I20260928 10:44:01.208808 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3d035581da47abb64156066e53fa67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.209043 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.209972 6270 tablet_replica.cc:330] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.210170 6270 raft_consensus.cc:2229] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.210358 6270 raft_consensus.cc:2258] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:01.210700 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1072cf156cdf4c2a8c9d9764de110c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1072cf156cdf4c2a8c9d9764de110c6d already in progress: creating tablet
I20260928 10:44:01.211665 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.212304 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.208786 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.212570 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.214039 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f (DEFAULT_TABLE table=default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34 [id=a0981bde32fc4198af603678ed4b161f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.214466 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9fb31988e4447f9c4a694056d6e54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.226648 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bab2604ba651431d8828e6a78a445930" } new_table_name: "default.Table_1acc77c2d6914c87a340fe67568a2d53" modify_external_catalogs: true
I20260928 10:44:01.227798 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 07a0c6ca08884dc6813b25e3991d0d8c from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:01.229108 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 943db4a7f3fe4283a67defd68e744e33 consensus state has no leader
I20260928 10:44:01.229404 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 847b18c212474456ac9b40eee055dbd0 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.230962 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5aca2d8635034ce69a07c97d997a2c86" } new_table_name: "default.Table_5607fa1f3fd0455abf4c687e67afde0e" modify_external_catalogs: true
I20260928 10:44:01.233826 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5008f3ece0d3476f901da4ac24f324ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.234580 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5008f3ece0d3476f901da4ac24f324ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.234593 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.246091 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f (DEFAULT_TABLE table=default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34 [id=a0981bde32fc4198af603678ed4b161f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.248375 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 58c0af95fa58451490947176ec9301e3 (DEFAULT_TABLE table=default.Table_22bfb6af239a4abea551a6d34e6453d3 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.249154 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 58c0af95fa58451490947176ec9301e3 (DEFAULT_TABLE table=default.Table_22bfb6af239a4abea551a6d34e6453d3 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.249737 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c0af95fa58451490947176ec9301e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.255874 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.256817 6126 tablet_service.cc:1467] Processing CreateTablet for tablet adb1f2e6392b4329b5520d0e292d6f98 (DEFAULT_TABLE table=default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.257819 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f (DEFAULT_TABLE table=default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34 [id=a0981bde32fc4198af603678ed4b161f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.259557 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 58c0af95fa58451490947176ec9301e3 (DEFAULT_TABLE table=default.Table_22bfb6af239a4abea551a6d34e6453d3 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.265610 6272 ts_tablet_manager.cc:1918] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.265803 6272 log.cc:1196] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/42b522152aa44e45969f37e3f65de554
I20260928 10:44:01.266204 6272 ts_tablet_manager.cc:1939] T 42b522152aa44e45969f37e3f65de554 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:01.267361 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9fb31988e4447f9c4a694056d6e54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.268867 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c0af95fa58451490947176ec9301e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.269481 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb1f2e6392b4329b5520d0e292d6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.275800 6272 tablet_replica.cc:330] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.276028 6272 raft_consensus.cc:2229] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.276176 6272 raft_consensus.cc:2258] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.277068 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c0af95fa58451490947176ec9301e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.287089 6272 ts_tablet_manager.cc:1905] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.296386 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 42b522152aa44e45969f37e3f65de554 (table default.Table_f411d60097904229877bc64f248a45c5 [id=5243c67e22f740479e004c0927b2580b]) successfully deleted
W20260928 10:44:01.296746 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 75e19b8189894e91a8be5a150f54cb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75e19b8189894e91a8be5a150f54cb6b already in progress: creating tablet
W20260928 10:44:01.296970 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 22f47338950743eb8a06e779a3ca5c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22f47338950743eb8a06e779a3ca5c69 already in progress: creating tablet
I20260928 10:44:01.300472 6272 ts_tablet_manager.cc:1918] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.300882 6272 log.cc:1196] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8b0aee4f49a44bb7bf19b28d96040e65
I20260928 10:44:01.301652 6272 ts_tablet_manager.cc:1939] T 8b0aee4f49a44bb7bf19b28d96040e65 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:01.302166 6271 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:01.304039 6271 tablet_bootstrap.cc:654] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.306878 6270 ts_tablet_manager.cc:1905] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.317548 6270 ts_tablet_manager.cc:1918] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.319669 6270 log.cc:1196] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/0a3d035581da47abb64156066e53fa67
I20260928 10:44:01.317631 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 (DEFAULT_TABLE table=default.Table_9420102eb4994caea7a11294bebbebd0 [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.322212 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a8098440fb4e919bc5e3f4dd3241a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.323395 6271 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:01.323721 6271 ts_tablet_manager.cc:1397] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.007s
I20260928 10:44:01.325079 6271 raft_consensus.cc:348] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.325464 6271 raft_consensus.cc:374] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.325594 6271 raft_consensus.cc:729] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.325977 6271 consensus_queue.cc:260] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.326903 6271 ts_tablet_manager.cc:1428] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:01.327324 6271 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:01.330646 6271 tablet_bootstrap.cc:654] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.336040 6647 raft_consensus.cc:2726] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.333230 6273 raft_consensus.cc:348] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.337244 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9fb31988e4447f9c4a694056d6e54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.339039 6271 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:01.339320 6271 ts_tablet_manager.cc:1397] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.008s
I20260928 10:44:01.340111 6271 raft_consensus.cc:348] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.340497 6271 raft_consensus.cc:374] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.340628 6271 raft_consensus.cc:729] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.340968 6271 consensus_queue.cc:260] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.341854 6271 ts_tablet_manager.cc:1428] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:01.342217 6271 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:01.317899 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 (DEFAULT_TABLE table=default.Table_9420102eb4994caea7a11294bebbebd0 [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.344545 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a8098440fb4e919bc5e3f4dd3241a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.345613 6271 tablet_bootstrap.cc:654] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.346091 5861 tablet_service.cc:1467] Processing CreateTablet for tablet adb1f2e6392b4329b5520d0e292d6f98 (DEFAULT_TABLE table=default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.346637 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb1f2e6392b4329b5520d0e292d6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.347289 6273 raft_consensus.cc:374] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.347311 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 (DEFAULT_TABLE table=default.Table_9420102eb4994caea7a11294bebbebd0 [id=d47f757b2fab48be9a9d94e97f1ff72a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.347502 6273 raft_consensus.cc:729] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.347828 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a8098440fb4e919bc5e3f4dd3241a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.318157 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.318961 6275 tablet_bootstrap.cc:492] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:01.348542 6275 ts_tablet_manager.cc:1397] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.391s user 0.057s sys 0.090s
W20260928 10:44:01.349105 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 138536us
W20260928 10:44:01.349565 5957 leader_election.cc:341] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0acf2685688e4e108bba66842acedbb9
I20260928 10:44:01.349735 5957 leader_election.cc:302] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:01.349905 5957 raft_consensus.cc:2670] T 0acf2685688e4e108bba66842acedbb9 P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:01.350584 6275 raft_consensus.cc:348] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.350842 6275 raft_consensus.cc:374] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.351119 6275 raft_consensus.cc:729] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.351753 6647 raft_consensus.cc:482] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.351958 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3d035581da47abb64156066e53fa67" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:01.352200 5884 raft_consensus.cc:2454] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:01.352253 6647 raft_consensus.cc:504] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.353053 5957 leader_election.cc:302] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:01.353250 5957 raft_consensus.cc:2670] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:01.354503 6275 consensus_queue.cc:260] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.354898 6272 tablet_replica.cc:330] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.320363 6270 ts_tablet_manager.cc:1939] T 0a3d035581da47abb64156066e53fa67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:01.354920 6647 leader_election.cc:288] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.354965 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8b0aee4f49a44bb7bf19b28d96040e65 (table default.Table_03bf7117677a45beb1e041ba0288cfd8 [id=4709681efc4b48f9b79a4936cedb9ee4]) successfully deleted
I20260928 10:44:01.355247 6275 ts_tablet_manager.cc:1428] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 10:44:01.355573 6275 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:01.355837 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e32961679ee47379dab4c62efc53d99" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:01.357355 6269 ts_tablet_manager.cc:1918] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.358863 6202 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:44:01.359822 6155 raft_consensus.cc:3037] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:01.360479 6275 tablet_bootstrap.cc:654] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.366597 6272 raft_consensus.cc:2229] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.367671 6272 raft_consensus.cc:2258] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.369540 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e32961679ee47379dab4c62efc53d99" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.361423 6647 raft_consensus.cc:482] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.370532 6647 raft_consensus.cc:504] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:01.357610 5817 leader_election.cc:341] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.368778 6273 consensus_queue.cc:260] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.371166 6647 leader_election.cc:288] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:01.371277 6273 ts_tablet_manager.cc:1428] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.199s user 0.001s sys 0.001s
W20260928 10:44:01.371646 5818 leader_election.cc:341] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.371865 5818 leader_election.cc:302] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.371726 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:01.372565 6647 raft_consensus.cc:2726] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.372597 5817 leader_election.cc:341] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.369688 6272 ts_tablet_manager.cc:1905] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.357527 6269 log.cc:1196] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1ba8abd00f2742a29fdc79059332b91d
I20260928 10:44:01.373258 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.373452 6269 ts_tablet_manager.cc:1939] T 1ba8abd00f2742a29fdc79059332b91d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:44:01.374025 5818 leader_election.cc:341] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:01.378191 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 943db4a7f3fe4283a67defd68e744e33 consensus state has no leader
I20260928 10:44:01.381762 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bb3b4a291acb4121ae9e440fc315a891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.383239 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2a5049f83fce42b0ab5b4beea486d708"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.383773 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5049f83fce42b0ab5b4beea486d708 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:01.384964 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb3b4a291acb4121ae9e440fc315a891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.387023 5818 leader_election.cc:302] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.388633 6682 raft_consensus.cc:2726] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.383842 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 351) took 1734 ms. Trace:
I20260928 10:44:01.388926 6269 rpcz_store.cc:276] 0928 10:43:59.649713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.717707 (+ 67994us) service_pool.cc:227] Handling call
0928 10:44:00.986671 (+1268964us) ts_tablet_manager.cc:1145] Deleting tablet 1ba8abd00f2742a29fdc79059332b91d
0928 10:44:00.986680 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.244438 (+257758us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.357209 (+112771us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.383794 (+ 26585us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266931}
I20260928 10:44:01.389336 6272 ts_tablet_manager.cc:1918] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.389546 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1ba8abd00f2742a29fdc79059332b91d (table default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]) successfully deleted
I20260928 10:44:01.389910 6269 tablet_replica.cc:330] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.390128 6269 raft_consensus.cc:2229] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.390336 6269 raft_consensus.cc:2258] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.390947 6269 ts_tablet_manager.cc:1905] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.393105 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 0a3d035581da47abb64156066e53fa67 (table default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99 [id=8c4d995731f94c088f6e4625446cee13]) successfully deleted
I20260928 10:44:01.386109 6273 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.393549 6270 tablet_replica.cc:330] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.393836 6270 raft_consensus.cc:2229] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.394071 6270 raft_consensus.cc:2258] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.394682 6270 ts_tablet_manager.cc:1905] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.394908 6273 tablet_bootstrap.cc:654] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.409898 6673 tablet.cc:1722] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 10:44:01.426862 6273 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.427191 6273 ts_tablet_manager.cc:1397] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260928 10:44:01.428634 6273 raft_consensus.cc:348] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.429098 6273 raft_consensus.cc:374] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.429252 6273 raft_consensus.cc:729] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.429576 6273 consensus_queue.cc:260] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.432672 6273 ts_tablet_manager.cc:1428] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:01.433017 6273 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:01.442905 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30fb3f88e66b4f8582fb348e035af290 consensus state has no leader
I20260928 10:44:01.444348 5701 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7]). Expected version 5 got 0
I20260928 10:44:01.444795 5696 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7] alter complete (version 5)
I20260928 10:44:01.445187 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_97cfcb43afbc4ecf879d65d4b6d55a60" } modify_external_catalogs: true
I20260928 10:44:01.445374 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_97cfcb43afbc4ecf879d65d4b6d55a60" } modify_external_catalogs: true
I20260928 10:44:01.447044 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34" } modify_external_catalogs: true
I20260928 10:44:01.447229 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2edc7f26ae3c4c5f95187ac6bf22eb34" } modify_external_catalogs: true
I20260928 10:44:01.449558 6273 tablet_bootstrap.cc:654] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.450639 6682 raft_consensus.cc:482] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.450834 6682 raft_consensus.cc:504] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:01.451498 6682 leader_election.cc:288] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:01.452181 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971f8344436f4e60ac0152e811efea8d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:01.452765 5818 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.456386 6269 ts_tablet_manager.cc:1918] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.456882 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.458001 6269 log.cc:1196] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/75ccd6efe3854d65995b17a38d81eaa5
I20260928 10:44:01.459458 6269 ts_tablet_manager.cc:1939] T 75ccd6efe3854d65995b17a38d81eaa5 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.460191 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3d035581da47abb64156066e53fa67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.461297 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 363) took 1697 ms. Trace:
I20260928 10:44:01.461450 6269 rpcz_store.cc:276] 0928 10:43:59.763836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.764545 (+ 709us) service_pool.cc:227] Handling call
0928 10:44:01.389812 (+1625267us) ts_tablet_manager.cc:1145] Deleting tablet 75ccd6efe3854d65995b17a38d81eaa5
0928 10:44:01.389823 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.400252 (+ 10429us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.456229 (+ 55977us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.461259 (+ 5030us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1624959}
I20260928 10:44:01.461898 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 75ccd6efe3854d65995b17a38d81eaa5 (table default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]) successfully deleted
I20260928 10:44:01.462989 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971f8344436f4e60ac0152e811efea8d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.463841 5817 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.464041 5817 leader_election.cc:302] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.464303 6682 raft_consensus.cc:2726] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.465396 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.469758 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_698c7b8d184d4d3ea24a82759664b00a" } new_table_name: "default.Table_8a416d7aa4cc45559e97ce1cd36575a1" modify_external_catalogs: true
I20260928 10:44:01.470643 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.472834 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 364) took 1678 ms. Trace:
I20260928 10:44:01.472972 6269 rpcz_store.cc:276] 0928 10:43:59.794161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.794855 (+ 694us) service_pool.cc:227] Handling call
0928 10:44:01.472660 (+1677805us) ts_tablet_manager.cc:1145] Deleting tablet d40123712b17464e87023f69a6235640
0928 10:44:01.472673 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.472794 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1675450}
W20260928 10:44:01.473483 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d40123712b17464e87023f69a6235640 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d40123712b17464e87023f69a6235640 already in progress: creating tablet
I20260928 10:44:01.474817 6269 tablet_replica.cc:330] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.475404 6269 raft_consensus.cc:2229] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:01.476794 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1a659100a124506a411c929ddc31f10 consensus state has no leader
I20260928 10:44:01.477152 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_61d563e1c8cb41f08ec6e49b87e45b1f" } modify_external_catalogs: true
I20260928 10:44:01.477325 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_61d563e1c8cb41f08ec6e49b87e45b1f" } modify_external_catalogs: true
I20260928 10:44:01.477680 6269 raft_consensus.cc:2258] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.478227 6269 ts_tablet_manager.cc:1905] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.480608 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 07a0c6ca08884dc6813b25e3991d0d8c
I20260928 10:44:01.481031 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 07a0c6ca08884dc6813b25e3991d0d8c deleted and replaced by tablet d6c48b8a7efa41a684205df3e6969370
I20260928 10:44:01.481338 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bcf12c0441964bec8f8b7d378ca8977f" } modify_external_catalogs: true
I20260928 10:44:01.481530 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bcf12c0441964bec8f8b7d378ca8977f" } modify_external_catalogs: true
I20260928 10:44:01.477504 6273 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.482641 6273 ts_tablet_manager.cc:1397] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260928 10:44:01.482829 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 847b18c212474456ac9b40eee055dbd0
I20260928 10:44:01.483166 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 847b18c212474456ac9b40eee055dbd0 deleted and replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2
I20260928 10:44:01.483366 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 9e05cdd590894adcb987ef3ac78bf416 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.483423 6273 raft_consensus.cc:348] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.483662 6273 raft_consensus.cc:374] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.483726 6273 raft_consensus.cc:729] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.483881 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 75e19b8189894e91a8be5a150f54cb6b from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.483986 6273 consensus_queue.cc:260] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.484313 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_68c20471e3394f65b7e4c48b74edac58" } modify_external_catalogs: true
I20260928 10:44:01.484484 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_68c20471e3394f65b7e4c48b74edac58" } modify_external_catalogs: true
I20260928 10:44:01.486937 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.487051 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.487133 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.487483 6273 ts_tablet_manager.cc:1428] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:01.487852 6273 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.488400 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.493332 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.493726 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.493976 6272 log.cc:1196] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/cf9361a96fdc44d7ac38a1d0d812eac0
I20260928 10:44:01.494463 6272 ts_tablet_manager.cc:1939] T cf9361a96fdc44d7ac38a1d0d812eac0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:01.494603 6682 raft_consensus.cc:482] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.494777 6682 raft_consensus.cc:504] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.495353 6682 leader_election.cc:288] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.495724 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet cf9361a96fdc44d7ac38a1d0d812eac0 (table default.Table_d317ef6e443b4c10b5972fe1ad8e93ea [id=d8bb5aee4ea44ee3b1eb058e062c389d]) successfully deleted
I20260928 10:44:01.495909 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a380da90a76545dba647e0c1b3e05acd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.496059 6272 tablet_replica.cc:330] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.496273 6272 raft_consensus.cc:2229] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.496438 6272 raft_consensus.cc:2258] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:01.496457 5818 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.497169 6272 ts_tablet_manager.cc:1905] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.497665 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a380da90a76545dba647e0c1b3e05acd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.498251 5817 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.498409 5817 leader_election.cc:302] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.499079 6682 raft_consensus.cc:2726] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.500979 6273 tablet_bootstrap.cc:654] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.502552 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.506670 6574 raft_consensus.cc:482] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.506816 6574 raft_consensus.cc:504] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.507437 6574 leader_election.cc:288] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:01.508553 5957 leader_election.cc:341] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 65905f0cb4154bdcb8ee6702c87d23ca
W20260928 10:44:01.516645 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c22cc964ceb741febfd3d1322ae05289 has no consensus state
I20260928 10:44:01.518328 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65905f0cb4154bdcb8ee6702c87d23ca" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.519114 5955 leader_election.cc:341] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.519301 5955 leader_election.cc:302] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:01.519567 6574 raft_consensus.cc:2726] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.528385 6275 tablet_bootstrap.cc:492] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:01.528693 6275 ts_tablet_manager.cc:1397] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.173s user 0.007s sys 0.005s
I20260928 10:44:01.529415 6273 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.529559 6273 ts_tablet_manager.cc:1397] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.005s
I20260928 10:44:01.529728 6275 raft_consensus.cc:348] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.530077 6275 raft_consensus.cc:374] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.530187 6275 raft_consensus.cc:729] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.530267 6273 raft_consensus.cc:348] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.530776 6273 raft_consensus.cc:374] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.530601 6275 consensus_queue.cc:260] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.535979 6273 raft_consensus.cc:729] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.540174 6273 consensus_queue.cc:260] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.540544 6269 ts_tablet_manager.cc:1918] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.540781 6269 log.cc:1196] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/971f8344436f4e60ac0152e811efea8d
I20260928 10:44:01.542428 6269 ts_tablet_manager.cc:1939] T 971f8344436f4e60ac0152e811efea8d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.542620 6275 ts_tablet_manager.cc:1428] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260928 10:44:01.545717 6275 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:01.543656 5930 heartbeater.cc:347] Connected to a master server at 127.5.100.126:39997
I20260928 10:44:01.547839 6275 tablet_bootstrap.cc:654] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.544297 6273 ts_tablet_manager.cc:1428] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260928 10:44:01.554975 6678 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 10:44:01.555922 6273 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.558972 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 365) took 1739 ms. Trace:
I20260928 10:44:01.559332 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.560534 6269 rpcz_store.cc:276] 0928 10:43:59.819451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.831156 (+ 11705us) service_pool.cc:227] Handling call
0928 10:44:01.474750 (+1643594us) ts_tablet_manager.cc:1145] Deleting tablet 971f8344436f4e60ac0152e811efea8d
0928 10:44:01.474762 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.481531 (+ 6769us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.535512 (+ 53981us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.558903 (+ 23391us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632570}
I20260928 10:44:01.561841 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 971f8344436f4e60ac0152e811efea8d (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
I20260928 10:44:01.562422 6269 tablet_replica.cc:330] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.562551 6273 tablet_bootstrap.cc:654] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.563679 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b63402f58ca449a4bd05369cc751445e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.564546 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b63402f58ca449a4bd05369cc751445e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.565984 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.574438 6682 raft_consensus.cc:482] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.574668 6682 raft_consensus.cc:504] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.575292 6682 leader_election.cc:288] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:01.575941 6269 raft_consensus.cc:2229] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.576460 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4ed61f43d5d4a6fa21eb854dae895d8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.577265 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4ed61f43d5d4a6fa21eb854dae895d8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:01.577020 5818 leader_election.cc:341] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:01.577927 5817 leader_election.cc:341] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.578065 5817 leader_election.cc:302] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.578136 6269 raft_consensus.cc:2258] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.578517 6682 raft_consensus.cc:2726] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.579053 6269 ts_tablet_manager.cc:1905] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.586755 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ec07c562189f47a280a2e75408d42ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.587386 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec07c562189f47a280a2e75408d42ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.593065 6270 ts_tablet_manager.cc:1918] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.593343 6270 log.cc:1196] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8854c8a8e4024c6db4cb6b21d6ae021f
I20260928 10:44:01.593861 6270 ts_tablet_manager.cc:1939] T 8854c8a8e4024c6db4cb6b21d6ae021f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:01.594996 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8854c8a8e4024c6db4cb6b21d6ae021f (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
W20260928 10:44:01.595831 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9fe0dd05136840ee91d0b2a415ad49fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fe0dd05136840ee91d0b2a415ad49fc already in progress: creating tablet
I20260928 10:44:01.596279 6270 tablet_replica.cc:330] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.606218 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d8589e4891fc44778c83c70292d08586"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.606968 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8589e4891fc44778c83c70292d08586 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.613543 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:01.614902 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.618830 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.619915 6269 ts_tablet_manager.cc:1918] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.624078 6269 log.cc:1196] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/28eb4bef35cc413ebbdc177de1d7b057
I20260928 10:44:01.631034 6269 ts_tablet_manager.cc:1939] T 28eb4bef35cc413ebbdc177de1d7b057 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.634286 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 366) took 1780 ms. Trace:
I20260928 10:44:01.634464 6269 rpcz_store.cc:276] 0928 10:43:59.853914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:43:59.853975 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:01.562329 (+1708354us) ts_tablet_manager.cc:1145] Deleting tablet 28eb4bef35cc413ebbdc177de1d7b057
0928 10:44:01.562341 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.584825 (+ 22484us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.619766 (+ 34941us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.634233 (+ 14467us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":353,"tablet-delete.queue_time_us":1684047}
I20260928 10:44:01.635056 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 28eb4bef35cc413ebbdc177de1d7b057 (table default.Table_31cadc2943274de99ca4c78618ea19fd [id=387c96b6b1cd436381e2b8011d66aa74]) successfully deleted
I20260928 10:44:01.638881 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 385) took 1538 ms. Trace:
I20260928 10:44:01.639950 6269 rpcz_store.cc:276] 0928 10:44:00.100734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.100808 (+ 74us) service_pool.cc:227] Handling call
0928 10:44:01.638661 (+1537853us) ts_tablet_manager.cc:1145] Deleting tablet 39cbecd1c19541f28bd32b7c46f2df61
0928 10:44:01.638675 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.638830 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1512905}
W20260928 10:44:01.640837 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 39cbecd1c19541f28bd32b7c46f2df61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39cbecd1c19541f28bd32b7c46f2df61 already in progress: creating tablet
I20260928 10:44:01.641319 6273 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.641499 6273 ts_tablet_manager.cc:1397] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.009s
I20260928 10:44:01.642237 6273 raft_consensus.cc:348] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.642527 6273 raft_consensus.cc:374] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.642616 6273 raft_consensus.cc:729] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.642877 6273 consensus_queue.cc:260] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.644680 6272 ts_tablet_manager.cc:1918] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.645576 6273 ts_tablet_manager.cc:1428] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 10:44:01.645932 6273 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.648715 6490 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" instance_seqno: 1790592233072395) as {username='slave'} at 127.5.100.65:53653; Asking this server to re-register.
I20260928 10:44:01.640684 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 387) took 1521 ms. Trace:
I20260928 10:44:01.649178 6269 rpcz_store.cc:276] 0928 10:44:00.119285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.125955 (+ 6670us) service_pool.cc:227] Handling call
0928 10:44:01.640509 (+1514554us) ts_tablet_manager.cc:1145] Deleting tablet 8a3443d4c6674342b4124156414dcc13
0928 10:44:01.640521 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.640639 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1514377}
I20260928 10:44:01.649552 6269 tablet_replica.cc:330] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.649770 6269 raft_consensus.cc:2229] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:01.649991 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8a3443d4c6674342b4124156414dcc13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3443d4c6674342b4124156414dcc13 already in progress: creating tablet
I20260928 10:44:01.650789 6269 raft_consensus.cc:2258] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.651410 5930 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:01.654376 6269 ts_tablet_manager.cc:1905] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.655350 6490 ts_manager.cc:194] Registered new tserver with Master: ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:01.655925 6273 tablet_bootstrap.cc:654] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.657186 6270 raft_consensus.cc:2229] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.657399 6270 raft_consensus.cc:2258] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.619447 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.657964 6270 ts_tablet_manager.cc:1905] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.621187 6271 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:01.658241 6271 ts_tablet_manager.cc:1397] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.316s user 0.044s sys 0.089s
I20260928 10:44:01.659377 6271 raft_consensus.cc:348] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.659709 6271 raft_consensus.cc:374] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.660715 6271 raft_consensus.cc:729] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.661099 6271 consensus_queue.cc:260] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.661775 6272 log.cc:1196] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1f6fe4271349432db8efda609d85d611
I20260928 10:44:01.661630 6275 tablet_bootstrap.cc:492] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:01.662402 6275 ts_tablet_manager.cc:1397] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.000s
I20260928 10:44:01.664739 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_139347c4fd714c3a926c9a6044cb6c77" } new_table_name: "default.Table_0796215bba1f4ecc85937aef3b01bee7" modify_external_catalogs: true
I20260928 10:44:01.664857 6490 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" instance_seqno: 1790592233535593) as {username='slave'} at 127.5.100.66:48579; Asking this server to re-register.
I20260928 10:44:01.670704 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 490f8a4f1f9245cfab168b96511e18de
I20260928 10:44:01.670782 6068 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:01.671676 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4a9fb31988e4447f9c4a694056d6e54f
I20260928 10:44:01.671913 6271 ts_tablet_manager.cc:1428] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260928 10:44:01.672509 6490 ts_manager.cc:194] Registered new tserver with Master: 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.675241 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.675498 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.674968 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.674744 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.678025 6271 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:01.678457 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_99610979832a4035a4a742164395bb0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.680202 6273 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:01.680274 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99610979832a4035a4a742164395bb0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.680351 6273 ts_tablet_manager.cc:1397] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260928 10:44:01.681046 6271 tablet_bootstrap.cc:654] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.681156 6273 raft_consensus.cc:348] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.681389 6273 raft_consensus.cc:374] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.681471 6273 raft_consensus.cc:729] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.679423 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_db76dbab7ae943c08f4ea4e705e48e5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.681715 6273 consensus_queue.cc:260] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:01.682044 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db76dbab7ae943c08f4ea4e705e48e5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.682322 6273 ts_tablet_manager.cc:1428] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:01.682653 6273 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.683298 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba8abd00f2742a29fdc79059332b91d with delete_type TABLET_DATA_DELETED (replaced by tablet 5afe4501ea584d44b511b89983e210e3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:01.687784 6273 tablet_bootstrap.cc:654] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.689162 6269 ts_tablet_manager.cc:1918] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.689857 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 503a4bcb9d37441aadf66b45238a3737
I20260928 10:44:01.690811 5695 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 838b6fd6c83a4f538af5bae4aed4aecf
I20260928 10:44:01.690984 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 733ca22794da4015bbe09ed6c374ad05 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.692173 6269 log.cc:1196] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:01.692530 6269 ts_tablet_manager.cc:1939] T 2ea33fe07f324842823f5f69dcbeec2b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.693307 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 384) took 1592 ms. Trace:
I20260928 10:44:01.693401 6269 rpcz_store.cc:276] 0928 10:44:00.100522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.100936 (+ 414us) service_pool.cc:227] Handling call
0928 10:44:01.649484 (+1548548us) ts_tablet_manager.cc:1145] Deleting tablet 2ea33fe07f324842823f5f69dcbeec2b
0928 10:44:01.649494 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.664131 (+ 14637us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.689046 (+ 24915us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.693256 (+ 4210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419699}
I20260928 10:44:01.693883 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 392) took 1553 ms. Trace:
I20260928 10:44:01.693972 6269 rpcz_store.cc:276] 0928 10:44:00.140015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.230971 (+ 90956us) service_pool.cc:227] Handling call
0928 10:44:01.693655 (+1462684us) ts_tablet_manager.cc:1145] Deleting tablet 85583238d6b54f1d89ff5b53b40e73bb
0928 10:44:01.693675 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.693833 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447903}
I20260928 10:44:01.694317 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 389) took 1566 ms. Trace:
I20260928 10:44:01.694401 6269 rpcz_store.cc:276] 0928 10:44:00.128218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.133203 (+ 4985us) service_pool.cc:227] Handling call
0928 10:44:01.694186 (+1560983us) ts_tablet_manager.cc:1145] Deleting tablet 4b6db38f77f64cfe9a7802d5307aa949
0928 10:44:01.694195 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.694269 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447919}
I20260928 10:44:01.697330 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 390) took 1567 ms. Trace:
I20260928 10:44:01.697466 6269 rpcz_store.cc:276] 0928 10:44:00.130010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.225899 (+ 95889us) service_pool.cc:227] Handling call
0928 10:44:01.697149 (+1471250us) ts_tablet_manager.cc:1145] Deleting tablet dbd5d1ccd2e54f3884af3af327bb892e
0928 10:44:01.697159 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.697282 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1450436}
I20260928 10:44:01.697928 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 386) took 1597 ms. Trace:
I20260928 10:44:01.698928 6269 rpcz_store.cc:276] 0928 10:44:00.100857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.101012 (+ 155us) service_pool.cc:227] Handling call
0928 10:44:01.697772 (+1596760us) ts_tablet_manager.cc:1145] Deleting tablet 98bd99e7bdb647ceb9357f88affc45d9
0928 10:44:01.697781 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.697880 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1440517}
I20260928 10:44:01.699504 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 388) took 1572 ms. Trace:
I20260928 10:44:01.701850 6269 rpcz_store.cc:276] 0928 10:44:00.126822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.127397 (+ 575us) service_pool.cc:227] Handling call
0928 10:44:01.699367 (+1571970us) ts_tablet_manager.cc:1145] Deleting tablet f95e1588a3d04142ab8d6bb257235dab
0928 10:44:01.699376 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.699456 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1335,"tablet-delete.queue_time_us":1441980}
I20260928 10:44:01.702589 6269 tablet_replica.cc:330] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.703361 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 503a4bcb9d37441aadf66b45238a3737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:01.703213 6269 raft_consensus.cc:2229] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.703903 6269 raft_consensus.cc:2258] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.705221 6269 ts_tablet_manager.cc:1905] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.703708 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 2ea33fe07f324842823f5f69dcbeec2b (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:01.706808 6273 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:01.706815 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 85583238d6b54f1d89ff5b53b40e73bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85583238d6b54f1d89ff5b53b40e73bb already in progress: creating tablet
I20260928 10:44:01.706972 6273 ts_tablet_manager.cc:1397] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.001s
W20260928 10:44:01.707064 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4b6db38f77f64cfe9a7802d5307aa949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b6db38f77f64cfe9a7802d5307aa949 already in progress: creating tablet
W20260928 10:44:01.707289 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet dbd5d1ccd2e54f3884af3af327bb892e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd5d1ccd2e54f3884af3af327bb892e already in progress: creating tablet
I20260928 10:44:01.707713 6273 raft_consensus.cc:348] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.707976 6273 raft_consensus.cc:374] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.708042 6273 raft_consensus.cc:729] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.708264 6273 consensus_queue.cc:260] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.708866 6273 ts_tablet_manager.cc:1428] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:01.710008 6273 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.673527 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.675787 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.699563 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 503a4bcb9d37441aadf66b45238a3737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.711477 6275 raft_consensus.cc:348] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:01.711723 6275 raft_consensus.cc:374] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.711820 6275 raft_consensus.cc:729] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.712242 6273 tablet_bootstrap.cc:654] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.712077 6275 consensus_queue.cc:260] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:01.712795 6275 ts_tablet_manager.cc:1428] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:01.714372 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8b18320697c0483895d8cef27a3f663f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.714993 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b18320697c0483895d8cef27a3f663f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.717833 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e980d7f015ba49d1b8b828e2d1f89593"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.718410 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e980d7f015ba49d1b8b828e2d1f89593 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.720500 6269 ts_tablet_manager.cc:1918] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.722666 6272 ts_tablet_manager.cc:1939] T 1f6fe4271349432db8efda609d85d611 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:01.707501 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 98bd99e7bdb647ceb9357f88affc45d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98bd99e7bdb647ceb9357f88affc45d9 already in progress: creating tablet
W20260928 10:44:01.723497 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f95e1588a3d04142ab8d6bb257235dab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95e1588a3d04142ab8d6bb257235dab already in progress: creating tablet
I20260928 10:44:01.726648 6269 log.cc:1196] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/92912af8cba4453a8e3422896d586855
I20260928 10:44:01.727286 6275 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:01.730116 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20ea1325da4e460da08377f5d6d6a055 has no consensus state
I20260928 10:44:01.730166 6490 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" instance_seqno: 1790592234011625) as {username='slave'} at 127.5.100.67:47789; Asking this server to re-register.
I20260928 10:44:01.730614 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5008f3ece0d3476f901da4ac24f324ce" } new_table_name: "default.Table_2d2f6d17577e40a38a8af4624ead8bd1" modify_external_catalogs: true
I20260928 10:44:01.731097 6202 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:01.731825 6269 ts_tablet_manager.cc:1939] T 92912af8cba4453a8e3422896d586855 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.732707 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 391) took 1593 ms. Trace:
I20260928 10:44:01.732841 6269 rpcz_store.cc:276] 0928 10:44:00.139592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.228725 (+ 89133us) service_pool.cc:227] Handling call
0928 10:44:01.702467 (+1473742us) ts_tablet_manager.cc:1145] Deleting tablet 92912af8cba4453a8e3422896d586855
0928 10:44:01.702498 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.714773 (+ 12275us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.720349 (+ 5576us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.732666 (+ 12317us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1438626}
I20260928 10:44:01.733367 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 92912af8cba4453a8e3422896d586855 (table default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]) successfully deleted
I20260928 10:44:01.733302 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1afd47c3d1274725a90186611c2d3414" } new_table_name: "default.Table_ac97228d056a4e5c94a51b6decaf589f" modify_external_catalogs: true
I20260928 10:44:01.734103 6273 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.734247 6273 ts_tablet_manager.cc:1397] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.002s
I20260928 10:44:01.734344 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 16f7d561b10e46609f22ce17b323fb23 with delete_type TABLET_DATA_DELETED (replaced by tablet 463cf5ecb52d40069b564698433c6781) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.734782 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 405) took 1192 ms. Trace:
I20260928 10:44:01.735061 6273 raft_consensus.cc:348] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.735262 6273 raft_consensus.cc:374] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.735356 6273 raft_consensus.cc:729] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.734947 6269 rpcz_store.cc:276] 0928 10:44:00.542428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.542630 (+ 202us) service_pool.cc:227] Handling call
0928 10:44:01.734609 (+1191979us) ts_tablet_manager.cc:1145] Deleting tablet d22260b5f20d47ad99d612ed5a7c022c
0928 10:44:01.734619 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.734741 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190212}
I20260928 10:44:01.735589 6273 consensus_queue.cc:260] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.736285 6273 ts_tablet_manager.cc:1428] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260928 10:44:01.736296 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d22260b5f20d47ad99d612ed5a7c022c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d22260b5f20d47ad99d612ed5a7c022c already in progress: creating tablet
I20260928 10:44:01.736598 6273 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.738389 6273 tablet_bootstrap.cc:654] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.741930 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d292f1b10c84bb58b70b64028774b25" } new_table_name: "default.Table_fb25cc33ccfb474ca51b0db8e1b167f7" modify_external_catalogs: true
I20260928 10:44:01.749128 6490 ts_manager.cc:194] Registered new tserver with Master: 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:01.749532 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1f6fe4271349432db8efda609d85d611 (table default.Table_b6a8b78145f2494aa8b0e49415c15f9d [id=b26a44ff8b0d4e6fa2f05c9de3ee1dab]) successfully deleted
W20260928 10:44:01.750988 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1072cf156cdf4c2a8c9d9764de110c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1072cf156cdf4c2a8c9d9764de110c6d already in progress: creating tablet
W20260928 10:44:01.752971 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9fe0dd05136840ee91d0b2a415ad49fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fe0dd05136840ee91d0b2a415ad49fc already in progress: creating tablet
I20260928 10:44:01.753317 6272 tablet_replica.cc:330] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.753576 6272 raft_consensus.cc:2229] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.754223 6272 raft_consensus.cc:2258] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.757328 6272 ts_tablet_manager.cc:1905] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.757586 6275 tablet_bootstrap.cc:654] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.760038 6273 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.760258 6273 ts_tablet_manager.cc:1397] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260928 10:44:01.761155 6273 raft_consensus.cc:348] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.761439 6273 raft_consensus.cc:374] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.761528 6273 raft_consensus.cc:729] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.761811 6273 consensus_queue.cc:260] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.762401 6273 ts_tablet_manager.cc:1428] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:01.763106 6273 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.764828 6273 tablet_bootstrap.cc:654] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.769387 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 404) took 1243 ms. Trace:
I20260928 10:44:01.769594 6269 rpcz_store.cc:276] 0928 10:44:00.525634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.526817 (+ 1183us) service_pool.cc:227] Handling call
0928 10:44:01.736672 (+1209855us) ts_tablet_manager.cc:1145] Deleting tablet 44bc6831f9354ddb81212bc107efdf68
0928 10:44:01.757572 (+ 20900us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.769351 (+ 11779us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191908}
W20260928 10:44:01.770198 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 44bc6831f9354ddb81212bc107efdf68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bc6831f9354ddb81212bc107efdf68 already in progress: creating tablet
I20260928 10:44:01.770310 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 403) took 1244 ms. Trace:
I20260928 10:44:01.770439 6269 rpcz_store.cc:276] 0928 10:44:00.525521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.529793 (+ 4272us) service_pool.cc:227] Handling call
0928 10:44:01.769952 (+1240159us) ts_tablet_manager.cc:1145] Deleting tablet 45a00a2c4692459cbdd0628af0184f09
0928 10:44:01.769962 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.770275 (+ 313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221859}
I20260928 10:44:01.770834 6275 tablet_bootstrap.cc:492] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:01.770881 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 45a00a2c4692459cbdd0628af0184f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a00a2c4692459cbdd0628af0184f09 already in progress: creating tablet
I20260928 10:44:01.771072 6275 ts_tablet_manager.cc:1397] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.006s
I20260928 10:44:01.771291 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 406) took 1195 ms. Trace:
I20260928 10:44:01.771458 6269 rpcz_store.cc:276] 0928 10:44:00.575769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.575831 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:01.771174 (+1195343us) ts_tablet_manager.cc:1145] Deleting tablet 122fbbe54c174c4ea9cf38698debcb27
0928 10:44:01.771183 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.771261 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185286}
W20260928 10:44:01.771911 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 122fbbe54c174c4ea9cf38698debcb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 122fbbe54c174c4ea9cf38698debcb27 already in progress: creating tablet
I20260928 10:44:01.771919 6275 raft_consensus.cc:348] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.772239 6269 tablet_replica.cc:330] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.772512 6269 raft_consensus.cc:2229] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.772720 6269 raft_consensus.cc:2258] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.773267 6269 ts_tablet_manager.cc:1905] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.775058 6275 raft_consensus.cc:374] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.775224 6275 raft_consensus.cc:729] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.775604 6275 consensus_queue.cc:260] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.779387 6275 ts_tablet_manager.cc:1428] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260928 10:44:01.782370 6275 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:01.783874 6272 ts_tablet_manager.cc:1918] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.784085 6272 log.cc:1196] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/0a3d035581da47abb64156066e53fa67
I20260928 10:44:01.784494 6272 ts_tablet_manager.cc:1939] T 0a3d035581da47abb64156066e53fa67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:01.784770 6275 tablet_bootstrap.cc:654] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.785210 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 0a3d035581da47abb64156066e53fa67 (table default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99 [id=8c4d995731f94c088f6e4625446cee13]) successfully deleted
W20260928 10:44:01.786015 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 07a0c6ca08884dc6813b25e3991d0d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07a0c6ca08884dc6813b25e3991d0d8c already in progress: creating tablet
W20260928 10:44:01.787081 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 847b18c212474456ac9b40eee055dbd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 847b18c212474456ac9b40eee055dbd0 already in progress: creating tablet
I20260928 10:44:01.787406 6272 tablet_replica.cc:330] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:01.787653 6272 raft_consensus.cc:2229] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.788021 6272 raft_consensus.cc:2258] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.788069 6630 raft_consensus.cc:482] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.788257 6630 raft_consensus.cc:504] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.788842 6272 ts_tablet_manager.cc:1905] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.788843 6630 leader_election.cc:288] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:01.794941 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 503a4bcb9d37441aadf66b45238a3737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:01.814935 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c322d11fab43499f82e077fd8a8c02f3 consensus state has no leader
I20260928 10:44:01.815217 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 98bd99e7bdb647ceb9357f88affc45d9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.815693 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ba8abd00f2742a29fdc79059332b91d from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.817041 6271 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:01.817281 6271 ts_tablet_manager.cc:1397] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.139s user 0.003s sys 0.001s
I20260928 10:44:01.818284 6271 raft_consensus.cc:348] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.818765 6271 raft_consensus.cc:374] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.818904 6271 raft_consensus.cc:729] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.819203 6271 consensus_queue.cc:260] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.824112 6271 ts_tablet_manager.cc:1428] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:01.827920 6682 raft_consensus.cc:482] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.828151 6682 raft_consensus.cc:504] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.828879 6682 leader_election.cc:288] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.829559 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25db69b15eb445792e6168f99304bf2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:01.830293 5818 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.830387 6271 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:01.831560 6270 ts_tablet_manager.cc:1918] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.832719 6270 log.cc:1196] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/6c7a51b960f24a2fbc3f0e851c98b9f9
I20260928 10:44:01.833405 6270 ts_tablet_manager.cc:1939] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:01.836674 6273 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.836956 6273 ts_tablet_manager.cc:1397] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.007s
I20260928 10:44:01.838516 6273 raft_consensus.cc:348] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.838867 6273 raft_consensus.cc:374] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.839007 6273 raft_consensus.cc:729] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.840018 6273 consensus_queue.cc:260] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.840308 6270 tablet_replica.cc:330] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.840423 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (table default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]) successfully deleted
I20260928 10:44:01.840662 6270 raft_consensus.cc:2229] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.840823 6270 raft_consensus.cc:2258] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.840819 6273 ts_tablet_manager.cc:1428] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 10:44:01.832479 6271 tablet_bootstrap.cc:654] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.843109 6269 ts_tablet_manager.cc:1918] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:01.843255 6269 log.cc:1196] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f1f8e172c5bf406196574895e5e5e3c7
I20260928 10:44:01.843665 6269 ts_tablet_manager.cc:1939] T f1f8e172c5bf406196574895e5e5e3c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.843741 6273 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.844470 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 407) took 1140 ms. Trace:
I20260928 10:44:01.844585 6269 rpcz_store.cc:276] 0928 10:44:00.704214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.704276 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:01.772178 (+1067902us) ts_tablet_manager.cc:1145] Deleting tablet f1f8e172c5bf406196574895e5e5e3c7
0928 10:44:01.772187 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.811454 (+ 39267us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.842978 (+ 31524us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.844410 (+ 1432us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067686}
I20260928 10:44:01.845074 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 408) took 1134 ms. Trace:
I20260928 10:44:01.845175 6269 rpcz_store.cc:276] 0928 10:44:00.710292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.710354 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:01.844873 (+1134519us) ts_tablet_manager.cc:1145] Deleting tablet efa178fc1e344069b086003d39f1b848
0928 10:44:01.844900 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.845024 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134239}
I20260928 10:44:01.845358 6273 tablet_bootstrap.cc:654] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.845497 6269 tablet_replica.cc:330] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:01.845427 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f1f8e172c5bf406196574895e5e5e3c7 (table default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
I20260928 10:44:01.845700 6269 raft_consensus.cc:2229] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.845893 6269 raft_consensus.cc:2258] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:01.846561 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet efa178fc1e344069b086003d39f1b848 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa178fc1e344069b086003d39f1b848 already in progress: creating tablet
I20260928 10:44:01.847616 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a6950587aac341189738d1f36a4b6250"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.848177 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6950587aac341189738d1f36a4b6250 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.852649 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_db9a81dcfa8f454d839c829673b77b9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:01.853215 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db9a81dcfa8f454d839c829673b77b9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.850380 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c05f29ca725a46b4bef695b530735cf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:01.856758 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:01.857174 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c05f29ca725a46b4bef695b530735cf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:01.857268 6269 ts_tablet_manager.cc:1905] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.857486 6270 ts_tablet_manager.cc:1905] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.869519 6270 ts_tablet_manager.cc:1918] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.871590 6682 raft_consensus.cc:482] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:01.871755 6682 raft_consensus.cc:504] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.872383 6682 leader_election.cc:288] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.873787 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d38c0ed54b45a89f8e1daefd5b67a1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:01.874382 5818 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.874565 6270 log.cc:1196] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/65905f0cb4154bdcb8ee6702c87d23ca
I20260928 10:44:01.874938 6270 ts_tablet_manager.cc:1939] T 65905f0cb4154bdcb8ee6702c87d23ca P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:01.874984 6273 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.875648 6273 ts_tablet_manager.cc:1397] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.003s
I20260928 10:44:01.875959 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 65905f0cb4154bdcb8ee6702c87d23ca (table default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]) successfully deleted
I20260928 10:44:01.876427 6273 raft_consensus.cc:348] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:01.876605 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 847b18c212474456ac9b40eee055dbd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 847b18c212474456ac9b40eee055dbd0 already in progress: creating tablet
I20260928 10:44:01.876746 6273 raft_consensus.cc:374] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:01.876839 6273 raft_consensus.cc:729] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.877133 6273 consensus_queue.cc:260] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:01.877489 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 07a0c6ca08884dc6813b25e3991d0d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07a0c6ca08884dc6813b25e3991d0d8c already in progress: creating tablet
I20260928 10:44:01.877720 6273 ts_tablet_manager.cc:1428] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:01.878001 6273 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.879877 6270 tablet_replica.cc:330] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.882594 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 877e2d1c734a4e2891119f308f9f3ae8 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.880118 6270 raft_consensus.cc:2229] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.883176 6270 raft_consensus.cc:2258] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.883751 6270 ts_tablet_manager.cc:1905] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.886217 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2e92501b07184f8d9021b31cc4f752fb" } modify_external_catalogs: true
I20260928 10:44:01.886439 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2e92501b07184f8d9021b31cc4f752fb" } modify_external_catalogs: true
I20260928 10:44:01.887439 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8361cd920f64394b922d3f17c2ae915" } modify_external_catalogs: true
I20260928 10:44:01.887643 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8361cd920f64394b922d3f17c2ae915" } modify_external_catalogs: true
W20260928 10:44:01.888902 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f799021aca384269bfcd67829f3a7db5 has no consensus state
I20260928 10:44:01.889261 6273 tablet_bootstrap.cc:654] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.889766 6269 ts_tablet_manager.cc:1918] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.889914 6269 log.cc:1196] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/99202cf0cfac40b2aa54b10b4d96939d
I20260928 10:44:01.890087 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_026184575e69478c879d0441560fcf70" } modify_external_catalogs: true
I20260928 10:44:01.890267 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_026184575e69478c879d0441560fcf70" } modify_external_catalogs: true
I20260928 10:44:01.892220 6682 raft_consensus.cc:482] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:01.892403 6090 leader_election.cc:341] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 0acf2685688e4e108bba66842acedbb9
W20260928 10:44:01.893432 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 96380us
I20260928 10:44:01.894248 6270 ts_tablet_manager.cc:1918] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:01.894450 6270 log.cc:1196] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/7dba507179ed44ce903111622ec1fb42
I20260928 10:44:01.894325 6682 raft_consensus.cc:504] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:01.894794 6091 leader_election.cc:341] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0acf2685688e4e108bba66842acedbb9
I20260928 10:44:01.894960 6682 leader_election.cc:288] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:01.895095 6269 ts_tablet_manager.cc:1939] T 99202cf0cfac40b2aa54b10b4d96939d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:01.895572 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d5dd4e5b544262938b1822510d8b9f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:01.895850 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 409) took 1154 ms. Trace:
I20260928 10:44:01.895985 6269 rpcz_store.cc:276] 0928 10:44:00.741538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:00.741599 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:01.845421 (+1103822us) ts_tablet_manager.cc:1145] Deleting tablet 99202cf0cfac40b2aa54b10b4d96939d
0928 10:44:01.845430 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.860567 (+ 15137us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.889581 (+ 29014us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:01.895817 (+ 6236us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1103562}
I20260928 10:44:01.896127 6091 leader_election.cc:302] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:01.896229 5818 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:01.896425 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 92366.6us
I20260928 10:44:01.896785 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 99202cf0cfac40b2aa54b10b4d96939d (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
I20260928 10:44:01.897059 6270 ts_tablet_manager.cc:1939] T 7dba507179ed44ce903111622ec1fb42 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:01.898102 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 7dba507179ed44ce903111622ec1fb42 (table default.Table_8b6de790cff44909b80e9ab812bb2d60 [id=4c0912577f204df2a369e5a7be835b49]) successfully deleted
W20260928 10:44:01.898802 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48ccd7551f6a4fc8b41e70e94749e6f1 already in progress: creating tablet
I20260928 10:44:01.896345 6269 tablet_replica.cc:330] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:01.899435 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4a9fb31988e4447f9c4a694056d6e54f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a9fb31988e4447f9c4a694056d6e54f already in progress: creating tablet
I20260928 10:44:01.899541 6269 raft_consensus.cc:2229] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.899744 6269 raft_consensus.cc:2258] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:01.900111 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 490f8a4f1f9245cfab168b96511e18de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490f8a4f1f9245cfab168b96511e18de already in progress: creating tablet
I20260928 10:44:01.900352 6269 ts_tablet_manager.cc:1905] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:01.900498 6270 tablet_replica.cc:330] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:01.900730 6270 raft_consensus.cc:2229] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:01.900952 6270 raft_consensus.cc:2258] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:01.901113 6630 raft_consensus.cc:2726] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.902578 6273 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:01.903028 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d5dd4e5b544262938b1822510d8b9f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:01.903154 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d38c0ed54b45a89f8e1daefd5b67a1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:01.903437 6273 ts_tablet_manager.cc:1397] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.001s
I20260928 10:44:01.903000 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25db69b15eb445792e6168f99304bf2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:01.904381 6273 raft_consensus.cc:348] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:01.904633 6273 raft_consensus.cc:374] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:01.904656 5817 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.904747 6273 raft_consensus.cc:729] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:01.904808 5817 leader_election.cc:302] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.905119 6273 consensus_queue.cc:260] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:01.905354 5817 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:01.905479 5817 leader_election.cc:302] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:01.905812 6682 raft_consensus.cc:2726] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:01.906031 6682 raft_consensus.cc:2726] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:01.920640 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 consensus state has no leader
I20260928 10:44:01.924396 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 0acf2685688e4e108bba66842acedbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:01.927946 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 (DEFAULT_TABLE table=default.Table_d8be5cda7ca54bef9c60c4c1bc88a460 [id=a3ea888f62864718bf54b5d764fd4a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.928514 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9319d4d4102e43b19c0caa0b0a4b4740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.930831 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:01.933487 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 (DEFAULT_TABLE table=default.Table_d8be5cda7ca54bef9c60c4c1bc88a460 [id=a3ea888f62864718bf54b5d764fd4a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.934033 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9319d4d4102e43b19c0caa0b0a4b4740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.934895 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 32560e881a1d4444a706bb8b60dda499 (DEFAULT_TABLE table=default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5 [id=e2eada457f2541f48d11a4652b64c7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.935374 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32560e881a1d4444a706bb8b60dda499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.937461 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 84c30726853549dfbc57f65fd31603fa (DEFAULT_TABLE table=default.Table_afd6eb9c78464f419465f6375df9d5cf [id=17317e8a64f24899884b053bbb419d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.937626 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 32560e881a1d4444a706bb8b60dda499 (DEFAULT_TABLE table=default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5 [id=e2eada457f2541f48d11a4652b64c7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.938519 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 22c4cea3f8ea413493c3ac23f83d0801 (DEFAULT_TABLE table=default.Table_6c902309876c48ae976ee0fb5e3d43c9 [id=263ec4300c4145479b53f240aad4198a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.938788 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 22c4cea3f8ea413493c3ac23f83d0801 (DEFAULT_TABLE table=default.Table_6c902309876c48ae976ee0fb5e3d43c9 [id=263ec4300c4145479b53f240aad4198a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.938803 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 381b12c993c74ba6ba78804c1f6c01e3 (DEFAULT_TABLE table=default.Table_a89653eaa7ec4ee3abdd48beaad49fce [id=adebad10f1c44a129db689cdaa9d327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.939098 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 9012fa19e01f43238c895a84c6dc9815 (DEFAULT_TABLE table=default.Table_74b56feae3a142d1931815dd8a85abc1 [id=50bf91efd5f24016b5b2b68b53939cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.939172 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22c4cea3f8ea413493c3ac23f83d0801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.937467 6126 tablet_service.cc:1467] Processing CreateTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f (DEFAULT_TABLE table=default.Table_5b4574fdeb284c7993e1f8dc100e9222 [id=4960f7a426eb4e6eafc506f69e15fdb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.939572 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 (DEFAULT_TABLE table=default.Table_81202df4ff1046078af574bab4d9d26f [id=733e3081c7374a06b8310c1f2b6a513a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.938514 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c30726853549dfbc57f65fd31603fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.939971 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c8c53b5ae244cda8dff396935fc8e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.940249 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381b12c993c74ba6ba78804c1f6c01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.942775 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 9012fa19e01f43238c895a84c6dc9815 (DEFAULT_TABLE table=default.Table_74b56feae3a142d1931815dd8a85abc1 [id=50bf91efd5f24016b5b2b68b53939cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.943162 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9012fa19e01f43238c895a84c6dc9815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.946542 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba67a229f61e4a6b8078b59fe89fae7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.946848 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9012fa19e01f43238c895a84c6dc9815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.946833 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 (DEFAULT_TABLE table=default.Table_81202df4ff1046078af574bab4d9d26f [id=733e3081c7374a06b8310c1f2b6a513a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.947212 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c8c53b5ae244cda8dff396935fc8e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.950657 5851 tablet_service.cc:1467] Processing CreateTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f (DEFAULT_TABLE table=default.Table_5b4574fdeb284c7993e1f8dc100e9222 [id=4960f7a426eb4e6eafc506f69e15fdb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.951045 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba67a229f61e4a6b8078b59fe89fae7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.951045 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32560e881a1d4444a706bb8b60dda499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.954664 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22c4cea3f8ea413493c3ac23f83d0801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.954821 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 84c30726853549dfbc57f65fd31603fa (DEFAULT_TABLE table=default.Table_afd6eb9c78464f419465f6375df9d5cf [id=17317e8a64f24899884b053bbb419d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.955185 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c30726853549dfbc57f65fd31603fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.962667 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 (DEFAULT_TABLE table=default.Table_d8be5cda7ca54bef9c60c4c1bc88a460 [id=a3ea888f62864718bf54b5d764fd4a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.963158 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9319d4d4102e43b19c0caa0b0a4b4740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.966920 6131 tablet_service.cc:1467] Processing CreateTablet for tablet c780d8c23a764f769848fa04550ceff6 (DEFAULT_TABLE table=default.Table_7c7420744fac446aa019cdc18caea501 [id=fe22abbd1be44e338619de8d022363d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.967384 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c780d8c23a764f769848fa04550ceff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.967887 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 381b12c993c74ba6ba78804c1f6c01e3 (DEFAULT_TABLE table=default.Table_a89653eaa7ec4ee3abdd48beaad49fce [id=adebad10f1c44a129db689cdaa9d327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.968303 5845 tablet_service.cc:1467] Processing CreateTablet for tablet b1cdff9f01974354a81179dd9bd5a26e (DEFAULT_TABLE table=default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.968575 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 270d4148268a47e5a6a5e71651eb0b12 (DEFAULT_TABLE table=default.Table_04b8310373fe46d29d461a489ceba2c0 [id=edb4ef9a96d34d53b907edcc030a4491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.968895 5846 tablet_service.cc:1467] Processing CreateTablet for tablet c780d8c23a764f769848fa04550ceff6 (DEFAULT_TABLE table=default.Table_7c7420744fac446aa019cdc18caea501 [id=fe22abbd1be44e338619de8d022363d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.969074 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.969604 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 79d1021f0b844a348e3fbed913758650 (DEFAULT_TABLE table=default.Table_6cf56fe048a6439b8252398f6bb6e503 [id=2ffb63513a054c8face49deb4cdcb63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.970022 6123 tablet_service.cc:1467] Processing CreateTablet for tablet bcecdf79aafe497080e2a1f6256ef6fd (DEFAULT_TABLE table=default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.970084 5854 tablet_service.cc:1467] Processing CreateTablet for tablet c22cc964ceb741febfd3d1322ae05289 (DEFAULT_TABLE table=default.Table_5607fa1f3fd0455abf4c687e67afde0e [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.970110 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.970393 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcecdf79aafe497080e2a1f6256ef6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.968314 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381b12c993c74ba6ba78804c1f6c01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.970696 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c780d8c23a764f769848fa04550ceff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.970126 6117 tablet_service.cc:1467] Processing CreateTablet for tablet c22cc964ceb741febfd3d1322ae05289 (DEFAULT_TABLE table=default.Table_5607fa1f3fd0455abf4c687e67afde0e [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.971060 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22cc964ceb741febfd3d1322ae05289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.971658 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 79d1021f0b844a348e3fbed913758650 (DEFAULT_TABLE table=default.Table_6cf56fe048a6439b8252398f6bb6e503 [id=2ffb63513a054c8face49deb4cdcb63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.972880 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f42d5aef2424b3aacc8564d98cd3b67 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:01.971081 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22cc964ceb741febfd3d1322ae05289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.974615 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cdff9f01974354a81179dd9bd5a26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.974745 6135 tablet_service.cc:1467] Processing CreateTablet for tablet b1cdff9f01974354a81179dd9bd5a26e (DEFAULT_TABLE table=default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.974992 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79d1021f0b844a348e3fbed913758650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.975096 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cdff9f01974354a81179dd9bd5a26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.976871 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.978125 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270d4148268a47e5a6a5e71651eb0b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.981217 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79d1021f0b844a348e3fbed913758650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.982707 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.984413 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 (DEFAULT_TABLE table=default.Table_876356586bbc4fa09b7cd43884e6ff24 [id=a58bcb6b8bfb4be5b5417b4d12bb9852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.984733 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c6ed97f74540b786ed3a6378dea0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.971046 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 270d4148268a47e5a6a5e71651eb0b12 (DEFAULT_TABLE table=default.Table_04b8310373fe46d29d461a489ceba2c0 [id=edb4ef9a96d34d53b907edcc030a4491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.985396 6273 ts_tablet_manager.cc:1428] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.082s user 0.002s sys 0.003s
I20260928 10:44:01.985708 6273 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:01.986951 6275 tablet_bootstrap.cc:492] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:01.987115 6275 ts_tablet_manager.cc:1397] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.205s user 0.016s sys 0.023s
I20260928 10:44:01.987401 6273 tablet_bootstrap.cc:654] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:01.988006 6275 raft_consensus.cc:348] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:01.988822 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270d4148268a47e5a6a5e71651eb0b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.996690 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 32560e881a1d4444a706bb8b60dda499 (DEFAULT_TABLE table=default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5 [id=e2eada457f2541f48d11a4652b64c7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:01.997152 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32560e881a1d4444a706bb8b60dda499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:01.999431 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5b4574fdeb284c7993e1f8dc100e9222" } modify_external_catalogs: true
I20260928 10:44:01.999667 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5b4574fdeb284c7993e1f8dc100e9222" } modify_external_catalogs: true
I20260928 10:44:01.999794 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 9012fa19e01f43238c895a84c6dc9815 (DEFAULT_TABLE table=default.Table_74b56feae3a142d1931815dd8a85abc1 [id=50bf91efd5f24016b5b2b68b53939cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.000211 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9012fa19e01f43238c895a84c6dc9815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.001142 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81202df4ff1046078af574bab4d9d26f" } modify_external_catalogs: true
I20260928 10:44:02.001380 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81202df4ff1046078af574bab4d9d26f" } modify_external_catalogs: true
I20260928 10:44:02.001543 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 22c4cea3f8ea413493c3ac23f83d0801 (DEFAULT_TABLE table=default.Table_6c902309876c48ae976ee0fb5e3d43c9 [id=263ec4300c4145479b53f240aad4198a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.003932 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22c4cea3f8ea413493c3ac23f83d0801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.009605 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 20ea1325da4e460da08377f5d6d6a055 (DEFAULT_TABLE table=default.Table_8a416d7aa4cc45559e97ce1cd36575a1 [id=c40b432db2ed4df79ab951498d2bfe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.010088 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ea1325da4e460da08377f5d6d6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.010689 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 (DEFAULT_TABLE table=default.Table_19576f3ea75745b09af525ae5b30f0a2 [id=01274b7dde224a98ae1da73c01701045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.013015 6123 tablet_service.cc:1467] Processing CreateTablet for tablet a87dd8e89c394e4f96c9d8c5fed17e66 (DEFAULT_TABLE table=default.Table_eb4c3825bbaa466480697ebfb8b81161 [id=48d4915dc56c4952ac72c64671c05943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.013809 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87dd8e89c394e4f96c9d8c5fed17e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.014777 6131 tablet_service.cc:1467] Processing CreateTablet for tablet d39e1e4d18d6450580e28614ae4c2895 (DEFAULT_TABLE table=default.Table_a8e76b8804da448caf6371b096913891 [id=db68c7086ebf437fa18f398767d98b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.014420 6275 raft_consensus.cc:374] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.015460 6275 raft_consensus.cc:729] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.015590 5846 tablet_service.cc:1467] Processing CreateTablet for tablet bcecdf79aafe497080e2a1f6256ef6fd (DEFAULT_TABLE table=default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.015987 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 (DEFAULT_TABLE table=default.Table_876356586bbc4fa09b7cd43884e6ff24 [id=a58bcb6b8bfb4be5b5417b4d12bb9852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.016206 6275 consensus_queue.cc:260] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.016286 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 20ea1325da4e460da08377f5d6d6a055 (DEFAULT_TABLE table=default.Table_8a416d7aa4cc45559e97ce1cd36575a1 [id=c40b432db2ed4df79ab951498d2bfe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.016538 5862 tablet_service.cc:1467] Processing CreateTablet for tablet a87dd8e89c394e4f96c9d8c5fed17e66 (DEFAULT_TABLE table=default.Table_eb4c3825bbaa466480697ebfb8b81161 [id=48d4915dc56c4952ac72c64671c05943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.016806 6275 ts_tablet_manager.cc:1428] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260928 10:44:02.021669 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.023272 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 877e2d1c734a4e2891119f308f9f3ae8
I20260928 10:44:02.023777 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 877e2d1c734a4e2891119f308f9f3ae8 deleted and replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65
I20260928 10:44:02.024036 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 (DEFAULT_TABLE table=default.Table_876356586bbc4fa09b7cd43884e6ff24 [id=a58bcb6b8bfb4be5b5417b4d12bb9852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.023509 5989 tablet_service.cc:1467] Processing CreateTablet for tablet b1cdff9f01974354a81179dd9bd5a26e (DEFAULT_TABLE table=default.Table_134f33c0d27c4f579572dcad2654bc65 [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.026271 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39e1e4d18d6450580e28614ae4c2895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.024626 5994 tablet_service.cc:1467] Processing CreateTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f (DEFAULT_TABLE table=default.Table_5b4574fdeb284c7993e1f8dc100e9222 [id=4960f7a426eb4e6eafc506f69e15fdb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.027228 5987 tablet_service.cc:1467] Processing CreateTablet for tablet c780d8c23a764f769848fa04550ceff6 (DEFAULT_TABLE table=default.Table_7c7420744fac446aa019cdc18caea501 [id=fe22abbd1be44e338619de8d022363d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.027506 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 79d1021f0b844a348e3fbed913758650 (DEFAULT_TABLE table=default.Table_6cf56fe048a6439b8252398f6bb6e503 [id=2ffb63513a054c8face49deb4cdcb63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.027763 5983 tablet_service.cc:1467] Processing CreateTablet for tablet bcecdf79aafe497080e2a1f6256ef6fd (DEFAULT_TABLE table=default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.028023 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 (DEFAULT_TABLE table=default.Table_81202df4ff1046078af574bab4d9d26f [id=733e3081c7374a06b8310c1f2b6a513a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.028179 6275 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.028694 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.029708 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:02.030023 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 381b12c993c74ba6ba78804c1f6c01e3 (DEFAULT_TABLE table=default.Table_a89653eaa7ec4ee3abdd48beaad49fce [id=adebad10f1c44a129db689cdaa9d327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.030802 5995 tablet_service.cc:1467] Processing CreateTablet for tablet c22cc964ceb741febfd3d1322ae05289 (DEFAULT_TABLE table=default.Table_5607fa1f3fd0455abf4c687e67afde0e [id=643bd72a41aa4477bc796c4a43eef8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.031090 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c6ed97f74540b786ed3a6378dea0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.031733 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 84c30726853549dfbc57f65fd31603fa (DEFAULT_TABLE table=default.Table_afd6eb9c78464f419465f6375df9d5cf [id=17317e8a64f24899884b053bbb419d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.032773 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 20ea1325da4e460da08377f5d6d6a055 (DEFAULT_TABLE table=default.Table_8a416d7aa4cc45559e97ce1cd36575a1 [id=c40b432db2ed4df79ab951498d2bfe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.034390 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:02.034371 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d5dd4e5b544262938b1822510d8b9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.035630 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 270d4148268a47e5a6a5e71651eb0b12 (DEFAULT_TABLE table=default.Table_04b8310373fe46d29d461a489ceba2c0 [id=edb4ef9a96d34d53b907edcc030a4491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.039865 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.044425 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 463cf5ecb52d40069b564698433c6781
I20260928 10:44:02.048543 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.049208 5847 tablet_service.cc:1467] Processing CreateTablet for tablet d39e1e4d18d6450580e28614ae4c2895 (DEFAULT_TABLE table=default.Table_a8e76b8804da448caf6371b096913891 [id=db68c7086ebf437fa18f398767d98b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.061612 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:02.062103 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 5f42d5aef2424b3aacc8564d98cd3b67 deleted and replaced by tablet 0e4594eae7b840ff980f67da8ed82e01
I20260928 10:44:02.065827 6275 tablet_bootstrap.cc:654] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.069085 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 0e149cdb22cc4c60b012c2d87868827b (DEFAULT_TABLE table=default.Table_b8e5fedeb2f242fca078d64788bf6c33 [id=60cc8d4d98524885be57b8bf246f2182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.069578 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e149cdb22cc4c60b012c2d87868827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.078361 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ba67a229f61e4a6b8078b59fe89fae7f
I20260928 10:44:02.079898 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1c8c53b5ae244cda8dff396935fc8e82
I20260928 10:44:02.080626 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.081753 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.082656 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.083930 6275 tablet_bootstrap.cc:492] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.084626 6275 ts_tablet_manager.cc:1397] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.005s
I20260928 10:44:02.086249 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cdff9f01974354a81179dd9bd5a26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.086596 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba67a229f61e4a6b8078b59fe89fae7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.087852 6275 raft_consensus.cc:348] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.088943 6275 raft_consensus.cc:374] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.089299 6275 raft_consensus.cc:729] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.090499 6275 consensus_queue.cc:260] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.092801 6275 ts_tablet_manager.cc:1428] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260928 10:44:02.093721 6272 ts_tablet_manager.cc:1918] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.094935 6272 log.cc:1196] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/6c7a51b960f24a2fbc3f0e851c98b9f9
I20260928 10:44:02.094985 6275 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.095584 6272 ts_tablet_manager.cc:1939] T 6c7a51b960f24a2fbc3f0e851c98b9f9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.098007 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 6c7a51b960f24a2fbc3f0e851c98b9f9 (table default.Table_df02222b4af8499b8e742bf0e39201f0 [id=052ae059524f476e810d7fb006cc2810]) successfully deleted
W20260928 10:44:02.098934 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48ccd7551f6a4fc8b41e70e94749e6f1 already in progress: creating tablet
W20260928 10:44:02.100046 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4a9fb31988e4447f9c4a694056d6e54f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a9fb31988e4447f9c4a694056d6e54f already in progress: creating tablet
I20260928 10:44:02.100936 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 29a1be37ede84ea485182044be92b8c6 (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:02.101868 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 490f8a4f1f9245cfab168b96511e18de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490f8a4f1f9245cfab168b96511e18de already in progress: creating tablet
I20260928 10:44:02.102209 6275 tablet_bootstrap.cc:654] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.102746 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a1be37ede84ea485182044be92b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.102998 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 503a4bcb9d37441aadf66b45238a3737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503a4bcb9d37441aadf66b45238a3737 already in progress: creating tablet
I20260928 10:44:02.103327 6272 tablet_replica.cc:330] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.103842 6272 raft_consensus.cc:2229] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.104115 6272 raft_consensus.cc:2258] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.113579 6272 ts_tablet_manager.cc:1905] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.115881 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcecdf79aafe497080e2a1f6256ef6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.115962 6682 raft_consensus.cc:482] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.116233 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ea1325da4e460da08377f5d6d6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.116197 6682 raft_consensus.cc:504] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.116921 6682 leader_election.cc:288] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:02.118067 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 107514us
I20260928 10:44:02.120584 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.121935 6275 tablet_bootstrap.cc:492] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.122761 6275 ts_tablet_manager.cc:1397] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
I20260928 10:44:02.123891 6275 raft_consensus.cc:348] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.125414 6272 ts_tablet_manager.cc:1918] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.131062 6272 log.cc:1196] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/16f7d561b10e46609f22ce17b323fb23
I20260928 10:44:02.130920 6275 raft_consensus.cc:374] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.131417 6275 raft_consensus.cc:729] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.131623 6272 ts_tablet_manager.cc:1939] T 16f7d561b10e46609f22ce17b323fb23 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.132856 6272 tablet_replica.cc:330] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.133119 6272 raft_consensus.cc:2229] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.133347 6272 raft_consensus.cc:2258] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.134377 6272 ts_tablet_manager.cc:1905] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.141781 6272 ts_tablet_manager.cc:1918] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.147563 5997 tablet_service.cc:1467] Processing CreateTablet for tablet a87dd8e89c394e4f96c9d8c5fed17e66 (DEFAULT_TABLE table=default.Table_eb4c3825bbaa466480697ebfb8b81161 [id=48d4915dc56c4952ac72c64671c05943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.151423 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcecdf79aafe497080e2a1f6256ef6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.152536 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd13e6a9d8f04fa3abb8d22a80932dae" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.148936 5998 tablet_service.cc:1467] Processing CreateTablet for tablet d39e1e4d18d6450580e28614ae4c2895 (DEFAULT_TABLE table=default.Table_a8e76b8804da448caf6371b096913891 [id=db68c7086ebf437fa18f398767d98b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.149073 6133 tablet_service.cc:1467] Processing CreateTablet for tablet df846e6bb5b54ddd8ac5df678803d739 (DEFAULT_TABLE table=default.Table_b63402f58ca449a4bd05369cc751445e [id=59fcbd230b544a6fb3e3fc3888be0f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.155684 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df846e6bb5b54ddd8ac5df678803d739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.155990 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.156368 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4594eae7b840ff980f67da8ed82e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.161257 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 0e149cdb22cc4c60b012c2d87868827b (DEFAULT_TABLE table=default.Table_b8e5fedeb2f242fca078d64788bf6c33 [id=60cc8d4d98524885be57b8bf246f2182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.161731 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87dd8e89c394e4f96c9d8c5fed17e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.132077 6275 consensus_queue.cc:260] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.164271 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39e1e4d18d6450580e28614ae4c2895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.164467 6132 tablet_service.cc:1467] Processing CreateTablet for tablet f799021aca384269bfcd67829f3a7db5 (DEFAULT_TABLE table=default.Table_2d2f6d17577e40a38a8af4624ead8bd1 [id=fe0ad2a84ee1475cbe49aec04d48f5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.164871 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799021aca384269bfcd67829f3a7db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.166340 6275 ts_tablet_manager.cc:1428] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260928 10:44:02.153312 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e (DEFAULT_TABLE table=default.Table_ec07c562189f47a280a2e75408d42ff5 [id=ac2ebddfd65c4db7bd12ef76a96072f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.167748 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.170542 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c8c53b5ae244cda8dff396935fc8e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.170897 6131 tablet_service.cc:1467] Processing CreateTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.171312 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea90e2cbd7624baab1522b8b4afa5f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.171458 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e149cdb22cc4c60b012c2d87868827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.173815 6134 tablet_service.cc:1467] Processing CreateTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 (DEFAULT_TABLE table=default.Table_d8589e4891fc44778c83c70292d08586 [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.174194 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03f686afffc4d47b5e27fdbc8eb8f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.174321 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 917513e857de49a7a57416eca237f70b (DEFAULT_TABLE table=default.Table_8b18320697c0483895d8cef27a3f663f [id=c6497815b1e84d11a9a54ed1f744948c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.175084 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917513e857de49a7a57416eca237f70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.176273 6118 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce585cc60d4001b12cb335929b9efb (DEFAULT_TABLE table=default.Table_2791ed0f44e341b6bf437f3eaa4b97a9 [id=74ea354eea8e4e5c8ed65b1502681cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.176658 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce585cc60d4001b12cb335929b9efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.178855 6275 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.180636 6275 tablet_bootstrap.cc:654] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.180598 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.184302 6133 tablet_service.cc:1467] Processing CreateTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 (DEFAULT_TABLE table=default.Table_bb3b4a291acb4121ae9e440fc315a891 [id=7a59d9d4e598496c9854a10ac0c6cb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.184846 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b217b6d4ad9a495795fe2b923144e8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.153640 6123 tablet_service.cc:1467] Processing CreateTablet for tablet ed443629ab604099a6fe5aff1840a553 (DEFAULT_TABLE table=default.Table_a6950587aac341189738d1f36a4b6250 [id=0d8f33fcda59488c8ebc3791be19384b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.153954 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 946188e312c6424f81926465667b5e11 (DEFAULT_TABLE table=default.Table_db9a81dcfa8f454d839c829673b77b9e [id=fa8505c90e814bfba8e693650ff889cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.186416 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946188e312c6424f81926465667b5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.154774 6136 tablet_service.cc:1467] Processing CreateTablet for tablet db7ba94f3efa4acda249ea0375547cc9 (DEFAULT_TABLE table=default.Table_2a5049f83fce42b0ab5b4beea486d708 [id=c423f78cb6574ea7828bc4cb94712908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.150586 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6f388d56f04696940caef30b213ca6 (DEFAULT_TABLE table=default.Table_409bf812ca684359b4bf9c0e9858ba1b [id=3f375f4cb4f34d57a8a5d38d8655325d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.196331 6132 tablet_service.cc:1467] Processing CreateTablet for tablet b254b5f8163d45cc8e1beb77d6ac4a65 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.196774 6118 tablet_service.cc:1467] Processing CreateTablet for tablet d03fd57e996c486384f92000925aff8a (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.201448 6128 tablet_service.cc:1467] Processing CreateTablet for tablet d6c48b8a7efa41a684205df3e6969370 (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.201829 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ea1325da4e460da08377f5d6d6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.197031 6135 tablet_service.cc:1467] Processing CreateTablet for tablet eb945bc6b99a44e0932b2a94f05db6c2 (DEFAULT_TABLE table=default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.203274 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22cc964ceb741febfd3d1322ae05289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.206136 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270d4148268a47e5a6a5e71651eb0b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.207234 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c780d8c23a764f769848fa04550ceff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.209450 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79d1021f0b844a348e3fbed913758650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.210342 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 0cffc63bccf448a7a59e311640567e4a (DEFAULT_TABLE table=default.Table_99610979832a4035a4a742164395bb0f [id=9d897090b86f467ba44c140e859a220e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.211490 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d5dd4e5b544262938b1822510d8b9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.213618 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7ba94f3efa4acda249ea0375547cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.213989 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c48b8a7efa41a684205df3e6969370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.216167 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03fd57e996c486384f92000925aff8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.218742 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb945bc6b99a44e0932b2a94f05db6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.219388 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b254b5f8163d45cc8e1beb77d6ac4a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.219681 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cffc63bccf448a7a59e311640567e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.220554 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 (DEFAULT_TABLE table=default.Table_e980d7f015ba49d1b8b828e2d1f89593 [id=9fbefe39be814729a3b4dfc471ae28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.221024 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f13643dbb64dcf97c4d6d94c22d8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.224442 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c30726853549dfbc57f65fd31603fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.224939 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381b12c993c74ba6ba78804c1f6c01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.225705 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6f388d56f04696940caef30b213ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.226712 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.227145 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.227435 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.231482 6275 tablet_bootstrap.cc:492] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.232234 6275 ts_tablet_manager.cc:1397] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.001s
I20260928 10:44:02.237824 6270 ts_tablet_manager.cc:1905] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.242456 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_27cacb67cfd44997b4f82d950e931f47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.244920 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27cacb67cfd44997b4f82d950e931f47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.242746 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0fd9d5a5cd454643973fba6cab7daa7f" } new_table_name: "default.Table_de468dcafe554bba9d4279813098e5d5" modify_external_catalogs: true
I20260928 10:44:02.242983 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_06e973961b9046a6898291edb23e85b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.247833 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06e973961b9046a6898291edb23e85b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.243156 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9a013dca23c84607871b1ce448aeee78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.249387 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a013dca23c84607871b1ce448aeee78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.243321 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dc893248efaa4d91bb9d16c3b6d9c85a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.250833 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc893248efaa4d91bb9d16c3b6d9c85a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.243460 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b63402f58ca449a4bd05369cc751445e" } new_table_name: "default.Table_9a5b7527d09b40078823a200d89c1e2d" modify_external_catalogs: true
I20260928 10:44:02.243610 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d820b51d65fe47c8a8636d537671a0a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.253052 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d820b51d65fe47c8a8636d537671a0a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.243810 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_96735822e535485388cefe7e10d7c0d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.254542 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96735822e535485388cefe7e10d7c0d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.243969 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bf940beada1a4c9a97761e9d2dc66c94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:02.244062 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet a908ac5d44a74c05b35f6853ab769d91 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:02.256601 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf940beada1a4c9a97761e9d2dc66c94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:02.274425 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 consensus state has no leader
I20260928 10:44:02.275151 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 427b96ce675d48629fcbf8bbcf6e500e from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:02.239185 6271 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:02.239104 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.293728 6272 log.cc:1196] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/0acf2685688e4e108bba66842acedbb9
I20260928 10:44:02.249719 6001 tablet_service.cc:1467] Processing CreateTablet for tablet ed443629ab604099a6fe5aff1840a553 (DEFAULT_TABLE table=default.Table_a6950587aac341189738d1f36a4b6250 [id=0d8f33fcda59488c8ebc3791be19384b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.254724 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.259048 5988 tablet_service.cc:1467] Processing CreateTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.268281 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 29a1be37ede84ea485182044be92b8c6 (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.271073 5989 tablet_service.cc:1467] Processing CreateTablet for tablet df846e6bb5b54ddd8ac5df678803d739 (DEFAULT_TABLE table=default.Table_b63402f58ca449a4bd05369cc751445e [id=59fcbd230b544a6fb3e3fc3888be0f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.273881 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e (DEFAULT_TABLE table=default.Table_ec07c562189f47a280a2e75408d42ff5 [id=ac2ebddfd65c4db7bd12ef76a96072f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.280790 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6f388d56f04696940caef30b213ca6 (DEFAULT_TABLE table=default.Table_409bf812ca684359b4bf9c0e9858ba1b [id=3f375f4cb4f34d57a8a5d38d8655325d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.287370 5998 tablet_service.cc:1467] Processing CreateTablet for tablet db7ba94f3efa4acda249ea0375547cc9 (DEFAULT_TABLE table=default.Table_2a5049f83fce42b0ab5b4beea486d708 [id=c423f78cb6574ea7828bc4cb94712908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.016975 6712 raft_consensus.cc:482] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.298552 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed443629ab604099a6fe5aff1840a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.300755 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea90e2cbd7624baab1522b8b4afa5f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.301757 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.303133 5991 tablet_service.cc:1467] Processing CreateTablet for tablet f799021aca384269bfcd67829f3a7db5 (DEFAULT_TABLE table=default.Table_2d2f6d17577e40a38a8af4624ead8bd1 [id=fe0ad2a84ee1475cbe49aec04d48f5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.303755 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 946188e312c6424f81926465667b5e11 (DEFAULT_TABLE table=default.Table_db9a81dcfa8f454d839c829673b77b9e [id=fa8505c90e814bfba8e693650ff889cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.305503 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed443629ab604099a6fe5aff1840a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.306833 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e140be79b9e24b58a59051919415af22" } new_table_name: "default.Table_72fa42e53bb14b278e9f91b8c5276960" modify_external_catalogs: true
I20260928 10:44:02.307925 6275 raft_consensus.cc:348] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.308225 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f3ec53daf068417ea2f10390d2736b66" } new_table_name: "default.Table_2fbadc72e6434348aedb000cdb6b9579" modify_external_catalogs: true
I20260928 10:44:02.309962 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_aae329bcf05349da8b851e709092bed2" } new_table_name: "default.Table_6089745a618d42d496cff786eba718fa" modify_external_catalogs: true
I20260928 10:44:02.311044 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6f388d56f04696940caef30b213ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.314021 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39e1e4d18d6450580e28614ae4c2895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.314369 6275 raft_consensus.cc:374] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.314489 6275 raft_consensus.cc:729] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.316004 6275 consensus_queue.cc:260] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.316635 6275 ts_tablet_manager.cc:1428] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.084s user 0.002s sys 0.000s
I20260928 10:44:02.317904 6275 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.320465 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 8854c8a8e4024c6db4cb6b21d6ae021f with delete_type TABLET_DATA_DELETED (replaced by tablet 99202cf0cfac40b2aa54b10b4d96939d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.320956 6272 ts_tablet_manager.cc:1939] T 0acf2685688e4e108bba66842acedbb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.323238 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e518e1e5c90b4f0bac535431691e53fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.323977 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e518e1e5c90b4f0bac535431691e53fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.324687 5984 tablet_service.cc:1467] Processing CreateTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 (DEFAULT_TABLE table=default.Table_d8589e4891fc44778c83c70292d08586 [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.325075 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.326750 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_754bf685bb8c4369a74a707d39d5ec08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.327390 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_754bf685bb8c4369a74a707d39d5ec08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:02.328665 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df846e6bb5b54ddd8ac5df678803d739 consensus state has no leader
I20260928 10:44:02.329820 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 0acf2685688e4e108bba66842acedbb9 (table default.Table_10c71f17ff0344b3b76588ee83bbbf40 [id=d1e8ef0e2d284ed7944eab1aa41e1a50]) successfully deleted
W20260928 10:44:02.330103 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 877e2d1c734a4e2891119f308f9f3ae8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877e2d1c734a4e2891119f308f9f3ae8 already in progress: creating tablet
I20260928 10:44:02.332016 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799021aca384269bfcd67829f3a7db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.333046 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4594eae7b840ff980f67da8ed82e01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.333312 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 87d5dd4e5b544262938b1822510d8b9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d5dd4e5b544262938b1822510d8b9f already in progress: creating tablet
W20260928 10:44:02.333566 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1f3d2c79118e44bca3540d3e3ff524a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3d2c79118e44bca3540d3e3ff524a6 already in progress: creating tablet
W20260928 10:44:02.333782 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 463cf5ecb52d40069b564698433c6781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 463cf5ecb52d40069b564698433c6781 already in progress: creating tablet
W20260928 10:44:02.334003 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ba67a229f61e4a6b8078b59fe89fae7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba67a229f61e4a6b8078b59fe89fae7f already in progress: creating tablet
W20260928 10:44:02.334177 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1c8c53b5ae244cda8dff396935fc8e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c8c53b5ae244cda8dff396935fc8e82 already in progress: creating tablet
W20260928 10:44:02.334374 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5f42d5aef2424b3aacc8564d98cd3b67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f42d5aef2424b3aacc8564d98cd3b67 already in progress: creating tablet
I20260928 10:44:02.334874 6272 tablet_replica.cc:330] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.335099 6272 raft_consensus.cc:2229] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.335456 6272 raft_consensus.cc:2258] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.338740 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df846e6bb5b54ddd8ac5df678803d739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.340807 6272 ts_tablet_manager.cc:1905] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.346333 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946188e312c6424f81926465667b5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.351511 6271 ts_tablet_manager.cc:1397] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.463s user 0.004s sys 0.000s
I20260928 10:44:02.352429 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7ba94f3efa4acda249ea0375547cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.355502 6275 tablet_bootstrap.cc:654] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.357918 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a1be37ede84ea485182044be92b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.359052 6630 raft_consensus.cc:482] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.359709 6630 raft_consensus.cc:504] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.360826 6630 leader_election.cc:288] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:02.364914 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:02.365135 5818 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.365275 6682 raft_consensus.cc:482] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.366276 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d5dd4e5b544262938b1822510d8b9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:02.368775 5817 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.373975 6272 ts_tablet_manager.cc:1918] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.374121 6272 log.cc:1196] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8854c8a8e4024c6db4cb6b21d6ae021f
I20260928 10:44:02.374504 6272 ts_tablet_manager.cc:1939] T 8854c8a8e4024c6db4cb6b21d6ae021f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.377031 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8854c8a8e4024c6db4cb6b21d6ae021f (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
I20260928 10:44:02.378223 6269 ts_tablet_manager.cc:1918] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.378511 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03f686afffc4d47b5e27fdbc8eb8f75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.379310 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 316304us
I20260928 10:44:02.380834 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.383564 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a908ac5d44a74c05b35f6853ab769d91
I20260928 10:44:02.384011 5699 catalog_manager.cc:6565] ReplaceTablet: tablet a908ac5d44a74c05b35f6853ab769d91 deleted and replaced by tablet c00ec4cec42a48388360e8723283829b
I20260928 10:44:02.383935 6271 raft_consensus.cc:348] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:02.384364 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9afe3c828c9747958a7c558716643007 consensus state has no leader
I20260928 10:44:02.385069 6271 raft_consensus.cc:374] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.385179 6271 raft_consensus.cc:729] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.385934 6271 consensus_queue.cc:260] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.387383 5817 leader_election.cc:302] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:02.394021 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 917513e857de49a7a57416eca237f70b (DEFAULT_TABLE table=default.Table_8b18320697c0483895d8cef27a3f663f [id=c6497815b1e84d11a9a54ed1f744948c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:02.395445 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c22cc964ceb741febfd3d1322ae05289 (table default.Table_5607fa1f3fd0455abf4c687e67afde0e [id=643bd72a41aa4477bc796c4a43eef8ac], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c22cc964ceb741febfd3d1322ae05289 consensus state has no leader
I20260928 10:44:02.397100 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.400213 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917513e857de49a7a57416eca237f70b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.401348 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a908ac5d44a74c05b35f6853ab769d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a908ac5d44a74c05b35f6853ab769d91 already in progress: creating tablet
I20260928 10:44:02.401787 5983 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce585cc60d4001b12cb335929b9efb (DEFAULT_TABLE table=default.Table_2791ed0f44e341b6bf437f3eaa4b97a9 [id=74ea354eea8e4e5c8ed65b1502681cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.369289 6712 raft_consensus.cc:504] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:02.403043 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c00ec4cec42a48388360e8723283829b has no consensus state
I20260928 10:44:02.405876 6273 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:02.407240 6001 tablet_service.cc:1467] Processing CreateTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 (DEFAULT_TABLE table=default.Table_bb3b4a291acb4121ae9e440fc315a891 [id=7a59d9d4e598496c9854a10ac0c6cb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.410663 6715 raft_consensus.cc:482] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.413347 6715 raft_consensus.cc:504] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.414747 6715 leader_election.cc:288] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:02.416154 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc7aa301bfbb4097b386a0d23cfa91e1 consensus state has no leader
I20260928 10:44:02.418927 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9c61d774437ea873fdc6e1c93486" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:02.423156 5857 tablet_service.cc:1467] Processing CreateTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.424134 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce585cc60d4001b12cb335929b9efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.424165 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 29a1be37ede84ea485182044be92b8c6 (DEFAULT_TABLE table=default.Table_5759f5da5ae84d678ab6a2e2042182e2 [id=87c3591cdbf34ccc8c10269033b20843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.427174 5988 tablet_service.cc:1467] Processing CreateTablet for tablet d03fd57e996c486384f92000925aff8a (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.449354 5846 tablet_service.cc:1467] Processing CreateTablet for tablet df846e6bb5b54ddd8ac5df678803d739 (DEFAULT_TABLE table=default.Table_b63402f58ca449a4bd05369cc751445e [id=59fcbd230b544a6fb3e3fc3888be0f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.449188 5863 tablet_service.cc:1467] Processing CreateTablet for tablet ed443629ab604099a6fe5aff1840a553 (DEFAULT_TABLE table=default.Table_a6950587aac341189738d1f36a4b6250 [id=0d8f33fcda59488c8ebc3791be19384b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.452654 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6f388d56f04696940caef30b213ca6 (DEFAULT_TABLE table=default.Table_409bf812ca684359b4bf9c0e9858ba1b [id=3f375f4cb4f34d57a8a5d38d8655325d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.457005 5854 tablet_service.cc:1467] Processing CreateTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 (DEFAULT_TABLE table=default.Table_d8589e4891fc44778c83c70292d08586 [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.471253 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_884fb10fbd3649ed8e069634d78d3042"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.471988 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_884fb10fbd3649ed8e069634d78d3042 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.473268 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fb25cc33ccfb474ca51b0db8e1b167f7" } modify_external_catalogs: true
I20260928 10:44:02.473477 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fb25cc33ccfb474ca51b0db8e1b167f7" } modify_external_catalogs: true
I20260928 10:44:02.476994 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dba507179ed44ce903111622ec1fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.477262 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fe24b61d424274b407327f130bb020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.477447 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet f57cd5585604424d92b8ce2522085567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.477641 6272 tablet_replica.cc:330] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.477828 6272 raft_consensus.cc:2229] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:02.477926 5853 consensus_meta.cc:287] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent flushing consensus metadata: real 0.532s user 0.005s sys 0.000s
I20260928 10:44:02.477998 6272 raft_consensus.cc:2258] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.479077 6272 ts_tablet_manager.cc:1905] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.486924 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c6ed97f74540b786ed3a6378dea0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.487000 6682 raft_consensus.cc:504] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.487707 6682 leader_election.cc:288] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.487893 6682 raft_consensus.cc:2726] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:02.488039 6682 raft_consensus.cc:482] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.488159 6682 raft_consensus.cc:504] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.488687 6682 leader_election.cc:288] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.488862 6269 log.cc:1196] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0a3d035581da47abb64156066e53fa67
I20260928 10:44:02.489303 6269 ts_tablet_manager.cc:1939] T 0a3d035581da47abb64156066e53fa67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:02.490056 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 414) took 1455 ms. Trace:
I20260928 10:44:02.490151 6269 rpcz_store.cc:276] 0928 10:44:01.034766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.034816 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:01.896273 (+861457us) ts_tablet_manager.cc:1145] Deleting tablet 0a3d035581da47abb64156066e53fa67
0928 10:44:01.896284 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:01.934994 (+ 38710us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:02.308857 (+373863us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:02.489998 (+181141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":861164}
W20260928 10:44:02.486943 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 128770us
I20260928 10:44:02.492205 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118ae3f8af264a31b7c22403c4951bdf" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.492326 6272 ts_tablet_manager.cc:1918] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.492477 6272 log.cc:1196] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/7dba507179ed44ce903111622ec1fb42
I20260928 10:44:02.492838 6272 ts_tablet_manager.cc:1939] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.492884 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.493304 5861 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce585cc60d4001b12cb335929b9efb (DEFAULT_TABLE table=default.Table_2791ed0f44e341b6bf437f3eaa4b97a9 [id=74ea354eea8e4e5c8ed65b1502681cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.493463 6272 tablet_replica.cc:330] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.493804 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 7dba507179ed44ce903111622ec1fb42 (table default.Table_8b6de790cff44909b80e9ab812bb2d60 [id=4c0912577f204df2a369e5a7be835b49]) successfully deleted
W20260928 10:44:02.494163 5818 leader_election.cc:341] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.494252 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87dd8e89c394e4f96c9d8c5fed17e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.494652 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 416) took 1439 ms. Trace:
I20260928 10:44:02.494750 6269 rpcz_store.cc:276] 0928 10:44:01.055315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.066533 (+ 11218us) service_pool.cc:227] Handling call
0928 10:44:02.490439 (+1423906us) ts_tablet_manager.cc:1145] Deleting tablet 104a223ec6ef47988d0aa3335a1f81de
0928 10:44:02.494405 (+ 3966us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:02.494596 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423504}
I20260928 10:44:02.496565 6682 raft_consensus.cc:482] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.496701 6682 raft_consensus.cc:504] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.497305 6682 leader_election.cc:288] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.497438 6682 raft_consensus.cc:482] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.497560 6682 raft_consensus.cc:504] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.497960 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed443629ab604099a6fe5aff1840a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.498075 6682 leader_election.cc:288] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.498217 6682 raft_consensus.cc:482] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.498330 6682 raft_consensus.cc:504] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.498819 6682 leader_election.cc:288] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.499752 6269 tablet_replica.cc:330] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:02.499976 6269 raft_consensus.cc:2229] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.500170 6269 raft_consensus.cc:2258] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.500550 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce585cc60d4001b12cb335929b9efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.503139 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df846e6bb5b54ddd8ac5df678803d739. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.496095 6091 leader_election.cc:341] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 7dba507179ed44ce903111622ec1fb42
I20260928 10:44:02.503193 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 402378e09a1d43ea92f694fe24f9c544 (DEFAULT_TABLE table=default.Table_06e973961b9046a6898291edb23e85b4 [id=4ef610fa38834b4ea8659881ad61e94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.504355 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 527e00f713214484bfc19ab96044a1be (DEFAULT_TABLE table=default.Table_9a013dca23c84607871b1ce448aeee78 [id=7d0309431ccf4fa493fc686fbd637ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.504010 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 1c056c078c95461b82c1ca1f31d90752 (DEFAULT_TABLE table=default.Table_27cacb67cfd44997b4f82d950e931f47 [id=b919863c76dc4a0ea5a2f0640149e789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.504712 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c056c078c95461b82c1ca1f31d90752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.504899 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 402378e09a1d43ea92f694fe24f9c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.509732 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 16510244612242f796910cf28e367da9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:02.510756 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527e00f713214484bfc19ab96044a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.511024 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "317446124e354bbeaaef608d9e8852fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.512509 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.512660 6272 raft_consensus.cc:2229] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:02.439819 5955 leader_election.cc:341] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.440521 5999 tablet_service.cc:1467] Processing CreateTablet for tablet b254b5f8163d45cc8e1beb77d6ac4a65 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.456168 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b217b6d4ad9a495795fe2b923144e8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.459487 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 0cffc63bccf448a7a59e311640567e4a (DEFAULT_TABLE table=default.Table_99610979832a4035a4a742164395bb0f [id=9d897090b86f467ba44c140e859a220e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.479978 5996 tablet_service.cc:1467] Processing CreateTablet for tablet d6c48b8a7efa41a684205df3e6969370 (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.485119 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 (DEFAULT_TABLE table=default.Table_e980d7f015ba49d1b8b828e2d1f89593 [id=9fbefe39be814729a3b4dfc471ae28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.512482 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40123712b17464e87023f69a6235640" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.434228 6270 ts_tablet_manager.cc:1918] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.517292 6272 raft_consensus.cc:2258] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.519678 6272 ts_tablet_manager.cc:1905] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.524923 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.525462 5850 tablet_service.cc:1467] Processing CreateTablet for tablet b254b5f8163d45cc8e1beb77d6ac4a65 (DEFAULT_TABLE table=default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.526638 6273 ts_tablet_manager.cc:1397] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.420s user 0.025s sys 0.060s
I20260928 10:44:02.527486 6273 raft_consensus.cc:348] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.528339 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.528617 6711 raft_consensus.cc:482] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.531503 5859 tablet_service.cc:1467] Processing CreateTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 (DEFAULT_TABLE table=default.Table_bb3b4a291acb4121ae9e440fc315a891 [id=7a59d9d4e598496c9854a10ac0c6cb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.531246 6712 leader_election.cc:288] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.533223 6269 ts_tablet_manager.cc:1905] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.533419 5858 tablet_service.cc:1467] Processing CreateTablet for tablet db7ba94f3efa4acda249ea0375547cc9 (DEFAULT_TABLE table=default.Table_2a5049f83fce42b0ab5b4beea486d708 [id=c423f78cb6574ea7828bc4cb94712908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.535423 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 (DEFAULT_TABLE table=default.Table_f9cdfa55dd3842baa9953832efc2313d [id=7d91230c80fd4951adc2206362b423ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.535961 6273 raft_consensus.cc:374] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.537331 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 946188e312c6424f81926465667b5e11 (DEFAULT_TABLE table=default.Table_db9a81dcfa8f454d839c829673b77b9e [id=fa8505c90e814bfba8e693650ff889cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.537874 6273 raft_consensus.cc:729] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.539302 6273 consensus_queue.cc:260] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.542387 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e (DEFAULT_TABLE table=default.Table_ec07c562189f47a280a2e75408d42ff5 [id=ac2ebddfd65c4db7bd12ef76a96072f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.543440 5861 tablet_service.cc:1467] Processing CreateTablet for tablet d03fd57e996c486384f92000925aff8a (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.543905 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:02.545233 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.546383 6270 log.cc:1196] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1ba8abd00f2742a29fdc79059332b91d
I20260928 10:44:02.484344 6002 tablet_service.cc:1467] Processing CreateTablet for tablet eb945bc6b99a44e0932b2a94f05db6c2 (DEFAULT_TABLE table=default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.557276 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 16510244612242f796910cf28e367da9
I20260928 10:44:02.557809 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 16510244612242f796910cf28e367da9 deleted and replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2
I20260928 10:44:02.563249 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:02.569841 5957 leader_election.cc:341] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a19c9c61d774437ea873fdc6e1c93486
I20260928 10:44:02.570623 6273 ts_tablet_manager.cc:1428] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260928 10:44:02.571141 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03fd57e996c486384f92000925aff8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.572295 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_72fa42e53bb14b278e9f91b8c5276960" } modify_external_catalogs: true
I20260928 10:44:02.572530 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_72fa42e53bb14b278e9f91b8c5276960" } modify_external_catalogs: true
I20260928 10:44:02.573091 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2fbadc72e6434348aedb000cdb6b9579" } modify_external_catalogs: true
I20260928 10:44:02.573248 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2fbadc72e6434348aedb000cdb6b9579" } modify_external_catalogs: true
W20260928 10:44:02.574074 5856 consensus_meta.cc:287] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent flushing consensus metadata: real 0.533s user 0.006s sys 0.000s
I20260928 10:44:02.554152 6711 raft_consensus.cc:504] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.578668 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 0cffc63bccf448a7a59e311640567e4a (DEFAULT_TABLE table=default.Table_99610979832a4035a4a742164395bb0f [id=9d897090b86f467ba44c140e859a220e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.578944 6272 ts_tablet_manager.cc:1918] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.579072 6272 log.cc:1196] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/68fe24b61d424274b407327f130bb020
I20260928 10:44:02.580361 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 917513e857de49a7a57416eca237f70b (DEFAULT_TABLE table=default.Table_8b18320697c0483895d8cef27a3f663f [id=c6497815b1e84d11a9a54ed1f744948c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.582243 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 0e149cdb22cc4c60b012c2d87868827b (DEFAULT_TABLE table=default.Table_b8e5fedeb2f242fca078d64788bf6c33 [id=60cc8d4d98524885be57b8bf246f2182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.582707 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6f388d56f04696940caef30b213ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.583405 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03fd57e996c486384f92000925aff8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.585131 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946188e312c6424f81926465667b5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.589193 5852 tablet_service.cc:1467] Processing CreateTablet for tablet f799021aca384269bfcd67829f3a7db5 (DEFAULT_TABLE table=default.Table_2d2f6d17577e40a38a8af4624ead8bd1 [id=fe0ad2a84ee1475cbe49aec04d48f5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.589607 6273 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:02.589977 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db7ba94f3efa4acda249ea0375547cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.590775 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4594eae7b840ff980f67da8ed82e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.593094 6273 tablet_bootstrap.cc:654] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.593294 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_27cacb67cfd44997b4f82d950e931f47" } modify_external_catalogs: true
I20260928 10:44:02.593537 6272 ts_tablet_manager.cc:1939] T 68fe24b61d424274b407327f130bb020 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.593533 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_27cacb67cfd44997b4f82d950e931f47" } modify_external_catalogs: true
I20260928 10:44:02.594015 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cffc63bccf448a7a59e311640567e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.594063 6272 tablet_replica.cc:330] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.594089 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8be5cda7ca54bef9c60c4c1bc88a460" } modify_external_catalogs: true
I20260928 10:44:02.594256 6272 raft_consensus.cc:2229] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.594256 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8be5cda7ca54bef9c60c4c1bc88a460" } modify_external_catalogs: true
I20260928 10:44:02.594416 6272 raft_consensus.cc:2258] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.594857 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e149cdb22cc4c60b012c2d87868827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.594993 6272 ts_tablet_manager.cc:1905] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.595319 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 68fe24b61d424274b407327f130bb020 (table default.Table_0bfbdb2023d34addb72137cd913ed484 [id=20a9a8169da84101bf07381bc2f9a7dd]) successfully deleted
I20260928 10:44:02.595732 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b254b5f8163d45cc8e1beb77d6ac4a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.597244 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_affa419abdd1427c95a8092f6e4b6337" } new_table_name: "default.Table_413facdd66c5442eb11b3bc647d2f82e" modify_external_catalogs: true
I20260928 10:44:02.597937 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2adfb715d87e4f0a8e837a43938de99e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.600560 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2adfb715d87e4f0a8e837a43938de99e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.606843 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799021aca384269bfcd67829f3a7db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.606091 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 (DEFAULT_TABLE table=default.Table_e980d7f015ba49d1b8b828e2d1f89593 [id=9fbefe39be814729a3b4dfc471ae28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.612190 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0a3d035581da47abb64156066e53fa67 (table default.Table_46bfcb3484ad4a8e8ca7bfc3ede02c99 [id=8c4d995731f94c088f6e4625446cee13]) successfully deleted
I20260928 10:44:02.613204 6275 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.613456 6275 ts_tablet_manager.cc:1397] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.297s user 0.035s sys 0.067s
I20260928 10:44:02.613762 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 402378e09a1d43ea92f694fe24f9c544 (DEFAULT_TABLE table=default.Table_06e973961b9046a6898291edb23e85b4 [id=4ef610fa38834b4ea8659881ad61e94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.614190 6270 ts_tablet_manager.cc:1939] T 1ba8abd00f2742a29fdc79059332b91d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:02.615108 6275 raft_consensus.cc:348] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.615579 6275 raft_consensus.cc:374] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:02.615641 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 104a223ec6ef47988d0aa3335a1f81de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104a223ec6ef47988d0aa3335a1f81de already in progress: creating tablet
I20260928 10:44:02.616535 6275 raft_consensus.cc:729] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.617132 6275 consensus_queue.cc:260] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.617743 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.618441 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.618727 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.618912 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 1c056c078c95461b82c1ca1f31d90752 (DEFAULT_TABLE table=default.Table_27cacb67cfd44997b4f82d950e931f47 [id=b919863c76dc4a0ea5a2f0640149e789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.619313 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b254b5f8163d45cc8e1beb77d6ac4a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.619724 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1ae67fee604d4932ae0e0ade17ccb28a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:02.620316 6711 leader_election.cc:288] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:02.620352 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ae67fee604d4932ae0e0ade17ccb28a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.620574 6732 raft_consensus.cc:482] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.620795 6732 raft_consensus.cc:504] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.621574 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bb3b4a291acb4121ae9e440fc315a891" } new_table_name: "default.Table_cc2a07c9718f4d569d7fcbbc6ebf79b1" modify_external_catalogs: true
I20260928 10:44:02.621788 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e14d183b3e9c4c16887eb2264760edde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.622285 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e14d183b3e9c4c16887eb2264760edde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:02.623673 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffa971239a2b4ac6bc309dfbacdbe12e consensus state has no leader
I20260928 10:44:02.625255 6275 ts_tablet_manager.cc:1428] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260928 10:44:02.625730 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1c056c078c95461b82c1ca1f31d90752
I20260928 10:44:02.627328 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.627552 5957 leader_election.cc:302] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:02.627683 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.627763 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c056c078c95461b82c1ca1f31d90752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:02.627768 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 115034us
I20260928 10:44:02.629302 6275 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.630744 6716 raft_consensus.cc:2726] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:02.632329 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.632695 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbd5d1ccd2e54f3884af3af327bb892e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.638568 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01433ce37b2c49cd858ea88877ca56da" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.641389 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c48b8a7efa41a684205df3e6969370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.642735 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917513e857de49a7a57416eca237f70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.647696 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 527e00f713214484bfc19ab96044a1be (DEFAULT_TABLE table=default.Table_9a013dca23c84607871b1ce448aeee78 [id=7d0309431ccf4fa493fc686fbd637ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.649206 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_af4b71ec0d304f94a6c07ff8ea188704"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.649869 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af4b71ec0d304f94a6c07ff8ea188704 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.652807 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cffc63bccf448a7a59e311640567e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.653228 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.654716 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 225686us
W20260928 10:44:02.656196 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:02.657601 5818 leader_election.cc:341] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:02.657920 5818 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.658520 6270 tablet_replica.cc:330] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:02.658829 6272 ts_tablet_manager.cc:1918] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.659227 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 402378e09a1d43ea92f694fe24f9c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.659541 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6063c7c57810402b9a28be794c2fe2f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:02.659930 6271 ts_tablet_manager.cc:1428] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.302s user 0.002s sys 0.023s
W20260928 10:44:02.660341 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6063c7c57810402b9a28be794c2fe2f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.662004 6272 log.cc:1196] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f57cd5585604424d92b8ce2522085567
I20260928 10:44:02.662570 6272 ts_tablet_manager.cc:1939] T f57cd5585604424d92b8ce2522085567 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.663736 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f57cd5585604424d92b8ce2522085567 (table default.Table_333faec6e5864a4982d5c0743c880176 [id=6c9610724d3341d193cf34cdee8780b7]) successfully deleted
W20260928 10:44:02.665016 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 already in progress: creating tablet
I20260928 10:44:02.665452 6270 raft_consensus.cc:2229] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:02.665431 5818 leader_election.cc:341] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:02.665686 5818 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:02.666267 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 16510244612242f796910cf28e367da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16510244612242f796910cf28e367da9 already in progress: creating tablet
I20260928 10:44:02.668272 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c056c078c95461b82c1ca1f31d90752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.664346 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d257233e5b934d619e2289a6df55d65a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.673026 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f13643dbb64dcf97c4d6d94c22d8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.674778 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b2d22c89014245869ff6b541065015ed" } new_table_name: "default.Table_6fb701fbad2b4bbb8767a204ac5595f5" modify_external_catalogs: true
I20260928 10:44:02.675595 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c056c078c95461b82c1ca1f31d90752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.676725 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1ba8abd00f2742a29fdc79059332b91d (table default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]) successfully deleted
W20260928 10:44:02.677052 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 503a4bcb9d37441aadf66b45238a3737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503a4bcb9d37441aadf66b45238a3737 already in progress: creating tablet
W20260928 10:44:02.684345 6090 leader_election.cc:341] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 7dba507179ed44ce903111622ec1fb42
I20260928 10:44:02.684880 6270 raft_consensus.cc:2258] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.685923 6271 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:02.688174 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d6349536abdb4f5ea6addc8eb9a7811b" } new_table_name: "default.Table_30de79cdae684abc96a9f7a080d00f02" modify_external_catalogs: true
W20260928 10:44:02.690014 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b217b6d4ad9a495795fe2b923144e8d3 consensus state has no leader
I20260928 10:44:02.690889 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_973b0af0dc714a2e963e9915961984a1" } new_table_name: "default.Table_083c6416ebeb4b91bfcff6a90005ec5e" modify_external_catalogs: true
I20260928 10:44:02.694072 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb945bc6b99a44e0932b2a94f05db6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.694130 6090 leader_election.cc:302] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:02.694330 6090 raft_consensus.cc:2670] T 7dba507179ed44ce903111622ec1fb42 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:02.694064 6270 ts_tablet_manager.cc:1905] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.695542 6272 tablet_replica.cc:330] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.695749 6272 raft_consensus.cc:2229] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.696557 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527e00f713214484bfc19ab96044a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.699532 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:02.700779 6272 raft_consensus.cc:2258] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.703214 6275 tablet_bootstrap.cc:654] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.704128 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_159c3cb36a0148e29f7d1be2eed024f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.704766 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_159c3cb36a0148e29f7d1be2eed024f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.704907 6732 leader_election.cc:288] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:02.706466 5818 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.708412 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9d87a6f28ce74fccb644babb0704ed0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.708724 5818 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:02.709244 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d87a6f28ce74fccb644babb0704ed0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.711771 6272 ts_tablet_manager.cc:1905] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.726688 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet d103af0b1cb24cda882cc2e3d95a558d from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:02.729578 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59bfe1f8050f47429ef80a19fdcd8198" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:02.733882 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 (DEFAULT_TABLE table=default.Table_754bf685bb8c4369a74a707d39d5ec08 [id=7e3dd6f19e8743a69f749afcb8be0e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.734385 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 263b9844bdf6465fa7894ddcf2809f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.738219 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 (DEFAULT_TABLE table=default.Table_754bf685bb8c4369a74a707d39d5ec08 [id=7e3dd6f19e8743a69f749afcb8be0e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.740278 6729 raft_consensus.cc:482] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.740959 6729 raft_consensus.cc:504] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:02.742136 6729 leader_election.cc:288] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:02.742704 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b793fca06095448a80f39e6924ba7963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.743764 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b793fca06095448a80f39e6924ba7963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.744872 6678 catalog_manager.cc:1259] Loaded cluster ID: d8fef7b33cab4615b13ae7bbac9dc27a
W20260928 10:44:02.744995 5818 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.748279 6678 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: loading cluster ID for follower catalog manager: success
I20260928 10:44:02.753432 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 263b9844bdf6465fa7894ddcf2809f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.759526 5855 tablet_service.cc:1467] Processing CreateTablet for tablet d6c48b8a7efa41a684205df3e6969370 (DEFAULT_TABLE table=default.Table_b12c9e0066374ae3a437cd0ebdb3efb0 [id=5746764388a94c4aa38985de816e9c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.767009 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48ccd7551f6a4fc8b41e70e94749e6f1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:02.769924 5818 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:02.772363 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 527e00f713214484bfc19ab96044a1be (DEFAULT_TABLE table=default.Table_9a013dca23c84607871b1ce448aeee78 [id=7d0309431ccf4fa493fc686fbd637ca8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:02.773335 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58b58d0c904a423f9801a883a2a2dfc1 consensus state has no leader
I20260928 10:44:02.773671 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 39cbecd1c19541f28bd32b7c46f2df61 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:02.773878 6001 tablet_service.cc:1467] Processing CreateTablet for tablet f913900914d149b48d64a0d53908482c (DEFAULT_TABLE table=default.Table_bf940beada1a4c9a97761e9d2dc66c94 [id=5d219895c430475a9216792176b8c0cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.774226 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f429f420bbd495c91b854218a0a06f5" } modify_external_catalogs: true
I20260928 10:44:02.774427 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f429f420bbd495c91b854218a0a06f5" } modify_external_catalogs: true
I20260928 10:44:02.782140 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.783887 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9319d4d4102e43b19c0caa0b0a4b4740
I20260928 10:44:02.780781 6739 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:02.784783 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d (DEFAULT_TABLE table=default.Table_d820b51d65fe47c8a8636d537671a0a2 [id=c8f4df5de05c40e7b236c01a8e08d17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.784869 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d (DEFAULT_TABLE table=default.Table_d820b51d65fe47c8a8636d537671a0a2 [id=c8f4df5de05c40e7b236c01a8e08d17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.785176 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.785421 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea90e2cbd7624baab1522b8b4afa5f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.785652 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b217b6d4ad9a495795fe2b923144e8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.785669 6271 tablet_bootstrap.cc:654] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.788177 5861 tablet_service.cc:1467] Processing CreateTablet for tablet eb945bc6b99a44e0932b2a94f05db6c2 (DEFAULT_TABLE table=default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.788578 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 402378e09a1d43ea92f694fe24f9c544 (DEFAULT_TABLE table=default.Table_06e973961b9046a6898291edb23e85b4 [id=4ef610fa38834b4ea8659881ad61e94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.788905 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.789115 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.789271 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.789409 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c056c078c95461b82c1ca1f31d90752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.789961 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f13643dbb64dcf97c4d6d94c22d8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.792882 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.793653 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a1be37ede84ea485182044be92b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.793605 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 1c056c078c95461b82c1ca1f31d90752 (DEFAULT_TABLE table=default.Table_27cacb67cfd44997b4f82d950e931f47 [id=b919863c76dc4a0ea5a2f0640149e789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.798892 5862 tablet_service.cc:1467] Processing CreateTablet for tablet f913900914d149b48d64a0d53908482c (DEFAULT_TABLE table=default.Table_bf940beada1a4c9a97761e9d2dc66c94 [id=5d219895c430475a9216792176b8c0cf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:02.799432 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 67238.5us
I20260928 10:44:02.800001 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.801349 6132 tablet_service.cc:1467] Processing CreateTablet for tablet f913900914d149b48d64a0d53908482c (DEFAULT_TABLE table=default.Table_bf940beada1a4c9a97761e9d2dc66c94 [id=5d219895c430475a9216792176b8c0cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.801879 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f913900914d149b48d64a0d53908482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.802702 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f913900914d149b48d64a0d53908482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.802991 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.809166 6135 tablet_service.cc:1467] Processing CreateTablet for tablet c00ec4cec42a48388360e8723283829b (DEFAULT_TABLE table=default.Table_2fbadc72e6434348aedb000cdb6b9579 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.809665 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00ec4cec42a48388360e8723283829b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.815991 6275 tablet_bootstrap.cc:492] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.816310 6275 ts_tablet_manager.cc:1397] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.187s user 0.002s sys 0.007s
I20260928 10:44:02.817425 6275 raft_consensus.cc:348] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.817837 6275 raft_consensus.cc:374] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.818004 6275 raft_consensus.cc:729] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.818735 6275 consensus_queue.cc:260] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.824262 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a (DEFAULT_TABLE table=default.Table_dc893248efaa4d91bb9d16c3b6d9c85a [id=6062484c72554ba5802a0f7cfc89bba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.824764 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.826435 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9afe3c828c9747958a7c558716643007
W20260928 10:44:02.827291 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04b947da50894cdba0f49d0738f60187 consensus state has no leader
I20260928 10:44:02.828364 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.830376 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c056c078c95461b82c1ca1f31d90752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.834625 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.835002 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.835057 5999 tablet_service.cc:1467] Processing CreateTablet for tablet c00ec4cec42a48388360e8723283829b (DEFAULT_TABLE table=default.Table_2fbadc72e6434348aedb000cdb6b9579 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.835372 6275 ts_tablet_manager.cc:1428] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260928 10:44:02.837266 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00ec4cec42a48388360e8723283829b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.838016 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.838335 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a (DEFAULT_TABLE table=default.Table_dc893248efaa4d91bb9d16c3b6d9c85a [id=6062484c72554ba5802a0f7cfc89bba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.838776 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.838755 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a (DEFAULT_TABLE table=default.Table_dc893248efaa4d91bb9d16c3b6d9c85a [id=6062484c72554ba5802a0f7cfc89bba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.839521 6270 ts_tablet_manager.cc:1918] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.840224 6270 log.cc:1196] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a19c9c61d774437ea873fdc6e1c93486
I20260928 10:44:02.840667 6270 ts_tablet_manager.cc:1939] T a19c9c61d774437ea873fdc6e1c93486 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:02.841142 6275 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:02.841853 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527e00f713214484bfc19ab96044a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.841840 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a19c9c61d774437ea873fdc6e1c93486 (table default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]) successfully deleted
W20260928 10:44:02.842239 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 877e2d1c734a4e2891119f308f9f3ae8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877e2d1c734a4e2891119f308f9f3ae8 already in progress: creating tablet
W20260928 10:44:02.842617 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 87d5dd4e5b544262938b1822510d8b9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d5dd4e5b544262938b1822510d8b9f already in progress: creating tablet
I20260928 10:44:02.842635 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 (DEFAULT_TABLE table=default.Table_754bf685bb8c4369a74a707d39d5ec08 [id=7e3dd6f19e8743a69f749afcb8be0e04]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:02.842916 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5f42d5aef2424b3aacc8564d98cd3b67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f42d5aef2424b3aacc8564d98cd3b67 already in progress: creating tablet
W20260928 10:44:02.843140 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 463cf5ecb52d40069b564698433c6781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 463cf5ecb52d40069b564698433c6781 already in progress: creating tablet
W20260928 10:44:02.843387 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ba67a229f61e4a6b8078b59fe89fae7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba67a229f61e4a6b8078b59fe89fae7f already in progress: creating tablet
I20260928 10:44:02.843549 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03f686afffc4d47b5e27fdbc8eb8f75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.843679 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1c8c53b5ae244cda8dff396935fc8e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c8c53b5ae244cda8dff396935fc8e82 already in progress: creating tablet
W20260928 10:44:02.844012 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1f3d2c79118e44bca3540d3e3ff524a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3d2c79118e44bca3540d3e3ff524a6 already in progress: creating tablet
W20260928 10:44:02.845458 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 609790us
I20260928 10:44:02.845890 6272 ts_tablet_manager.cc:1918] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:02.846724 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a908ac5d44a74c05b35f6853ab769d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a908ac5d44a74c05b35f6853ab769d91 already in progress: creating tablet
W20260928 10:44:02.847007 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 16510244612242f796910cf28e367da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16510244612242f796910cf28e367da9 already in progress: creating tablet
W20260928 10:44:02.847249 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 already in progress: creating tablet
W20260928 10:44:02.847652 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1c056c078c95461b82c1ca1f31d90752 because the tablet was not found. No further retry: Not found: Tablet not found: 1c056c078c95461b82c1ca1f31d90752
W20260928 10:44:02.847975 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9319d4d4102e43b19c0caa0b0a4b4740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9319d4d4102e43b19c0caa0b0a4b4740 already in progress: creating tablet
W20260928 10:44:02.848278 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9afe3c828c9747958a7c558716643007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9afe3c828c9747958a7c558716643007 already in progress: creating tablet
I20260928 10:44:02.851495 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda (DEFAULT_TABLE table=default.Table_e518e1e5c90b4f0bac535431691e53fe [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.851933 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d03d764256a4a8d9d8bb17b82fe8bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.852193 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fc69aee75b914164961654baaea21d7e" } new_table_name: "default.Table_a76680616cce463084d329ce2930c487" modify_external_catalogs: true
I20260928 10:44:02.855119 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_50ccb77506cf4484aa8e95d8ed6b216c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.855708 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50ccb77506cf4484aa8e95d8ed6b216c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.853165 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d (DEFAULT_TABLE table=default.Table_d820b51d65fe47c8a8636d537671a0a2 [id=c8f4df5de05c40e7b236c01a8e08d17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.856885 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9c61d774437ea873fdc6e1c93486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.857401 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_de468dcafe554bba9d4279813098e5d5" } modify_external_catalogs: true
I20260928 10:44:02.857618 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_de468dcafe554bba9d4279813098e5d5" } modify_external_catalogs: true
I20260928 10:44:02.858430 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c48b8a7efa41a684205df3e6969370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.858573 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda (DEFAULT_TABLE table=default.Table_e518e1e5c90b4f0bac535431691e53fe [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.859014 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d03d764256a4a8d9d8bb17b82fe8bda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.864244 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bd09430a2c34965a590f2e0852c686b consensus state has no leader
I20260928 10:44:02.864921 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 263b9844bdf6465fa7894ddcf2809f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.868795 6275 tablet_bootstrap.cc:654] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.869482 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.846068 6272 log.cc:1196] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/68e1b25f634e48008f5262aed44010da
I20260928 10:44:02.870800 6272 ts_tablet_manager.cc:1939] T 68e1b25f634e48008f5262aed44010da P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.871623 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 68e1b25f634e48008f5262aed44010da (table default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]) successfully deleted
I20260928 10:44:02.871762 6272 tablet_replica.cc:330] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:02.871892 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1c056c078c95461b82c1ca1f31d90752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c056c078c95461b82c1ca1f31d90752 already in progress: creating tablet
I20260928 10:44:02.871948 6272 raft_consensus.cc:2229] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.872133 6272 raft_consensus.cc:2258] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:02.872431 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9319d4d4102e43b19c0caa0b0a4b4740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9319d4d4102e43b19c0caa0b0a4b4740 already in progress: creating tablet
W20260928 10:44:02.872648 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9afe3c828c9747958a7c558716643007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9afe3c828c9747958a7c558716643007 already in progress: creating tablet
I20260928 10:44:02.872975 6272 ts_tablet_manager.cc:1905] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.874786 6135 tablet_service.cc:1467] Processing CreateTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.875967 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257d722a42e44f4ac554b1ebe7d8e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.843555 5848 tablet_service.cc:1467] Processing CreateTablet for tablet c00ec4cec42a48388360e8723283829b (DEFAULT_TABLE table=default.Table_2fbadc72e6434348aedb000cdb6b9579 [id=48f06cee1ca2460cad2383e5bbfb83ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.887480 5991 tablet_service.cc:1467] Processing CreateTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.887926 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257d722a42e44f4ac554b1ebe7d8e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.888109 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c00ec4cec42a48388360e8723283829b
I20260928 10:44:02.888872 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a9e4a90e63964c2392953fa50a5ddb5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.889535 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9e4a90e63964c2392953fa50a5ddb5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.891578 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb945bc6b99a44e0932b2a94f05db6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.893981 6271 tablet_bootstrap.cc:492] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:02.894126 6271 ts_tablet_manager.cc:1397] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.220s user 0.000s sys 0.010s
I20260928 10:44:02.894901 6271 raft_consensus.cc:348] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.895116 6271 raft_consensus.cc:374] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.895203 6271 raft_consensus.cc:729] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.895438 6271 consensus_queue.cc:260] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.898084 6271 ts_tablet_manager.cc:1428] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260928 10:44:02.898415 6271 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:02.898307 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda (DEFAULT_TABLE table=default.Table_e518e1e5c90b4f0bac535431691e53fe [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.898787 6740 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:02.899245 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet c00ec4cec42a48388360e8723283829b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.899595 6728 raft_consensus.cc:482] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:02.899796 6728 raft_consensus.cc:504] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.900552 6728 leader_election.cc:288] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:02.900749 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d03d764256a4a8d9d8bb17b82fe8bda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:02.902567 5957 leader_election.cc:341] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 68e1b25f634e48008f5262aed44010da
I20260928 10:44:02.909075 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 402378e09a1d43ea92f694fe24f9c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.916821 6271 tablet_bootstrap.cc:654] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:02.924790 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c00ec4cec42a48388360e8723283829b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00ec4cec42a48388360e8723283829b already in progress: creating tablet
I20260928 10:44:02.936642 6269 ts_tablet_manager.cc:1918] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.939867 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ffae5213a5b24308b867a0c79f48d5cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:02.940603 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffae5213a5b24308b867a0c79f48d5cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.943464 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_80bfbf065e5b4c20b4ad9d675c9762f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:02.943778 6271 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:02.943943 6271 ts_tablet_manager.cc:1397] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
W20260928 10:44:02.944155 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80bfbf065e5b4c20b4ad9d675c9762f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.945345 6271 raft_consensus.cc:348] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.945644 6271 raft_consensus.cc:374] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.945736 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.945745 6271 raft_consensus.cc:729] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.946159 6270 tablet_replica.cc:330] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:02.946365 6270 raft_consensus.cc:2229] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.946569 6270 raft_consensus.cc:2258] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.946393 6271 consensus_queue.cc:260] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.947023 6271 ts_tablet_manager.cc:1428] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:02.947429 6271 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:02.947750 6270 ts_tablet_manager.cc:1905] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.949540 6271 tablet_bootstrap.cc:654] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.950139 6678 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: acquiring CA information for follower catalog manager: success
I20260928 10:44:02.955184 6270 ts_tablet_manager.cc:1918] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.955520 6270 log.cc:1196] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/68e1b25f634e48008f5262aed44010da
I20260928 10:44:02.956012 6270 ts_tablet_manager.cc:1939] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:02.957216 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 68e1b25f634e48008f5262aed44010da (table default.Table_bd7053e67266490cba88d524556fed3e [id=1f6532e920784b629cc3ebf699ceddfa]) successfully deleted
I20260928 10:44:02.958323 6271 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:02.958504 6271 ts_tablet_manager.cc:1397] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20260928 10:44:02.959352 6271 raft_consensus.cc:348] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.959609 6271 raft_consensus.cc:374] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.959587 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d103af0b1cb24cda882cc2e3d95a558d
I20260928 10:44:02.959698 6271 raft_consensus.cc:729] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.960089 5698 catalog_manager.cc:6565] ReplaceTablet: tablet d103af0b1cb24cda882cc2e3d95a558d deleted and replaced by tablet 39a851d2728a46c4ab2ad70399153361
I20260928 10:44:02.966962 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet d103af0b1cb24cda882cc2e3d95a558d with delete_type TABLET_DATA_DELETED (replaced by tablet 39a851d2728a46c4ab2ad70399153361) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:02.967381 6270 tablet_replica.cc:330] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:02.963152 6271 consensus_queue.cc:260] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.967592 6270 raft_consensus.cc:2229] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.967806 6270 raft_consensus.cc:2258] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.969146 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b4cea29f67244120946fe29fe5b1e2f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:02.969779 6270 ts_tablet_manager.cc:1905] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:02.969826 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4cea29f67244120946fe29fe5b1e2f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:02.971097 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5b6c5808b2f54b0094cd1910c2cda924" } new_table_name: "default.Table_14bedf63b9574b6da31a6f0b67270e19" modify_external_catalogs: true
I20260928 10:44:02.971318 6271 ts_tablet_manager.cc:1428] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260928 10:44:02.972823 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet c00ec4cec42a48388360e8723283829b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.939744 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.939953 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.974131 6269 log.cc:1196] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/118ae3f8af264a31b7c22403c4951bdf
I20260928 10:44:02.974529 6269 ts_tablet_manager.cc:1939] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:02.974969 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 420) took 1907 ms. Trace:
I20260928 10:44:02.975086 6269 rpcz_store.cc:276] 0928 10:44:01.067465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.067516 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:02.494971 (+1427455us) ts_tablet_manager.cc:1145] Deleting tablet 118ae3f8af264a31b7c22403c4951bdf
0928 10:44:02.499655 (+ 4684us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:02.783453 (+283798us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:02.936502 (+153049us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:02.974937 (+ 38435us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1427248}
W20260928 10:44:02.975665 5955 leader_election.cc:341] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 68e1b25f634e48008f5262aed44010da
I20260928 10:44:02.975797 5955 leader_election.cc:302] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:02.975410 6269 tablet_replica.cc:330] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:02.975982 5955 raft_consensus.cc:2670] T 68e1b25f634e48008f5262aed44010da P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:02.976078 6269 raft_consensus.cc:2229] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:02.976275 6269 raft_consensus.cc:2258] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:02.976486 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet d103af0b1cb24cda882cc2e3d95a558d with delete_type TABLET_DATA_DELETED (replaced by tablet 39a851d2728a46c4ab2ad70399153361) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:02.976792 6269 ts_tablet_manager.cc:1905] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.944669 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.945010 5859 tablet_service.cc:1467] Processing CreateTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:02.945256 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f913900914d149b48d64a0d53908482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.977339 6270 ts_tablet_manager.cc:1918] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:02.977499 6270 log.cc:1196] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d103af0b1cb24cda882cc2e3d95a558d
I20260928 10:44:02.977986 6270 ts_tablet_manager.cc:1939] T d103af0b1cb24cda882cc2e3d95a558d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:02.978080 6275 tablet_bootstrap.cc:492] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.978221 6275 ts_tablet_manager.cc:1397] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.138s user 0.034s sys 0.019s
I20260928 10:44:02.978966 6275 raft_consensus.cc:348] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.979171 6275 raft_consensus.cc:374] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:02.979251 6275 raft_consensus.cc:729] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:02.979435 6275 consensus_queue.cc:260] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:02.982630 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.983121 6275 ts_tablet_manager.cc:1428] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:44:02.983749 6272 ts_tablet_manager.cc:1918] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:02.983913 6272 log.cc:1196] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a19c9c61d774437ea873fdc6e1c93486
I20260928 10:44:02.984455 6272 ts_tablet_manager.cc:1939] T a19c9c61d774437ea873fdc6e1c93486 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:02.985411 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a19c9c61d774437ea873fdc6e1c93486 (table default.Table_1696a82ccb5c45d9a154583fc88be5ed [id=c92a139a1c444a78b1c0f34c961eda9a]) successfully deleted
I20260928 10:44:02.985692 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 118ae3f8af264a31b7c22403c4951bdf (table default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9 [id=c8d4a6587af14ea39b7ace0ce005588b]) successfully deleted
I20260928 10:44:02.985785 6275 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:02.986442 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c00ec4cec42a48388360e8723283829b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00ec4cec42a48388360e8723283829b already in progress: creating tablet
I20260928 10:44:02.986821 6272 tablet_replica.cc:330] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:02.987025 6272 raft_consensus.cc:2229] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:02.987426 6275 tablet_bootstrap.cc:654] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.987756 6271 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:02.987747 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]) successfully deleted
I20260928 10:44:02.988833 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257d722a42e44f4ac554b1ebe7d8e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.991593 6272 raft_consensus.cc:2258] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:02.991858 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 241677us
I20260928 10:44:02.993307 6271 tablet_bootstrap.cc:654] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:02.994644 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00ec4cec42a48388360e8723283829b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:02.995004 6272 ts_tablet_manager.cc:1905] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:02.947162 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.961210 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet c00ec4cec42a48388360e8723283829b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.009898 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd13e6a9d8f04fa3abb8d22a80932dae" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.010627 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118ae3f8af264a31b7c22403c4951bdf" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.011168 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "317446124e354bbeaaef608d9e8852fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.011637 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40123712b17464e87023f69a6235640" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.012092 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01433ce37b2c49cd858ea88877ca56da" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.012557 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbd5d1ccd2e54f3884af3af327bb892e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.013046 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.013571 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d257233e5b934d619e2289a6df55d65a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.014132 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59bfe1f8050f47429ef80a19fdcd8198" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.014691 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48ccd7551f6a4fc8b41e70e94749e6f1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.015813 5817 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.016083 5817 leader_election.cc:302] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.016444 6729 raft_consensus.cc:2726] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.016601 5817 leader_election.cc:341] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.016832 5817 leader_election.cc:302] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:03.017015 5817 raft_consensus.cc:2670] T 118ae3f8af264a31b7c22403c4951bdf P ab770e77cb704ea38b5ca8cff97dc73b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:44:03.017721 5817 leader_election.cc:341] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.017841 5817 leader_election.cc:302] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.018070 6729 raft_consensus.cc:2726] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.018181 5817 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.018270 5817 leader_election.cc:302] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.018467 6729 raft_consensus.cc:2726] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.020069 6747 tablet.cc:1722] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:03.032009 6275 tablet_bootstrap.cc:492] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:02.961869 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.968201 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:02.969779 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet d103af0b1cb24cda882cc2e3d95a558d with delete_type TABLET_DATA_DELETED (replaced by tablet 39a851d2728a46c4ab2ad70399153361) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.037848 6275 ts_tablet_manager.cc:1397] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.010s
I20260928 10:44:03.038785 6275 raft_consensus.cc:348] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.039369 6273 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.039525 6273 ts_tablet_manager.cc:1397] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.469s user 0.002s sys 0.011s
I20260928 10:44:03.040179 6273 raft_consensus.cc:348] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.040477 6273 raft_consensus.cc:374] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.040573 6273 raft_consensus.cc:729] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.040782 6273 consensus_queue.cc:260] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.041355 6273 ts_tablet_manager.cc:1428] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:03.042939 6273 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.043733 5701 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:03.045045 6273 tablet_bootstrap.cc:654] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.044503 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_56d98f59d24d4db58f8dc77f3c25918d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.045749 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56d98f59d24d4db58f8dc77f3c25918d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:03.046072 5817 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.046203 5817 leader_election.cc:302] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.047214 6729 raft_consensus.cc:2726] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.048177 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e1b25f634e48008f5262aed44010da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.048429 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet d103af0b1cb24cda882cc2e3d95a558d with delete_type TABLET_DATA_DELETED (replaced by tablet 39a851d2728a46c4ab2ad70399153361) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.050074 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 68e1b25f634e48008f5262aed44010da because the tablet was not found. No further retry: Not found: Tablet not found: 68e1b25f634e48008f5262aed44010da
W20260928 10:44:03.050496 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d103af0b1cb24cda882cc2e3d95a558d because the tablet was not found. No further retry: Not found: Tablet not found: d103af0b1cb24cda882cc2e3d95a558d
I20260928 10:44:03.061026 6275 raft_consensus.cc:374] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.061192 6275 raft_consensus.cc:729] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.061543 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 78295825061a4d75984e2d6e110e1c55
I20260928 10:44:03.063663 6275 consensus_queue.cc:260] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.063911 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 78295825061a4d75984e2d6e110e1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.064352 6275 ts_tablet_manager.cc:1428] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
W20260928 10:44:03.066174 5817 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.066322 5817 leader_election.cc:302] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:03.067044 5817 leader_election.cc:341] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.067097 6275 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.067175 5817 leader_election.cc:302] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.067039 6729 raft_consensus.cc:2726] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.067407 6729 raft_consensus.cc:2726] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.067572 5817 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.067665 5817 leader_election.cc:302] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.067849 6732 raft_consensus.cc:2726] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.068518 5817 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.068619 5817 leader_election.cc:302] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.068822 6732 raft_consensus.cc:2726] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.068950 5817 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.069046 5817 leader_election.cc:302] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.069217 6732 raft_consensus.cc:2726] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.071787 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 78295825061a4d75984e2d6e110e1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.072341 6275 tablet_bootstrap.cc:654] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.073719 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 78295825061a4d75984e2d6e110e1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.074440 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 78295825061a4d75984e2d6e110e1c55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78295825061a4d75984e2d6e110e1c55 already in progress: creating tablet
I20260928 10:44:03.081499 6272 ts_tablet_manager.cc:1918] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:03.081662 6272 log.cc:1196] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d103af0b1cb24cda882cc2e3d95a558d
I20260928 10:44:03.082536 6272 ts_tablet_manager.cc:1939] T d103af0b1cb24cda882cc2e3d95a558d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.085412 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]) successfully deleted
I20260928 10:44:03.086334 6269 ts_tablet_manager.cc:1918] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:03.086722 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 78295825061a4d75984e2d6e110e1c55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78295825061a4d75984e2d6e110e1c55 already in progress: creating tablet
I20260928 10:44:03.094923 6269 log.cc:1196] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1e32961679ee47379dab4c62efc53d99
I20260928 10:44:03.096459 6275 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.096727 6275 ts_tablet_manager.cc:1397] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.001s
I20260928 10:44:03.097057 6271 tablet_bootstrap.cc:492] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.097239 6271 ts_tablet_manager.cc:1397] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.110s user 0.015s sys 0.024s
I20260928 10:44:03.097736 6275 raft_consensus.cc:348] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.098054 6275 raft_consensus.cc:374] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.098613 6275 raft_consensus.cc:729] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.098944 6275 consensus_queue.cc:260] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.091926 6273 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.100831 6273 ts_tablet_manager.cc:1397] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260928 10:44:03.101610 6273 raft_consensus.cc:348] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.101843 6273 raft_consensus.cc:374] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.101900 6273 raft_consensus.cc:729] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.102056 6275 ts_tablet_manager.cc:1428] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:03.102166 6273 consensus_queue.cc:260] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.102511 6275 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.102771 6273 ts_tablet_manager.cc:1428] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:03.103228 6269 ts_tablet_manager.cc:1939] T 1e32961679ee47379dab4c62efc53d99 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.103597 6273 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.106197 6273 tablet_bootstrap.cc:654] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.097982 6271 raft_consensus.cc:348] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.106807 6271 raft_consensus.cc:374] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.106911 6271 raft_consensus.cc:729] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.107591 6271 consensus_queue.cc:260] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.108088 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 421) took 2040 ms. Trace:
I20260928 10:44:03.109155 6275 tablet_bootstrap.cc:654] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.114100 6271 ts_tablet_manager.cc:1428] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260928 10:44:03.116305 6269 rpcz_store.cc:276] 0928 10:44:01.067909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.067961 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:02.975346 (+1907385us) ts_tablet_manager.cc:1145] Deleting tablet 1e32961679ee47379dab4c62efc53d99
0928 10:44:02.975355 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.037879 (+ 62524us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.086201 (+ 48322us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.108028 (+ 21827us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":1906633}
I20260928 10:44:03.116716 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:03.116989 6269 tablet_replica.cc:330] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.117199 6269 raft_consensus.cc:2229] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.117440 6269 raft_consensus.cc:2258] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.118144 6269 ts_tablet_manager.cc:1905] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.118767 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1e32961679ee47379dab4c62efc53d99 (table default.Table_89caef5f6e1943cd824b68ae13547e1d [id=f2e30412da7045c0b0bd9bbea0976fa6]) successfully deleted
I20260928 10:44:03.119728 6678 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2eb817eda984ab99ec4704c47699846: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 10:44:03.122419 6728 raft_consensus.cc:482] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.122638 6728 raft_consensus.cc:504] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.123291 6728 leader_election.cc:288] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.125572 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.125861 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.126116 6270 tablet_replica.cc:330] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.126338 6270 raft_consensus.cc:2229] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.126513 6270 raft_consensus.cc:2258] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:03.127699 5957 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:03.128386 6270 ts_tablet_manager.cc:1905] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:03.132917 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2eded874aa094054b0c2e7c2e592dba1 consensus state has no leader
I20260928 10:44:03.133600 6728 raft_consensus.cc:482] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.133783 6728 raft_consensus.cc:504] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.134497 6728 leader_election.cc:288] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.134877 6273 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.135046 6273 ts_tablet_manager.cc:1397] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260928 10:44:03.135190 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:03.135433 5883 raft_consensus.cc:2454] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:03.135859 6273 raft_consensus.cc:348] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.136096 6273 raft_consensus.cc:374] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.136119 5957 leader_election.cc:302] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:03.136180 6273 raft_consensus.cc:729] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.136402 6273 consensus_queue.cc:260] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.136572 6728 raft_consensus.cc:2781] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:03.136668 6728 raft_consensus.cc:482] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:03.136744 6728 raft_consensus.cc:3037] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.136991 6273 ts_tablet_manager.cc:1428] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:03.137265 6273 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.138947 6273 tablet_bootstrap.cc:654] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.138929 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:03.140075 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.141222 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_22bfb6af239a4abea551a6d34e6453d3" } new_table_name: "default.Table_7e9af122dd484e7b93ea68f097022ac8" modify_external_catalogs: true
I20260928 10:44:03.142127 6271 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.143440 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1c452474e96647c6a42ccc1dfd19d7db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.142499 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.143990 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c452474e96647c6a42ccc1dfd19d7db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.139938 6728 raft_consensus.cc:504] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.145615 6271 tablet_bootstrap.cc:654] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.146704 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:03.146942 5883 raft_consensus.cc:3037] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.149940 5883 raft_consensus.cc:2454] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:03.150568 5957 leader_election.cc:302] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:03.150961 6731 raft_consensus.cc:2781] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:03.151132 6731 raft_consensus.cc:686] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:03.151542 6731 consensus_queue.cc:237] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.154753 6271 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.154922 6271 ts_tablet_manager.cc:1397] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.001s
I20260928 10:44:03.155159 6728 leader_election.cc:288] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.155676 6269 ts_tablet_manager.cc:1918] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.155864 6269 log.cc:1196] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/5a51d9a67e15479587ab2d5a492bb7c2
I20260928 10:44:03.155803 6271 raft_consensus.cc:348] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.156020 6271 raft_consensus.cc:374] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.156111 6271 raft_consensus.cc:729] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.156354 6271 consensus_queue.cc:260] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.156610 6269 ts_tablet_manager.cc:1939] T 5a51d9a67e15479587ab2d5a492bb7c2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.156875 6271 ts_tablet_manager.cc:1428] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:03.157155 6271 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.158006 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 422) took 2089 ms. Trace:
I20260928 10:44:03.158784 6271 tablet_bootstrap.cc:654] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.159844 6270 ts_tablet_manager.cc:1918] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.160964 6270 log.cc:1196] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:03.163141 6270 ts_tablet_manager.cc:1939] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.164089 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ea33fe07f324842823f5f69dcbeec2b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.164199 6269 rpcz_store.cc:276] 0928 10:44:01.068920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.068977 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:03.116795 (+2047818us) ts_tablet_manager.cc:1145] Deleting tablet 5a51d9a67e15479587ab2d5a492bb7c2
0928 10:44:03.116807 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.128501 (+ 11694us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.155204 (+ 26703us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.157970 (+ 2766us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047632}
I20260928 10:44:03.165436 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 2ea33fe07f324842823f5f69dcbeec2b (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:03.165752 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 5a51d9a67e15479587ab2d5a492bb7c2 (table default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]) successfully deleted
I20260928 10:44:03.161842 6271 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.166731 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.167428 5955 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:03.167573 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 already in progress: creating tablet
I20260928 10:44:03.167582 5955 leader_election.cc:302] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:03.167752 5955 raft_consensus.cc:2670] T 2ea33fe07f324842823f5f69dcbeec2b P 2f6ffbf4f0534383bf89d15aa37e3027: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:03.167877 6270 tablet_replica.cc:330] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.168097 6270 raft_consensus.cc:2229] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.168470 6271 ts_tablet_manager.cc:1397] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 10:44:03.169238 6271 raft_consensus.cc:348] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.169503 6271 raft_consensus.cc:374] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.169776 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:03.169588 6270 raft_consensus.cc:2258] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.169997 6156 raft_consensus.cc:3037] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.169588 6271 raft_consensus.cc:729] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.170315 6271 consensus_queue.cc:260] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.170840 6271 ts_tablet_manager.cc:1428] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.171144 6271 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.172626 6271 tablet_bootstrap.cc:654] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.172675 6156 raft_consensus.cc:2454] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:03.173671 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 423) took 2104 ms. Trace:
I20260928 10:44:03.175597 6737 raft_consensus.cc:482] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.175750 6737 raft_consensus.cc:504] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.176484 6737 leader_election.cc:288] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.177250 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:03.177543 5883 raft_consensus.cc:2454] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:03.177781 6269 rpcz_store.cc:276] 0928 10:44:01.069344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.069381 (+ 37us) service_pool.cc:227] Handling call
0928 10:44:03.165300 (+2095919us) ts_tablet_manager.cc:1145] Deleting tablet 2d71edffecf044ba9cec14a70683a56f
0928 10:44:03.165311 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.173625 (+ 8314us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2095772}
I20260928 10:44:03.178181 6091 leader_election.cc:302] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:03.178292 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 424) took 2108 ms. Trace:
I20260928 10:44:03.178442 6737 raft_consensus.cc:2781] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:03.178403 6269 rpcz_store.cc:276] 0928 10:44:01.069715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.069754 (+ 39us) service_pool.cc:227] Handling call
0928 10:44:03.178160 (+2108406us) ts_tablet_manager.cc:1145] Deleting tablet 22f47338950743eb8a06e779a3ca5c69
0928 10:44:03.178171 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.178264 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2108239}
I20260928 10:44:03.178561 6737 raft_consensus.cc:482] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:03.178646 6737 raft_consensus.cc:3037] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.178820 6269 tablet_replica.cc:330] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.179006 6269 raft_consensus.cc:2229] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.179142 6269 raft_consensus.cc:2258] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:03.179198 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2d71edffecf044ba9cec14a70683a56f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d71edffecf044ba9cec14a70683a56f already in progress: creating tablet
W20260928 10:44:03.179469 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 22f47338950743eb8a06e779a3ca5c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22f47338950743eb8a06e779a3ca5c69 already in progress: creating tablet
I20260928 10:44:03.179639 6269 ts_tablet_manager.cc:1905] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.181299 6737 raft_consensus.cc:504] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.182057 6737 leader_election.cc:288] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.182572 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:03.182822 5883 raft_consensus.cc:3037] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.185906 5883 raft_consensus.cc:2454] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:03.186378 6091 leader_election.cc:302] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:03.187022 6737 raft_consensus.cc:2781] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:03.187270 6737 raft_consensus.cc:686] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:03.187438 6273 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.187615 6273 ts_tablet_manager.cc:1397] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.001s
I20260928 10:44:03.187593 6737 consensus_queue.cc:237] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.188310 6273 raft_consensus.cc:348] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.188576 6273 raft_consensus.cc:374] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.188648 6273 raft_consensus.cc:729] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.188886 6273 consensus_queue.cc:260] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.190841 6273 ts_tablet_manager.cc:1428] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:03.191131 6273 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.192529 6273 tablet_bootstrap.cc:654] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.196517 6270 ts_tablet_manager.cc:1905] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.200335 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:03.200342 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1677f971c9384d519f1ce94da1b7ef2a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.200611 6018 raft_consensus.cc:3037] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.203810 6018 raft_consensus.cc:2454] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:03.203981 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet a19c9c61d774437ea873fdc6e1c93486 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.206296 6270 ts_tablet_manager.cc:1918] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.206557 6270 log.cc:1196] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c4528bf643664da29496849c94e6dd2e
I20260928 10:44:03.207000 6270 ts_tablet_manager.cc:1939] T c4528bf643664da29496849c94e6dd2e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.208297 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c4528bf643664da29496849c94e6dd2e (table default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]) successfully deleted
W20260928 10:44:03.209167 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 already in progress: creating tablet
I20260928 10:44:03.215123 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa971239a2b4ac6bc309dfbacdbe12e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.215662 6155 raft_consensus.cc:2362] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1. Re-sending same reply.
I20260928 10:44:03.216866 6273 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.217060 6273 ts_tablet_manager.cc:1397] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s
I20260928 10:44:03.217458 6275 tablet_bootstrap.cc:492] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.217798 6273 raft_consensus.cc:348] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.218007 6273 raft_consensus.cc:374] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.218096 6273 raft_consensus.cc:729] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.218346 6273 consensus_queue.cc:260] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.218986 6273 ts_tablet_manager.cc:1428] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.220136 6269 ts_tablet_manager.cc:1918] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.222134 6269 log.cc:1196] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:03.222695 6269 ts_tablet_manager.cc:1939] T a380da90a76545dba647e0c1b3e05acd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.223917 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 425) took 2153 ms. Trace:
I20260928 10:44:03.228586 6275 ts_tablet_manager.cc:1397] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.115s user 0.000s sys 0.004s
I20260928 10:44:03.229446 6275 raft_consensus.cc:348] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.229727 6275 raft_consensus.cc:374] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.220517 6273 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.229828 6275 raft_consensus.cc:729] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.230082 6275 consensus_queue.cc:260] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.231679 6273 tablet_bootstrap.cc:654] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.232496 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_876356586bbc4fa09b7cd43884e6ff24" } modify_external_catalogs: true
I20260928 10:44:03.232748 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_876356586bbc4fa09b7cd43884e6ff24" } modify_external_catalogs: true
I20260928 10:44:03.232599 6269 rpcz_store.cc:276] 0928 10:44:01.070083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.070119 (+ 36us) service_pool.cc:227] Handling call
0928 10:44:03.178770 (+2108651us) ts_tablet_manager.cc:1145] Deleting tablet a380da90a76545dba647e0c1b3e05acd
0928 10:44:03.178779 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.199728 (+ 20949us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.220015 (+ 20287us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.223831 (+ 3816us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2108483}
I20260928 10:44:03.233104 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7c7420744fac446aa019cdc18caea501" } modify_external_catalogs: true
I20260928 10:44:03.233274 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7c7420744fac446aa019cdc18caea501" } modify_external_catalogs: true
I20260928 10:44:03.233482 6269 tablet_replica.cc:330] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.233487 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a380da90a76545dba647e0c1b3e05acd (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
I20260928 10:44:03.233819 6269 raft_consensus.cc:2229] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.234660 6269 raft_consensus.cc:2258] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:03.234783 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a229207ce7cc475c8f4492e62d122721 consensus state has no leader
I20260928 10:44:03.235179 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_13c8e14c1b6f453387a61626092d58a0" } new_table_name: "default.Table_12f98eb7390e4942864fe3d2eeb10eb7" modify_external_catalogs: true
I20260928 10:44:03.235304 6269 ts_tablet_manager.cc:1905] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.233893 6275 ts_tablet_manager.cc:1428] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:44:03.236469 6275 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:03.236946 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58c0af95fa58451490947176ec9301e3 consensus state has no leader
I20260928 10:44:03.238735 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet ea90e2cbd7624baab1522b8b4afa5f32 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.240763 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e518e1e5c90b4f0bac535431691e53fe" } new_table_name: "default.Table_5036aebd63204ce8ae1e2ce09e507570" modify_external_catalogs: true
I20260928 10:44:03.242425 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a6950587aac341189738d1f36a4b6250" } modify_external_catalogs: true
I20260928 10:44:03.242667 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a6950587aac341189738d1f36a4b6250" } modify_external_catalogs: true
I20260928 10:44:03.245198 6271 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.245393 6271 ts_tablet_manager.cc:1397] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.001s
I20260928 10:44:03.246189 6271 raft_consensus.cc:348] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.246454 6271 raft_consensus.cc:374] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.246572 6271 raft_consensus.cc:729] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.246838 6271 consensus_queue.cc:260] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.248558 6273 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.248728 6273 ts_tablet_manager.cc:1397] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20260928 10:44:03.249980 6271 ts_tablet_manager.cc:1428] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:03.250046 6273 raft_consensus.cc:348] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.250402 6273 raft_consensus.cc:374] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.250495 6273 raft_consensus.cc:729] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.250767 6273 consensus_queue.cc:260] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.251441 6273 ts_tablet_manager.cc:1428] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260928 10:44:03.251782 6273 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.253572 6273 tablet_bootstrap.cc:654] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.253961 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1a86ef60e78644ebb3a6b912b67ca670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.254643 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a86ef60e78644ebb3a6b912b67ca670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.255236 6731 raft_consensus.cc:482] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.255406 6731 raft_consensus.cc:504] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.256084 6731 leader_election.cc:288] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.256903 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:03.257139 5883 raft_consensus.cc:2454] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:03.257802 5957 leader_election.cc:302] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:03.258205 6731 raft_consensus.cc:2781] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:03.258297 6731 raft_consensus.cc:482] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:03.258392 6731 raft_consensus.cc:3037] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.261386 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.262844 6731 raft_consensus.cc:504] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:03.262238 5955 leader_election.cc:341] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.264554 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:03.265348 6731 leader_election.cc:288] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:03.265375 5955 leader_election.cc:341] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.265830 6271 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.267561 6271 tablet_bootstrap.cc:654] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.271620 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427b96ce675d48629fcbf8bbcf6e500e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:03.271865 5883 raft_consensus.cc:3037] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:03.275478 5883 raft_consensus.cc:2454] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:03.276670 5957 leader_election.cc:302] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.277719 6731 raft_consensus.cc:2781] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:03.278908 6269 ts_tablet_manager.cc:1918] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.278894 6731 raft_consensus.cc:686] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:03.279112 6269 log.cc:1196] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a4ed61f43d5d4a6fa21eb854dae895d8
I20260928 10:44:03.279117 6275 tablet_bootstrap.cc:654] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.279160 6731 consensus_queue.cc:237] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.279712 6269 ts_tablet_manager.cc:1939] T a4ed61f43d5d4a6fa21eb854dae895d8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.280577 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 426) took 2210 ms. Trace:
I20260928 10:44:03.280751 6269 rpcz_store.cc:276] 0928 10:44:01.070460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.070521 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:03.233332 (+2162811us) ts_tablet_manager.cc:1145] Deleting tablet a4ed61f43d5d4a6fa21eb854dae895d8
0928 10:44:03.233344 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.255758 (+ 22414us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.278778 (+ 23020us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.280540 (+ 1762us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2162654}
I20260928 10:44:03.285856 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 427) took 2215 ms. Trace:
I20260928 10:44:03.285892 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a4ed61f43d5d4a6fa21eb854dae895d8 (table default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]) successfully deleted
I20260928 10:44:03.286366 6269 rpcz_store.cc:276] 0928 10:44:01.070858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.070894 (+ 36us) service_pool.cc:227] Handling call
0928 10:44:03.285688 (+2214794us) ts_tablet_manager.cc:1145] Deleting tablet 75e19b8189894e91a8be5a150f54cb6b
0928 10:44:03.285700 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.285824 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2214645}
W20260928 10:44:03.287040 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bae5a2038947413f95f134602081c889 consensus state has no leader
I20260928 10:44:03.287225 6269 tablet_replica.cc:330] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.287446 6269 raft_consensus.cc:2229] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.287441 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5f2ddf1361dc4fa8959ededb61aef4dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.287608 6269 raft_consensus.cc:2258] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:03.287997 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f2ddf1361dc4fa8959ededb61aef4dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.288133 6269 ts_tablet_manager.cc:1905] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:03.290004 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 75e19b8189894e91a8be5a150f54cb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75e19b8189894e91a8be5a150f54cb6b already in progress: creating tablet
I20260928 10:44:03.293610 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:03.294577 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:03.294847 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bbc76197cee647ed96ae1e077c21f1d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.295356 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet a25c7f3b94e94cafb3275a2e190be0ed from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:03.295456 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbc76197cee647ed96ae1e077c21f1d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.297040 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba8abd00f2742a29fdc79059332b91d with delete_type TABLET_DATA_DELETED (replaced by tablet 5afe4501ea584d44b511b89983e210e3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.298051 6272 tablet_replica.cc:330] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.298274 6272 raft_consensus.cc:2229] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.298450 6272 raft_consensus.cc:2258] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.300318 6272 ts_tablet_manager.cc:1905] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.300745 6271 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.300907 6271 ts_tablet_manager.cc:1397] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260928 10:44:03.301640 6271 raft_consensus.cc:348] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.301901 6271 raft_consensus.cc:374] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.301992 6271 raft_consensus.cc:729] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.302827 6273 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.302983 6273 ts_tablet_manager.cc:1397] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.006s
I20260928 10:44:03.303699 6273 raft_consensus.cc:348] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.303906 6273 raft_consensus.cc:374] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.303982 6273 raft_consensus.cc:729] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.304309 6271 consensus_queue.cc:260] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.304929 6271 ts_tablet_manager.cc:1428] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:03.305132 6273 consensus_queue.cc:260] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.305263 6732 raft_consensus.cc:482] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.305404 6732 raft_consensus.cc:504] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.305716 6273 ts_tablet_manager.cc:1428] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:03.306010 6273 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.306051 6732 leader_election.cc:288] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:03.306150 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:03.307793 6273 tablet_bootstrap.cc:654] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.307858 5702 catalog_manager.cc:5495] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67). New cstate: current_term: 1 leader_uuid: "4dab87557ec9445dbe35ea05e3561a94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:03.308295 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:03.308959 6271 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.309211 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 37a685d70ec44acb9f9ffadec2105307 (DEFAULT_TABLE table=default.Table_6063c7c57810402b9a28be794c2fe2f4 [id=12bd500d1fc0428aa23aa0c132c29514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.309748 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9583b5637a428db383320d98a7a280" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.311012 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.311771 6271 tablet_bootstrap.cc:654] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:03.312753 5818 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.313082 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 37a685d70ec44acb9f9ffadec2105307 (DEFAULT_TABLE table=default.Table_6063c7c57810402b9a28be794c2fe2f4 [id=12bd500d1fc0428aa23aa0c132c29514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.313323 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a685d70ec44acb9f9ffadec2105307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.313498 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a685d70ec44acb9f9ffadec2105307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.316166 6001 tablet_service.cc:1467] Processing CreateTablet for tablet de99da54941a4eaf9107f4b2efca5c7b (DEFAULT_TABLE table=default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5 [id=aae3d67dd75642aeb962dff5dfc0551b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.316337 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.316776 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.318468 6118 tablet_service.cc:1467] Processing CreateTablet for tablet de99da54941a4eaf9107f4b2efca5c7b (DEFAULT_TABLE table=default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5 [id=aae3d67dd75642aeb962dff5dfc0551b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.318883 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99da54941a4eaf9107f4b2efca5c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.319337 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99da54941a4eaf9107f4b2efca5c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.322671 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.323181 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 37a685d70ec44acb9f9ffadec2105307 (DEFAULT_TABLE table=default.Table_6063c7c57810402b9a28be794c2fe2f4 [id=12bd500d1fc0428aa23aa0c132c29514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.323626 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a685d70ec44acb9f9ffadec2105307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.325521 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.327108 5854 tablet_service.cc:1467] Processing CreateTablet for tablet de99da54941a4eaf9107f4b2efca5c7b (DEFAULT_TABLE table=default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5 [id=aae3d67dd75642aeb962dff5dfc0551b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.327517 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99da54941a4eaf9107f4b2efca5c7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:03.328168 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d03d764256a4a8d9d8bb17b82fe8bda consensus state has no leader
I20260928 10:44:03.329559 5701 catalog_manager.cc:5495] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:03.330058 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:03.330840 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.330986 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bb8c5c03d60e4a16b7a66ec258c00e74" } modify_external_catalogs: true
I20260928 10:44:03.331159 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bb8c5c03d60e4a16b7a66ec258c00e74" } modify_external_catalogs: true
I20260928 10:44:03.331238 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.334127 6272 ts_tablet_manager.cc:1918] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.334326 6272 log.cc:1196] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1ba8abd00f2742a29fdc79059332b91d
I20260928 10:44:03.334954 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9583b5637a428db383320d98a7a280" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.336515 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 03ebfc156361479c909ff263c3be4601 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.336987 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ebfc156361479c909ff263c3be4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.337424 6272 ts_tablet_manager.cc:1939] T 1ba8abd00f2742a29fdc79059332b91d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.338379 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1ba8abd00f2742a29fdc79059332b91d (table default.Table_401439ae18274d0b922ac1bb235ee300 [id=13c323309f6d42d49f3e4a1448e2ff73]) successfully deleted
W20260928 10:44:03.343664 5817 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.343854 5817 leader_election.cc:302] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.344376 6729 raft_consensus.cc:2726] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.348286 6271 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.348485 6271 ts_tablet_manager.cc:1397] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.003s
I20260928 10:44:03.349244 6271 raft_consensus.cc:348] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.349525 6271 raft_consensus.cc:374] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.349630 6271 raft_consensus.cc:729] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.350632 6269 ts_tablet_manager.cc:1918] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.350806 6269 log.cc:1196] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/427b96ce675d48629fcbf8bbcf6e500e
I20260928 10:44:03.351202 6269 ts_tablet_manager.cc:1939] T 427b96ce675d48629fcbf8bbcf6e500e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.351672 6271 consensus_queue.cc:260] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.352344 6271 ts_tablet_manager.cc:1428] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260928 10:44:03.356194 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 03ebfc156361479c909ff263c3be4601 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.356195 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 03ebfc156361479c909ff263c3be4601 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.356673 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ebfc156361479c909ff263c3be4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.356673 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ebfc156361479c909ff263c3be4601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.361567 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 11c6ed97f74540b786ed3a6378dea0d3
I20260928 10:44:03.361686 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f (DEFAULT_TABLE table=default.Table_af4b71ec0d304f94a6c07ff8ea188704 [id=57dbe17c197d4f299ce69cf2d40fee50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.362317 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c19618aa84f24be0f9b1e4224f47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.363632 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f (DEFAULT_TABLE table=default.Table_af4b71ec0d304f94a6c07ff8ea188704 [id=57dbe17c197d4f299ce69cf2d40fee50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.363853 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.364032 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c19618aa84f24be0f9b1e4224f47f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:03.367391 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 11c6ed97f74540b786ed3a6378dea0d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c6ed97f74540b786ed3a6378dea0d3 already in progress: creating tablet
I20260928 10:44:03.367514 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f (DEFAULT_TABLE table=default.Table_af4b71ec0d304f94a6c07ff8ea188704 [id=57dbe17c197d4f299ce69cf2d40fee50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.368801 6132 tablet_service.cc:1467] Processing CreateTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba (DEFAULT_TABLE table=default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9 [id=91f840baa69c4256ad99009b9faade65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.368892 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 419) took 2301 ms. Trace:
I20260928 10:44:03.369019 6269 rpcz_store.cc:276] 0928 10:44:01.067349 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.080804 (+ 13455us) service_pool.cc:227] Handling call
0928 10:44:03.287168 (+2206364us) ts_tablet_manager.cc:1145] Deleting tablet 427b96ce675d48629fcbf8bbcf6e500e
0928 10:44:03.287178 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.312695 (+ 25517us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.350458 (+ 37763us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.368790 (+ 18332us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2205662}
I20260928 10:44:03.369402 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe768adf9a1b4631b63151f8cf3cc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.369519 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 430) took 2157 ms. Trace:
I20260928 10:44:03.369611 6269 rpcz_store.cc:276] 0928 10:44:01.212156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.212205 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:03.369370 (+2157165us) ts_tablet_manager.cc:1145] Deleting tablet 1072cf156cdf4c2a8c9d9764de110c6d
0928 10:44:03.369390 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.369477 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156938}
I20260928 10:44:03.370174 6271 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.371866 6271 tablet_bootstrap.cc:654] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.373124 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c19618aa84f24be0f9b1e4224f47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.374361 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:03.374909 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 427b96ce675d48629fcbf8bbcf6e500e (table default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]) successfully deleted
I20260928 10:44:03.375021 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:03.375135 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1072cf156cdf4c2a8c9d9764de110c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1072cf156cdf4c2a8c9d9764de110c6d already in progress: creating tablet
I20260928 10:44:03.375461 6273 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.375620 6273 ts_tablet_manager.cc:1397] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20260928 10:44:03.376343 6273 raft_consensus.cc:348] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.376585 6273 raft_consensus.cc:374] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.376662 6273 raft_consensus.cc:729] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.376971 6273 consensus_queue.cc:260] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.377449 6273 ts_tablet_manager.cc:1428] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.377750 6273 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.379412 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 429) took 2167 ms. Trace:
I20260928 10:44:03.379508 6269 rpcz_store.cc:276] 0928 10:44:01.212020 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.212500 (+ 480us) service_pool.cc:227] Handling call
0928 10:44:03.379247 (+2166747us) ts_tablet_manager.cc:1145] Deleting tablet 9fe0dd05136840ee91d0b2a415ad49fc
0928 10:44:03.379256 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.379355 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166569}
I20260928 10:44:03.379967 6269 tablet_replica.cc:330] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:03.380055 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9fe0dd05136840ee91d0b2a415ad49fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fe0dd05136840ee91d0b2a415ad49fc already in progress: creating tablet
I20260928 10:44:03.380137 6269 raft_consensus.cc:2229] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.380293 6269 raft_consensus.cc:2258] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.380523 6275 tablet_bootstrap.cc:492] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.380663 6275 ts_tablet_manager.cc:1397] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.144s user 0.001s sys 0.002s
I20260928 10:44:03.380788 6269 ts_tablet_manager.cc:1905] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.381346 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 104a223ec6ef47988d0aa3335a1f81de from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.381368 6275 raft_consensus.cc:348] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.381564 6275 raft_consensus.cc:374] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.381645 6275 raft_consensus.cc:729] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.381822 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 9319d4d4102e43b19c0caa0b0a4b4740 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.382282 6275 consensus_queue.cc:260] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.383279 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.383615 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.383781 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.384145 6275 ts_tablet_manager.cc:1428] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:03.385064 5854 tablet_service.cc:1467] Processing CreateTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba (DEFAULT_TABLE table=default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9 [id=91f840baa69c4256ad99009b9faade65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.385488 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe768adf9a1b4631b63151f8cf3cc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.385640 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e (DEFAULT_TABLE table=default.Table_2adfb715d87e4f0a8e837a43938de99e [id=ff7c145afa07429eb0d3510cf722531c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.385901 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.385994 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3bf7a6b83344c886362cc216c9e26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.386332 6273 tablet_bootstrap.cc:654] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.391414 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.382799 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5759f5da5ae84d678ab6a2e2042182e2" } new_table_name: "default.Table_a98c668a7dea48138cdba63f65364fe8" modify_external_catalogs: true
I20260928 10:44:03.394835 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_922ff47b37674ce099a7cab4c39b7167" } modify_external_catalogs: true
I20260928 10:44:03.395208 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.391147 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e2765a3c31e249c5ae04b511e48c2d3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.396306 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2765a3c31e249c5ae04b511e48c2d3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.395037 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_922ff47b37674ce099a7cab4c39b7167" } modify_external_catalogs: true
I20260928 10:44:03.397480 6275 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.401043 6275 tablet_bootstrap.cc:654] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.402319 6269 ts_tablet_manager.cc:1918] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:03.403389 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 11c6ed97f74540b786ed3a6378dea0d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c6ed97f74540b786ed3a6378dea0d3 already in progress: creating tablet
I20260928 10:44:03.403890 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 2c683445c12e43cc9379bf465f7e252c (DEFAULT_TABLE table=default.Table_e14d183b3e9c4c16887eb2264760edde [id=359d7663c53c46f592a1bb6b29de7020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.404302 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c683445c12e43cc9379bf465f7e252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.404851 5991 tablet_service.cc:1467] Processing CreateTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba (DEFAULT_TABLE table=default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9 [id=91f840baa69c4256ad99009b9faade65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.405277 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe768adf9a1b4631b63151f8cf3cc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.406816 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07d2f6a5c1402c9768b84177f52fc2 (DEFAULT_TABLE table=default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.406988 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07d2f6a5c1402c9768b84177f52fc2 (DEFAULT_TABLE table=default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.407297 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07d2f6a5c1402c9768b84177f52fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.407383 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07d2f6a5c1402c9768b84177f52fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.410931 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e (DEFAULT_TABLE table=default.Table_2adfb715d87e4f0a8e837a43938de99e [id=ff7c145afa07429eb0d3510cf722531c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.410949 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e (DEFAULT_TABLE table=default.Table_2adfb715d87e4f0a8e837a43938de99e [id=ff7c145afa07429eb0d3510cf722531c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.411302 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3bf7a6b83344c886362cc216c9e26e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:03.415345 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet bae5a2038947413f95f134602081c889 (table default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet bae5a2038947413f95f134602081c889 consensus state has no leader
I20260928 10:44:03.416101 6729 raft_consensus.cc:482] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.416249 6729 raft_consensus.cc:504] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.416937 6729 leader_election.cc:288] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:03.417374 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a0d63c6cbc4eebaf42dc7f969f243c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.418071 5817 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.423655 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet c4528bf643664da29496849c94e6dd2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.424032 6272 tablet_replica.cc:330] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.424225 6272 raft_consensus.cc:2229] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.424412 6272 raft_consensus.cc:2258] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.412164 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 2c683445c12e43cc9379bf465f7e252c (DEFAULT_TABLE table=default.Table_e14d183b3e9c4c16887eb2264760edde [id=359d7663c53c46f592a1bb6b29de7020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.426016 6272 ts_tablet_manager.cc:1905] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.426752 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3bf7a6b83344c886362cc216c9e26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.427172 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_28ea586599a94b6a86535e4d617de2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.427748 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c683445c12e43cc9379bf465f7e252c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:03.427867 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28ea586599a94b6a86535e4d617de2be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.425974 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a0d63c6cbc4eebaf42dc7f969f243c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.429158 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 2c683445c12e43cc9379bf465f7e252c (DEFAULT_TABLE table=default.Table_e14d183b3e9c4c16887eb2264760edde [id=359d7663c53c46f592a1bb6b29de7020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.429598 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c683445c12e43cc9379bf465f7e252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.426795 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07d2f6a5c1402c9768b84177f52fc2 (DEFAULT_TABLE table=default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:03.430584 5818 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.430768 5818 leader_election.cc:302] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.431324 6729 raft_consensus.cc:2726] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.431689 6273 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.432000 6273 ts_tablet_manager.cc:1397] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.003s
I20260928 10:44:03.432021 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07d2f6a5c1402c9768b84177f52fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.433749 6273 raft_consensus.cc:348] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.434002 6273 raft_consensus.cc:374] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.434088 6273 raft_consensus.cc:729] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.439344 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a25c7f3b94e94cafb3275a2e190be0ed
I20260928 10:44:03.439903 5695 catalog_manager.cc:6565] ReplaceTablet: tablet a25c7f3b94e94cafb3275a2e190be0ed deleted and replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5
I20260928 10:44:03.441195 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.441459 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.445139 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a25c7f3b94e94cafb3275a2e190be0ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25c7f3b94e94cafb3275a2e190be0ed already in progress: creating tablet
I20260928 10:44:03.445951 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_767ffc9c94824b23bb8020515c96aa8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.446669 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_767ffc9c94824b23bb8020515c96aa8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.446651 6273 consensus_queue.cc:260] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.447302 6273 ts_tablet_manager.cc:1428] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260928 10:44:03.447397 6269 log.cc:1196] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/733ca22794da4015bbe09ed6c374ad05
I20260928 10:44:03.447847 6269 ts_tablet_manager.cc:1939] T 733ca22794da4015bbe09ed6c374ad05 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.448314 6273 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.448511 6272 ts_tablet_manager.cc:1918] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.448714 6272 log.cc:1196] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c4528bf643664da29496849c94e6dd2e
I20260928 10:44:03.449064 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 65905f0cb4154bdcb8ee6702c87d23ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.449599 6272 ts_tablet_manager.cc:1939] T c4528bf643664da29496849c94e6dd2e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.450059 6273 tablet_bootstrap.cc:654] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.450511 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c4528bf643664da29496849c94e6dd2e (table default.Table_96174d1bf9934bcf8ca2a0000012d955 [id=bf76917b11cd472495e7a31269b3a9ca]) successfully deleted
W20260928 10:44:03.451259 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a25c7f3b94e94cafb3275a2e190be0ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25c7f3b94e94cafb3275a2e190be0ed already in progress: creating tablet
I20260928 10:44:03.453959 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 431) took 2219 ms. Trace:
I20260928 10:44:03.454113 6269 rpcz_store.cc:276] 0928 10:44:01.234388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.234457 (+ 69us) service_pool.cc:227] Handling call
0928 10:44:03.379891 (+2145434us) ts_tablet_manager.cc:1145] Deleting tablet 733ca22794da4015bbe09ed6c374ad05
0928 10:44:03.379900 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.398708 (+ 18808us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.402190 (+ 3482us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.453906 (+ 51716us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2144797}
I20260928 10:44:03.455721 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 733ca22794da4015bbe09ed6c374ad05 (table default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]) successfully deleted
I20260928 10:44:03.456570 6272 tablet_replica.cc:330] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.456811 6272 raft_consensus.cc:2229] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.457048 6272 raft_consensus.cc:2258] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.457937 6272 ts_tablet_manager.cc:1905] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.455680 6269 tablet_replica.cc:330] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.458809 6269 raft_consensus.cc:2229] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.459005 6269 raft_consensus.cc:2258] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.459568 6269 ts_tablet_manager.cc:1905] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.465088 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c780d8c23a764f769848fa04550ceff6
I20260928 10:44:03.466245 6269 ts_tablet_manager.cc:1918] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.466400 6269 log.cc:1196] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e25db69b15eb445792e6168f99304bf2
I20260928 10:44:03.466826 6269 ts_tablet_manager.cc:1939] T e25db69b15eb445792e6168f99304bf2 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.466820 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:03.467620 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 435) took 2010 ms. Trace:
I20260928 10:44:03.467535 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9de49f9ac8fb408e925afecc2ca2c293"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.467724 6269 rpcz_store.cc:276] 0928 10:44:01.456710 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.456764 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:03.454409 (+1997645us) ts_tablet_manager.cc:1145] Deleting tablet e25db69b15eb445792e6168f99304bf2
0928 10:44:03.455618 (+ 1209us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.462699 (+ 7081us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.466143 (+ 3444us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.467562 (+ 1419us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1996546}
W20260928 10:44:03.468086 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9de49f9ac8fb408e925afecc2ca2c293 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.468647 6269 tablet_replica.cc:330] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.468858 6269 raft_consensus.cc:2229] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.469038 6269 raft_consensus.cc:2258] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.469559 6269 ts_tablet_manager.cc:1905] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.469871 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet c780d8c23a764f769848fa04550ceff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.471127 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c780d8c23a764f769848fa04550ceff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c780d8c23a764f769848fa04550ceff6 already in progress: creating tablet
I20260928 10:44:03.477385 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ea90e2cbd7624baab1522b8b4afa5f32
I20260928 10:44:03.477809 5697 catalog_manager.cc:6565] ReplaceTablet: tablet ea90e2cbd7624baab1522b8b4afa5f32 deleted and replaced by tablet 734c09c7645c4dd3a05f6508297ee48b
I20260928 10:44:03.478261 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 with delete_type TABLET_DATA_DELETED (replaced by tablet 734c09c7645c4dd3a05f6508297ee48b) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.478950 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ea90e2cbd7624baab1522b8b4afa5f32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea90e2cbd7624baab1522b8b4afa5f32 already in progress: creating tablet
I20260928 10:44:03.479108 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ed443629ab604099a6fe5aff1840a553
I20260928 10:44:03.479367 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 with delete_type TABLET_DATA_DELETED (replaced by tablet 734c09c7645c4dd3a05f6508297ee48b) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.479725 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7083e30c5bf441738eb57535673b970d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.479935 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e25db69b15eb445792e6168f99304bf2 (table default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]) successfully deleted
I20260928 10:44:03.480206 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet ed443629ab604099a6fe5aff1840a553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.480295 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7083e30c5bf441738eb57535673b970d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.480278 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet ed443629ab604099a6fe5aff1840a553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.480455 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet ed443629ab604099a6fe5aff1840a553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.481082 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ed443629ab604099a6fe5aff1840a553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed443629ab604099a6fe5aff1840a553 already in progress: creating tablet
I20260928 10:44:03.481343 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 with delete_type TABLET_DATA_DELETED (replaced by tablet 734c09c7645c4dd3a05f6508297ee48b) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.482034 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet c780d8c23a764f769848fa04550ceff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.485275 6271 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.485459 6271 ts_tablet_manager.cc:1397] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.115s user 0.009s sys 0.000s
I20260928 10:44:03.486292 6272 ts_tablet_manager.cc:1918] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.486434 6272 log.cc:1196] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/65905f0cb4154bdcb8ee6702c87d23ca
I20260928 10:44:03.486775 6272 ts_tablet_manager.cc:1939] T 65905f0cb4154bdcb8ee6702c87d23ca P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.486755 6271 raft_consensus.cc:348] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.487016 6271 raft_consensus.cc:374] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.487098 6271 raft_consensus.cc:729] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.487326 6271 consensus_queue.cc:260] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.487443 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.487306 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 65905f0cb4154bdcb8ee6702c87d23ca (table default.Table_51182a736d85419b988e29c595a08051 [id=1f194293de074b918e93e7d71ac72b5e]) successfully deleted
I20260928 10:44:03.487854 6271 ts_tablet_manager.cc:1428] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.488461 6271 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.490962 6271 tablet_bootstrap.cc:654] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.492148 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet c780d8c23a764f769848fa04550ceff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.493607 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ea90e2cbd7624baab1522b8b4afa5f32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea90e2cbd7624baab1522b8b4afa5f32 already in progress: creating tablet
W20260928 10:44:03.494575 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ed443629ab604099a6fe5aff1840a553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed443629ab604099a6fe5aff1840a553 already in progress: creating tablet
I20260928 10:44:03.499360 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a61d97ed6b7b4dcba34a7a2190316b02
I20260928 10:44:03.500415 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.500826 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c780d8c23a764f769848fa04550ceff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c780d8c23a764f769848fa04550ceff6 already in progress: creating tablet
I20260928 10:44:03.501067 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.501178 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a61d97ed6b7b4dcba34a7a2190316b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61d97ed6b7b4dcba34a7a2190316b02 already in progress: creating tablet
I20260928 10:44:03.501530 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:03.501695 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a61d97ed6b7b4dcba34a7a2190316b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61d97ed6b7b4dcba34a7a2190316b02 already in progress: creating tablet
I20260928 10:44:03.502524 6273 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.502684 6273 ts_tablet_manager.cc:1397] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.005s
I20260928 10:44:03.503443 6273 raft_consensus.cc:348] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.503747 6273 raft_consensus.cc:374] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.503780 6275 tablet_bootstrap.cc:492] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.503816 6273 raft_consensus.cc:729] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.503957 6275 ts_tablet_manager.cc:1397] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.001s
I20260928 10:44:03.504051 6273 consensus_queue.cc:260] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.504670 6273 ts_tablet_manager.cc:1428] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.504690 6275 raft_consensus.cc:348] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.504925 6275 raft_consensus.cc:374] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.504998 6275 raft_consensus.cc:729] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.505255 6275 consensus_queue.cc:260] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.506523 6273 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.507859 6275 ts_tablet_manager.cc:1428] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:03.508178 6275 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.510881 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9d7e6f17bff44442923f9cb732081e0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.511559 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d7e6f17bff44442923f9cb732081e0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.512059 6273 tablet_bootstrap.cc:654] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.514724 6729 raft_consensus.cc:482] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.514896 6729 raft_consensus.cc:504] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.515502 6729 leader_election.cc:288] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:03.516081 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "734c3196929d4814b77bce7938bf598e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.516700 5817 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.517714 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "734c3196929d4814b77bce7938bf598e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:03.518962 5818 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.519119 5818 leader_election.cc:302] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.519582 6729 raft_consensus.cc:2726] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.521843 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.522173 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.522501 6270 tablet_replica.cc:330] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.522706 6270 raft_consensus.cc:2229] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:03.522933 6270 pending_rounds.cc:62] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:03.523010 6270 pending_rounds.cc:68] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265828474535936 op_type: NO_OP noop_request { }
I20260928 10:44:03.523134 6270 raft_consensus.cc:2866] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:03.523247 6270 raft_consensus.cc:2258] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.523689 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.524505 6270 ts_tablet_manager.cc:1905] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.528468 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.528599 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.528712 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.530651 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.530678 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_afd6eb9c78464f419465f6375df9d5cf" } new_table_name: "default.Table_657fa5819345488788e6612b8a05deaa" modify_external_catalogs: true
I20260928 10:44:03.531051 6272 tablet_replica.cc:330] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.531245 6272 raft_consensus.cc:2229] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.531245 6270 ts_tablet_manager.cc:1918] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:03.531375 6270 log.cc:1196] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/427b96ce675d48629fcbf8bbcf6e500e
I20260928 10:44:03.531431 6272 raft_consensus.cc:2258] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.531775 6270 ts_tablet_manager.cc:1939] T 427b96ce675d48629fcbf8bbcf6e500e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.532522 6272 ts_tablet_manager.cc:1905] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.532827 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 427b96ce675d48629fcbf8bbcf6e500e (table default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]) successfully deleted
I20260928 10:44:03.533506 6270 tablet_replica.cc:330] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.533703 6270 raft_consensus.cc:2229] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.533885 6270 raft_consensus.cc:2258] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.534986 6269 ts_tablet_manager.cc:1918] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.535778 6270 ts_tablet_manager.cc:1905] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.536298 6269 log.cc:1196] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/317446124e354bbeaaef608d9e8852fd
I20260928 10:44:03.536971 6269 ts_tablet_manager.cc:1939] T 317446124e354bbeaaef608d9e8852fd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.538751 6272 ts_tablet_manager.cc:1918] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.537665 6273 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.538892 6272 log.cc:1196] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/427b96ce675d48629fcbf8bbcf6e500e
I20260928 10:44:03.539186 6273 ts_tablet_manager.cc:1397] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.004s
I20260928 10:44:03.539219 6272 ts_tablet_manager.cc:1939] T 427b96ce675d48629fcbf8bbcf6e500e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.539857 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 427b96ce675d48629fcbf8bbcf6e500e (table default.Table_19a3d99bd33d4f939d10a3b861a5a0cd [id=a584749da7484132ab62328b83f21835]) successfully deleted
I20260928 10:44:03.540091 6273 raft_consensus.cc:348] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.540367 6273 raft_consensus.cc:374] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.540493 6273 raft_consensus.cc:729] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.540781 6273 consensus_queue.cc:260] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.541412 6273 ts_tablet_manager.cc:1428] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:03.541936 6273 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.542356 6275 tablet_bootstrap.cc:654] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.543663 6273 tablet_bootstrap.cc:654] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.544059 6271 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.544207 6271 ts_tablet_manager.cc:1397] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260928 10:44:03.545027 6271 raft_consensus.cc:348] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.545269 6271 raft_consensus.cc:374] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.545365 6271 raft_consensus.cc:729] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.545591 6271 consensus_queue.cc:260] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.548272 6271 ts_tablet_manager.cc:1428] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:03.548604 6271 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:03.550232 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29a1be37ede84ea485182044be92b8c6 consensus state has no leader
I20260928 10:44:03.553432 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_134f33c0d27c4f579572dcad2654bc65" } new_table_name: "default.Table_5d9a9b1e53f0424cbd3ac7c00550534f" modify_external_catalogs: true
I20260928 10:44:03.554713 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 971f8344436f4e60ac0152e811efea8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.556558 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 427b96ce675d48629fcbf8bbcf6e500e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.561326 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d028317843a24ae18ce20c6d26017c92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.561964 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d028317843a24ae18ce20c6d26017c92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.563499 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 82b3afe074194023ba788094a2a6b81c
I20260928 10:44:03.564483 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b3afe074194023ba788094a2a6b81c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.564507 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_40542c2360704c5ca950edfd1e8274e2" } new_table_name: "default.Table_ed31eead32684a629bc6dc930678fa40" modify_external_catalogs: true
I20260928 10:44:03.564790 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b3afe074194023ba788094a2a6b81c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.573972 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b3afe074194023ba788094a2a6b81c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.575644 6271 tablet_bootstrap.cc:654] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.546149 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 436) took 2080 ms. Trace:
I20260928 10:44:03.579169 6269 rpcz_store.cc:276] 0928 10:44:01.465251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.465306 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:03.468031 (+2002725us) ts_tablet_manager.cc:1145] Deleting tablet 317446124e354bbeaaef608d9e8852fd
0928 10:44:03.468042 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.501010 (+ 32968us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.534836 (+ 33826us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.546098 (+ 11262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002486}
I20260928 10:44:03.579854 6270 ts_tablet_manager.cc:1918] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.579998 6270 log.cc:1196] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/97e20784940a4647a220ad74e3e15f83
I20260928 10:44:03.580394 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 317446124e354bbeaaef608d9e8852fd (table default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]) successfully deleted
I20260928 10:44:03.581221 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 437) took 2094 ms. Trace:
I20260928 10:44:03.584468 6271 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.584388 6269 rpcz_store.cc:276] 0928 10:44:01.486659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.486850 (+ 191us) service_pool.cc:227] Handling call
0928 10:44:03.581059 (+2094209us) ts_tablet_manager.cc:1145] Deleting tablet 07a0c6ca08884dc6813b25e3991d0d8c
0928 10:44:03.581070 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.581187 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2093986}
I20260928 10:44:03.584645 6271 ts_tablet_manager.cc:1397] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
W20260928 10:44:03.585078 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 07a0c6ca08884dc6813b25e3991d0d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07a0c6ca08884dc6813b25e3991d0d8c already in progress: creating tablet
I20260928 10:44:03.585316 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 438) took 2098 ms. Trace:
I20260928 10:44:03.585578 6269 rpcz_store.cc:276] 0928 10:44:01.486800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.486988 (+ 188us) service_pool.cc:227] Handling call
0928 10:44:03.585147 (+2098159us) ts_tablet_manager.cc:1145] Deleting tablet 847b18c212474456ac9b40eee055dbd0
0928 10:44:03.585160 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.585282 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2098005}
W20260928 10:44:03.586018 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 847b18c212474456ac9b40eee055dbd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 847b18c212474456ac9b40eee055dbd0 already in progress: creating tablet
I20260928 10:44:03.586119 6269 tablet_replica.cc:330] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.586733 6269 raft_consensus.cc:2229] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.586978 6269 raft_consensus.cc:2258] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.587627 6269 ts_tablet_manager.cc:1905] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.590716 6270 ts_tablet_manager.cc:1939] T 97e20784940a4647a220ad74e3e15f83 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.591500 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a89653eaa7ec4ee3abdd48beaad49fce" } new_table_name: "default.Table_01c93471d7f34f44b0ffbea6e492c088" modify_external_catalogs: true
I20260928 10:44:03.591765 6275 tablet_bootstrap.cc:492] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.591809 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 97e20784940a4647a220ad74e3e15f83 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:44:03.591913 6275 ts_tablet_manager.cc:1397] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.001s
I20260928 10:44:03.592941 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet e9e0bac650904b8f81474ba2dac9c04f from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.593022 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_538716398c7244d295dc35a0876d202b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.593106 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3cfd0d068acd44ee9c6d5c6966f0a1b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.593546 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_538716398c7244d295dc35a0876d202b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:03.593642 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cfd0d068acd44ee9c6d5c6966f0a1b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:03.595474 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 427b96ce675d48629fcbf8bbcf6e500e because the tablet was not found. No further retry: Not found: Tablet not found: 427b96ce675d48629fcbf8bbcf6e500e
I20260928 10:44:03.595593 6275 raft_consensus.cc:348] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.595831 6275 raft_consensus.cc:374] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.595927 6275 raft_consensus.cc:729] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.596190 6275 consensus_queue.cc:260] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.596863 6275 ts_tablet_manager.cc:1428] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 10:44:03.597189 6275 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:03.596473 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 82b3afe074194023ba788094a2a6b81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82b3afe074194023ba788094a2a6b81c already in progress: creating tablet
I20260928 10:44:03.598206 6729 raft_consensus.cc:482] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.598428 6729 raft_consensus.cc:504] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.599153 6729 leader_election.cc:288] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:03.599503 6275 tablet_bootstrap.cc:654] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.599625 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1631d396362a4cffa1dec06d00894c63" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.599858 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1631d396362a4cffa1dec06d00894c63" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:03.600193 5817 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:03.600437 5818 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.600582 5818 leader_election.cc:302] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.601150 6729 raft_consensus.cc:2726] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:03.603950 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84c30726853549dfbc57f65fd31603fa consensus state has no leader
I20260928 10:44:03.604308 6275 tablet_bootstrap.cc:492] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.604481 6275 ts_tablet_manager.cc:1397] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260928 10:44:03.610977 6273 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.611606 6273 ts_tablet_manager.cc:1397] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.000s
I20260928 10:44:03.612759 6273 raft_consensus.cc:348] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.613036 6273 raft_consensus.cc:374] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.613116 6273 raft_consensus.cc:729] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.613456 6273 consensus_queue.cc:260] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.614056 6273 ts_tablet_manager.cc:1428] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.614374 6273 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.615919 6271 raft_consensus.cc:348] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.616175 6271 raft_consensus.cc:374] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.616251 6271 raft_consensus.cc:729] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.616164 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_63fc7a3742ea42e28b3a0bb25584c00f" } modify_external_catalogs: true
I20260928 10:44:03.616443 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_63fc7a3742ea42e28b3a0bb25584c00f" } modify_external_catalogs: true
I20260928 10:44:03.617322 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_093d6eb485344036802223ce544f483a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.617775 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6f7476c814e0a9abf56b23c1e547d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.617933 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_093d6eb485344036802223ce544f483a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.621177 6272 tablet_replica.cc:330] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.621496 6272 raft_consensus.cc:2229] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.621775 6272 raft_consensus.cc:2258] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:03.622014 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1cdff9f01974354a81179dd9bd5a26e consensus state has no leader
I20260928 10:44:03.625550 6272 ts_tablet_manager.cc:1905] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.628850 6270 tablet_replica.cc:330] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.629860 6270 raft_consensus.cc:2229] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.633013 6275 raft_consensus.cc:348] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.633309 6275 raft_consensus.cc:374] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.633386 6275 raft_consensus.cc:729] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.633620 6275 consensus_queue.cc:260] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:03.634195 6275 ts_tablet_manager.cc:1428] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.030s user 0.000s sys 0.001s
I20260928 10:44:03.629082 6271 consensus_queue.cc:260] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.642058 6271 ts_tablet_manager.cc:1428] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20260928 10:44:03.642228 6270 raft_consensus.cc:2258] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.642340 6273 tablet_bootstrap.cc:654] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.643393 6270 ts_tablet_manager.cc:1905] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:03.648243 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c67f960eb84426f9ebdfef33306a9d0 consensus state has no leader
I20260928 10:44:03.648588 6729 raft_consensus.cc:482] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.648777 6275 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.648739 6729 raft_consensus.cc:504] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.649444 6729 leader_election.cc:288] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:03.650108 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 381b12c993c74ba6ba78804c1f6c01e3 consensus state has no leader
I20260928 10:44:03.650413 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd9b4092b1242b8a60974c445a2789a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.651715 6269 ts_tablet_manager.cc:1918] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.651981 6269 log.cc:1196] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:03.654422 6275 tablet_bootstrap.cc:654] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.655805 6269 ts_tablet_manager.cc:1939] T 59bfe1f8050f47429ef80a19fdcd8198 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:03.644948 6271 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.650178 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd9b4092b1242b8a60974c445a2789a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.659101 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 97e20784940a4647a220ad74e3e15f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:03.652556 5817 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:03.661612 5818 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.662154 5818 leader_election.cc:302] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.662402 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 439) took 2103 ms. Trace:
I20260928 10:44:03.662634 6729 raft_consensus.cc:2726] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.662533 6269 rpcz_store.cc:276] 0928 10:44:01.559143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.559197 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:03.586061 (+2026864us) ts_tablet_manager.cc:1145] Deleting tablet 59bfe1f8050f47429ef80a19fdcd8198
0928 10:44:03.586072 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.606863 (+ 20791us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.651586 (+ 44723us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.662338 (+ 10752us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2025659}
I20260928 10:44:03.662899 6269 tablet_replica.cc:330] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:03.663038 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 59bfe1f8050f47429ef80a19fdcd8198 (table default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]) successfully deleted
I20260928 10:44:03.663089 6269 raft_consensus.cc:2229] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.663271 6269 raft_consensus.cc:2258] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.665238 6275 tablet_bootstrap.cc:492] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:03.665473 6275 ts_tablet_manager.cc:1397] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20260928 10:44:03.666316 6275 raft_consensus.cc:348] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.666663 6275 raft_consensus.cc:374] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.666800 6275 raft_consensus.cc:729] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.664836 6273 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.667097 6273 ts_tablet_manager.cc:1397] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.003s
I20260928 10:44:03.668809 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_80bfbf065e5b4c20b4ad9d675c9762f4" } modify_external_catalogs: true
I20260928 10:44:03.667887 6273 raft_consensus.cc:348] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.669054 6273 raft_consensus.cc:374] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.669044 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_80bfbf065e5b4c20b4ad9d675c9762f4" } modify_external_catalogs: true
I20260928 10:44:03.669145 6273 raft_consensus.cc:729] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.669387 6273 consensus_queue.cc:260] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.669974 6273 ts_tablet_manager.cc:1428] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:03.670540 6269 ts_tablet_manager.cc:1905] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.671077 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 3cb9c554d363441b8006abc2d9bdd856 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.671124 6275 consensus_queue.cc:260] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.671674 6275 ts_tablet_manager.cc:1428] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260928 10:44:03.670890 6273 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.679555 6273 tablet_bootstrap.cc:654] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.679879 6271 tablet_bootstrap.cc:654] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.688189 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9a013dca23c84607871b1ce448aeee78" } modify_external_catalogs: true
I20260928 10:44:03.688448 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9a013dca23c84607871b1ce448aeee78" } modify_external_catalogs: true
I20260928 10:44:03.689643 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ea33fe07f324842823f5f69dcbeec2b with delete_type TABLET_DATA_DELETED (replaced by tablet 1631d396362a4cffa1dec06d00894c63) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.693574 6272 ts_tablet_manager.cc:1918] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.703334 6272 log.cc:1196] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/10f6f7476c814e0a9abf56b23c1e547d
I20260928 10:44:03.703950 6272 ts_tablet_manager.cc:1939] T 10f6f7476c814e0a9abf56b23c1e547d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.706557 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_06e973961b9046a6898291edb23e85b4" } modify_external_catalogs: true
I20260928 10:44:03.706771 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_06e973961b9046a6898291edb23e85b4" } modify_external_catalogs: true
I20260928 10:44:03.694803 6275 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:03.708985 6275 tablet_bootstrap.cc:654] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.710014 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 10f6f7476c814e0a9abf56b23c1e547d (table default.Table_d567147d0d8c4ca4a12c66f2646477de [id=8780ec83a2e047bb8d762c1bc472e96e]) successfully deleted
I20260928 10:44:03.711429 6270 ts_tablet_manager.cc:1918] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.714160 6270 log.cc:1196] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/10f6f7476c814e0a9abf56b23c1e547d
I20260928 10:44:03.710691 6272 tablet_replica.cc:330] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.716956 6272 raft_consensus.cc:2229] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.717195 6272 raft_consensus.cc:2258] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.718313 6272 ts_tablet_manager.cc:1905] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.720799 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:03.721130 6273 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.721303 6273 ts_tablet_manager.cc:1397] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.001s
I20260928 10:44:03.722334 6273 raft_consensus.cc:348] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.722617 6273 raft_consensus.cc:374] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.722702 6273 raft_consensus.cc:729] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.723042 6273 consensus_queue.cc:260] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.723596 6273 ts_tablet_manager.cc:1428] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:03.725706 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 98bd99e7bdb647ceb9357f88affc45d9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:03.726784 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:03.728061 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.732594 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.733090 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b6d18cf0304edc8b3ca1d4d106decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.733808 5993 tablet_service.cc:1467] Processing CreateTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 (DEFAULT_TABLE table=default.Table_5f2ddf1361dc4fa8959ededb61aef4dd [id=a374ec10d29e4e51b02d545ca8e45325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.734242 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da28a9cb2f49639abc40b5208a96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.734283 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.737717 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 (DEFAULT_TABLE table=default.Table_b4cea29f67244120946fe29fe5b1e2f6 [id=16d1e20859d54f69a1014cd9049574bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.738174 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ac3eb76f74468a4811c5d642d53f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.738832 5996 tablet_service.cc:1467] Processing CreateTablet for tablet ad79320a73b04a18813fbf83fb738b2e (DEFAULT_TABLE table=default.Table_1c452474e96647c6a42ccc1dfd19d7db [id=00f4a47d4b814b7788e8aa3e686b46ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.738933 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 (DEFAULT_TABLE table=default.Table_a9e4a90e63964c2392953fa50a5ddb5a [id=3f910e3eda7a4a4293b45a4903f1822a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.739239 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad79320a73b04a18813fbf83fb738b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.739436 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aefce878fd0459c9c6502cfd226e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.740845 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.741252 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b6d18cf0304edc8b3ca1d4d106decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.742762 6118 tablet_service.cc:1467] Processing CreateTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 (DEFAULT_TABLE table=default.Table_5f2ddf1361dc4fa8959ededb61aef4dd [id=a374ec10d29e4e51b02d545ca8e45325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.743119 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da28a9cb2f49639abc40b5208a96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.743502 5854 tablet_service.cc:1467] Processing CreateTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 (DEFAULT_TABLE table=default.Table_5f2ddf1361dc4fa8959ededb61aef4dd [id=a374ec10d29e4e51b02d545ca8e45325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.744308 6001 tablet_service.cc:1467] Processing CreateTablet for tablet c2af1c83c4544bc68c67f7002742b2cd (DEFAULT_TABLE table=default.Table_56d98f59d24d4db58f8dc77f3c25918d [id=d3a9784181084b4c8109b093b62e0f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.746624 6135 tablet_service.cc:1467] Processing CreateTablet for tablet ad79320a73b04a18813fbf83fb738b2e (DEFAULT_TABLE table=default.Table_1c452474e96647c6a42ccc1dfd19d7db [id=00f4a47d4b814b7788e8aa3e686b46ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.746941 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 527e00f713214484bfc19ab96044a1be
I20260928 10:44:03.747008 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad79320a73b04a18813fbf83fb738b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.747237 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2af1c83c4544bc68c67f7002742b2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.748306 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 527e00f713214484bfc19ab96044a1be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.748680 5988 tablet_service.cc:1467] Processing CreateTablet for tablet bc5d744dbc904525858a39c27636443e (DEFAULT_TABLE table=default.Table_50ccb77506cf4484aa8e95d8ed6b216c [id=d9e947fc706b4680acadce9a64e0caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.749351 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5d744dbc904525858a39c27636443e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.750774 6123 tablet_service.cc:1467] Processing CreateTablet for tablet c2af1c83c4544bc68c67f7002742b2cd (DEFAULT_TABLE table=default.Table_56d98f59d24d4db58f8dc77f3c25918d [id=d3a9784181084b4c8109b093b62e0f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.751160 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2af1c83c4544bc68c67f7002742b2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.754436 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7083e30c5bf441738eb57535673b970d" } new_table_name: "default.Table_6450b311bb9142c4ab6babb8728fff9c" modify_external_catalogs: true
I20260928 10:44:03.754796 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 (DEFAULT_TABLE table=default.Table_b4cea29f67244120946fe29fe5b1e2f6 [id=16d1e20859d54f69a1014cd9049574bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.755609 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ac3eb76f74468a4811c5d642d53f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.758801 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 (DEFAULT_TABLE table=default.Table_a9e4a90e63964c2392953fa50a5ddb5a [id=3f910e3eda7a4a4293b45a4903f1822a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.759200 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aefce878fd0459c9c6502cfd226e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.759511 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 349d67ee0d3840ef813f241ac13968fe (DEFAULT_TABLE table=default.Table_b793fca06095448a80f39e6924ba7963 [id=7b233e0cf78f4485aa9dce900e775e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.759922 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 349d67ee0d3840ef813f241ac13968fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.762576 6122 tablet_service.cc:1467] Processing CreateTablet for tablet bc5d744dbc904525858a39c27636443e (DEFAULT_TABLE table=default.Table_50ccb77506cf4484aa8e95d8ed6b216c [id=d9e947fc706b4680acadce9a64e0caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.762935 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5d744dbc904525858a39c27636443e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.765421 6273 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.765641 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 (DEFAULT_TABLE table=default.Table_a9e4a90e63964c2392953fa50a5ddb5a [id=3f910e3eda7a4a4293b45a4903f1822a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.743502 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 (DEFAULT_TABLE table=default.Table_b4cea29f67244120946fe29fe5b1e2f6 [id=16d1e20859d54f69a1014cd9049574bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.769191 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 402378e09a1d43ea92f694fe24f9c544
I20260928 10:44:03.771124 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_74bddb88512b41eea5c0824f27398ea6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.771741 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74bddb88512b41eea5c0824f27398ea6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.773006 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5cfed112dcdb41b1ba08631bf2b58f32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.773461 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 527e00f713214484bfc19ab96044a1be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:03.773617 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cfed112dcdb41b1ba08631bf2b58f32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.774240 5991 tablet_service.cc:1467] Processing CreateTablet for tablet add5cbcbede9481494444371b44b5ab6 (DEFAULT_TABLE table=default.Table_9d87a6f28ce74fccb644babb0704ed0f [id=97e839da90124c499f45887cde116e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.774899 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_48080e9dfbf64580b869f48141af3593"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.775072 5846 tablet_service.cc:1467] Processing CreateTablet for tablet c2af1c83c4544bc68c67f7002742b2cd (DEFAULT_TABLE table=default.Table_56d98f59d24d4db58f8dc77f3c25918d [id=d3a9784181084b4c8109b093b62e0f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.775276 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_31d744c3757844c388bd3f29ac469dc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.775416 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48080e9dfbf64580b869f48141af3593 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.775445 5850 tablet_service.cc:1467] Processing CreateTablet for tablet ad79320a73b04a18813fbf83fb738b2e (DEFAULT_TABLE table=default.Table_1c452474e96647c6a42ccc1dfd19d7db [id=00f4a47d4b814b7788e8aa3e686b46ae]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:03.775739 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31d744c3757844c388bd3f29ac469dc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.776544 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b6d18cf0304edc8b3ca1d4d106decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.778420 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add5cbcbede9481494444371b44b5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.770907 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b6d141d94e74477ba22579aa9c058b06" } modify_external_catalogs: true
I20260928 10:44:03.778883 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b6d141d94e74477ba22579aa9c058b06" } modify_external_catalogs: true
I20260928 10:44:03.780313 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_781804886015445ca7413cdb7e25e9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.780978 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_781804886015445ca7413cdb7e25e9cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.781283 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2af1c83c4544bc68c67f7002742b2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.782572 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.782792 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.780900 5851 tablet_service.cc:1467] Processing CreateTablet for tablet bc5d744dbc904525858a39c27636443e (DEFAULT_TABLE table=default.Table_50ccb77506cf4484aa8e95d8ed6b216c [id=d9e947fc706b4680acadce9a64e0caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.783231 6737 raft_consensus.cc:482] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.783313 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 402378e09a1d43ea92f694fe24f9c544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.783435 6737 raft_consensus.cc:504] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.783748 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad79320a73b04a18813fbf83fb738b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.784061 6737 leader_election.cc:288] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.784466 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 349d67ee0d3840ef813f241ac13968fe (DEFAULT_TABLE table=default.Table_b793fca06095448a80f39e6924ba7963 [id=7b233e0cf78f4485aa9dce900e775e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.784684 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733ac3eb76f74468a4811c5d642d53f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.784830 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 349d67ee0d3840ef813f241ac13968fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.784866 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5d744dbc904525858a39c27636443e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.786079 6729 raft_consensus.cc:482] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.786219 6729 raft_consensus.cc:504] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.786617 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 527e00f713214484bfc19ab96044a1be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.786881 6729 leader_election.cc:288] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:03.787034 6136 tablet_service.cc:1467] Processing CreateTablet for tablet add5cbcbede9481494444371b44b5ab6 (DEFAULT_TABLE table=default.Table_9d87a6f28ce74fccb644babb0704ed0f [id=97e839da90124c499f45887cde116e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.787406 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add5cbcbede9481494444371b44b5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.787488 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.787967 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 39a851d2728a46c4ab2ad70399153361 (DEFAULT_TABLE table=default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.788128 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.788285 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39a851d2728a46c4ab2ad70399153361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.788326 6729 raft_consensus.cc:482] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.788723 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd (DEFAULT_TABLE table=default.Table_159c3cb36a0148e29f7d1be2eed024f7 [id=615201f29e7a4dd8adf8f9bb10383137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.789057 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e15b3cc46734ed5b8f0aef2f50025dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.788928 6729 raft_consensus.cc:504] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.789463 6729 leader_election.cc:288] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:03.789583 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aefce878fd0459c9c6502cfd226e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.790166 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 349d67ee0d3840ef813f241ac13968fe (DEFAULT_TABLE table=default.Table_b793fca06095448a80f39e6924ba7963 [id=7b233e0cf78f4485aa9dce900e775e71]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:03.790663 6090 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:03.791057 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da28a9cb2f49639abc40b5208a96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.791266 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5b422c70a84cc0bc9f8a686f4e2c82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:03.791414 5817 leader_election.cc:341] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.791947 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5b422c70a84cc0bc9f8a686f4e2c82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.792793 5817 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:03.795819 5818 leader_election.cc:341] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.796267 5818 leader_election.cc:302] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:03.796892 5818 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.797122 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 349d67ee0d3840ef813f241ac13968fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.798086 5818 leader_election.cc:302] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:03.799391 6091 leader_election.cc:341] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:03.799528 6091 leader_election.cc:302] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:03.799912 6737 raft_consensus.cc:2726] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.801321 6729 raft_consensus.cc:2726] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.802430 6732 raft_consensus.cc:2726] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.803368 6273 tablet_bootstrap.cc:654] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.803395 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 402378e09a1d43ea92f694fe24f9c544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.803488 6271 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.803653 6271 ts_tablet_manager.cc:1397] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.159s user 0.002s sys 0.003s
I20260928 10:44:03.804067 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 402378e09a1d43ea92f694fe24f9c544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.804389 6271 raft_consensus.cc:348] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.804603 6271 raft_consensus.cc:374] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.805200 6271 raft_consensus.cc:729] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.805467 6271 consensus_queue.cc:260] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.805553 6001 tablet_service.cc:1467] Processing CreateTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 (DEFAULT_TABLE table=default.Table_1a86ef60e78644ebb3a6b912b67ca670 [id=26edc4c50f524c10b444f56df298da5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.806087 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5abdd2484f41d7bd244db14d2b1916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.807255 5848 tablet_service.cc:1467] Processing CreateTablet for tablet add5cbcbede9481494444371b44b5ab6 (DEFAULT_TABLE table=default.Table_9d87a6f28ce74fccb644babb0704ed0f [id=97e839da90124c499f45887cde116e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.807641 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add5cbcbede9481494444371b44b5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.809551 6270 ts_tablet_manager.cc:1939] T 10f6f7476c814e0a9abf56b23c1e547d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.809986 6271 ts_tablet_manager.cc:1428] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 10:44:03.811879 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 1812d56c71da48a0ae6b966d8af05408 (DEFAULT_TABLE table=default.Table_ffae5213a5b24308b867a0c79f48d5cc [id=5edc2ef3e581489f8c6d180b66db3244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.812392 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1812d56c71da48a0ae6b966d8af05408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.815147 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd (DEFAULT_TABLE table=default.Table_159c3cb36a0148e29f7d1be2eed024f7 [id=615201f29e7a4dd8adf8f9bb10383137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.815850 5857 tablet_service.cc:1467] Processing CreateTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 (DEFAULT_TABLE table=default.Table_1a86ef60e78644ebb3a6b912b67ca670 [id=26edc4c50f524c10b444f56df298da5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.816269 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5abdd2484f41d7bd244db14d2b1916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.817701 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 39a851d2728a46c4ab2ad70399153361 (DEFAULT_TABLE table=default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.818013 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e15b3cc46734ed5b8f0aef2f50025dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.821091 5521 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu pid 5597
I20260928 10:44:03.822547 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39a851d2728a46c4ab2ad70399153361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.823671 6271 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.825335 6271 tablet_bootstrap.cc:654] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.826908 6270 tablet_replica.cc:330] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.827107 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 10f6f7476c814e0a9abf56b23c1e547d (table default.Table_d567147d0d8c4ca4a12c66f2646477de [id=8780ec83a2e047bb8d762c1bc472e96e]) successfully deleted
I20260928 10:44:03.829577 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cc2990e37a9648669eb39a865392c9e7
I20260928 10:44:03.831404 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e9e0bac650904b8f81474ba2dac9c04f
W20260928 10:44:03.831715 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 has no consensus state
I20260928 10:44:03.831858 5694 catalog_manager.cc:6565] ReplaceTablet: tablet e9e0bac650904b8f81474ba2dac9c04f deleted and replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e
I20260928 10:44:03.832253 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1298747f4eef4583b1c6b34e0e32dadc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.832885 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1298747f4eef4583b1c6b34e0e32dadc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.833453 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5f2ddf1361dc4fa8959ededb61aef4dd" } new_table_name: "default.Table_ccf056a194734a92b14d72e70df23bc0" modify_external_catalogs: true
I20260928 10:44:03.835166 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3cfd0d068acd44ee9c6d5c6966f0a1b3" } new_table_name: "default.Table_4ce39ee8f68841bfacf9e7c5617ac41c" modify_external_catalogs: true
I20260928 10:44:03.835340 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1812d56c71da48a0ae6b966d8af05408 (DEFAULT_TABLE table=default.Table_ffae5213a5b24308b867a0c79f48d5cc [id=5edc2ef3e581489f8c6d180b66db3244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.835722 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.836280 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.838425 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1812d56c71da48a0ae6b966d8af05408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.830587 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.833081 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e0bac650904b8f81474ba2dac9c04f with delete_type TABLET_DATA_DELETED (replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.833652 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.840669 6270 raft_consensus.cc:2229] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.841593 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 60b55bf4bd3f45a99429c0a6e97f63f6
I20260928 10:44:03.842005 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 (DEFAULT_TABLE table=default.Table_80bfbf065e5b4c20b4ad9d675c9762f4 [id=f56901ab05054f9fb569599da2b427fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.844449 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60b55bf4bd3f45a99429c0a6e97f63f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.843269 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.848016 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 39a851d2728a46c4ab2ad70399153361 (DEFAULT_TABLE table=default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.848489 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39a851d2728a46c4ab2ad70399153361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.849036 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e0bac650904b8f81474ba2dac9c04f with delete_type TABLET_DATA_DELETED (replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.850126 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_28ea586599a94b6a86535e4d617de2be" } new_table_name: "default.Table_e167692a9b0c4332a3095e2bc5ed1e0d" modify_external_catalogs: true
I20260928 10:44:03.850198 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.850335 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 (DEFAULT_TABLE table=default.Table_80bfbf065e5b4c20b4ad9d675c9762f4 [id=f56901ab05054f9fb569599da2b427fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.850231 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.850847 6270 raft_consensus.cc:2258] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.851759 6270 ts_tablet_manager.cc:1905] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.851804 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60b55bf4bd3f45a99429c0a6e97f63f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.852538 6132 tablet_service.cc:1467] Processing CreateTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 (DEFAULT_TABLE table=default.Table_1a86ef60e78644ebb3a6b912b67ca670 [id=26edc4c50f524c10b444f56df298da5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.851810 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd (DEFAULT_TABLE table=default.Table_159c3cb36a0148e29f7d1be2eed024f7 [id=615201f29e7a4dd8adf8f9bb10383137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.854393 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e15b3cc46734ed5b8f0aef2f50025dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.854522 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9de49f9ac8fb408e925afecc2ca2c293" } new_table_name: "default.Table_1e522b8f8f72427880d3623ce9b7377b" modify_external_catalogs: true
I20260928 10:44:03.857739 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e0bac650904b8f81474ba2dac9c04f with delete_type TABLET_DATA_DELETED (replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.857951 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.858078 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.858798 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 1812d56c71da48a0ae6b966d8af05408 (DEFAULT_TABLE table=default.Table_ffae5213a5b24308b867a0c79f48d5cc [id=5edc2ef3e581489f8c6d180b66db3244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.859277 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.859681 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 (DEFAULT_TABLE table=default.Table_80bfbf065e5b4c20b4ad9d675c9762f4 [id=f56901ab05054f9fb569599da2b427fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.875885 6271 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:03.876113 6271 ts_tablet_manager.cc:1397] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.002s
I20260928 10:44:03.876937 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3abfedf425b84f679b22d6ca9bef718a
I20260928 10:44:03.876936 6271 raft_consensus.cc:348] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.877842 6271 raft_consensus.cc:374] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.877944 6271 raft_consensus.cc:729] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.878237 6271 consensus_queue.cc:260] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.883440 6271 ts_tablet_manager.cc:1428] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 10:44:03.883632 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a4f5d81e2b44bada43c4c23bfc5c1b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:03.884264 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a4f5d81e2b44bada43c4c23bfc5c1b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.885347 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.886615 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5da28a9cb2f49639abc40b5208a96b7 consensus state has no leader
I20260928 10:44:03.889369 6269 ts_tablet_manager.cc:1918] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.890100 6271 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:03.891525 6269 log.cc:1196] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:03.892478 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2100a4c39c3e4e9ab2b821068dd02ab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.893040 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:03.893671 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2100a4c39c3e4e9ab2b821068dd02ab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.896078 6271 tablet_bootstrap.cc:654] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.899648 6270 ts_tablet_manager.cc:1918] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.899827 6270 log.cc:1196] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/99202cf0cfac40b2aa54b10b4d96939d
I20260928 10:44:03.895754 5883 raft_consensus.cc:1261] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:03.896160 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.903343 6731 raft_consensus.cc:482] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.903506 6731 raft_consensus.cc:504] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:03.905328 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29f07262a710456ea0837dc5af3eaebb has no consensus state
I20260928 10:44:03.908066 6731 leader_election.cc:288] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:03.908268 6731 consensus_queue.cc:1035] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:03.908367 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_710fd0784d404c9a85b86b0251b64b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:03.908718 6270 ts_tablet_manager.cc:1939] T 99202cf0cfac40b2aa54b10b4d96939d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.909936 6270 tablet_replica.cc:330] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.910246 6270 raft_consensus.cc:2229] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.911263 6270 raft_consensus.cc:2258] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.911936 6270 ts_tablet_manager.cc:1905] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:03.915115 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_710fd0784d404c9a85b86b0251b64b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:03.916422 6155 raft_consensus.cc:1261] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:03.917234 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 99202cf0cfac40b2aa54b10b4d96939d (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
W20260928 10:44:03.920099 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34e41838d44e400f9934ea40a198e606 has no consensus state
I20260928 10:44:03.921792 6272 ts_tablet_manager.cc:1918] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:03.922044 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f697a2ecde3d4d0e83dc74917c90cfd7 has no consensus state
I20260928 10:44:03.922379 6272 log.cc:1196] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/97e20784940a4647a220ad74e3e15f83
I20260928 10:44:03.922555 6732 raft_consensus.cc:482] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.922744 6732 raft_consensus.cc:504] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:03.922150 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971f8344436f4e60ac0152e811efea8d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.923364 5955 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.923429 6272 ts_tablet_manager.cc:1939] T 97e20784940a4647a220ad74e3e15f83 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:03.923925 6732 leader_election.cc:288] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:03.925331 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:03.925678 6792 consensus_queue.cc:1035] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:03.926124 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:03.926694 5817 leader_election.cc:341] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.926883 6272 tablet_replica.cc:330] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:03.927150 6269 ts_tablet_manager.cc:1939] T 48ccd7551f6a4fc8b41e70e94749e6f1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:44:03.928942 5957 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 971f8344436f4e60ac0152e811efea8d
W20260928 10:44:03.929569 5818 leader_election.cc:341] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.929719 5818 leader_election.cc:302] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:03.931253 6729 raft_consensus.cc:2726] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.931811 5957 leader_election.cc:302] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:03.932435 6792 raft_consensus.cc:2726] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.935907 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 440) took 2321 ms. Trace:
I20260928 10:44:03.936702 6269 rpcz_store.cc:276] 0928 10:44:01.614742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.614808 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:03.662798 (+2047990us) ts_tablet_manager.cc:1145] Deleting tablet 48ccd7551f6a4fc8b41e70e94749e6f1
0928 10:44:03.662822 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.700945 (+ 38123us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.863292 (+162347us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:03.935865 (+ 72573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047731}
I20260928 10:44:03.937513 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 441) took 2262 ms. Trace:
I20260928 10:44:03.938148 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (table default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]) successfully deleted
I20260928 10:44:03.939127 6273 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:03.939335 6273 ts_tablet_manager.cc:1397] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.215s user 0.003s sys 0.001s
I20260928 10:44:03.939486 6270 ts_tablet_manager.cc:1918] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:03.940106 6272 raft_consensus.cc:2229] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.940405 6272 raft_consensus.cc:2258] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.940268 6273 raft_consensus.cc:348] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.940517 6273 raft_consensus.cc:374] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:03.940618 6273 raft_consensus.cc:729] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:03.940912 6273 consensus_queue.cc:260] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.941488 6273 ts_tablet_manager.cc:1428] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:03.941803 6273 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:03.938392 6269 rpcz_store.cc:276] 0928 10:44:01.674939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.675152 (+ 213us) service_pool.cc:227] Handling call
0928 10:44:03.937344 (+2262192us) ts_tablet_manager.cc:1145] Deleting tablet 490f8a4f1f9245cfab168b96511e18de
0928 10:44:03.937360 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.937480 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261959}
I20260928 10:44:03.945068 6270 log.cc:1196] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/0563f8c31f7d43b3b703593dbc562ad6
W20260928 10:44:03.945200 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 490f8a4f1f9245cfab168b96511e18de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 490f8a4f1f9245cfab168b96511e18de already in progress: creating tablet
I20260928 10:44:03.946215 6270 ts_tablet_manager.cc:1939] T 0563f8c31f7d43b3b703593dbc562ad6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:03.946452 6272 ts_tablet_manager.cc:1905] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.947968 6793 raft_consensus.cc:482] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:03.948200 6793 raft_consensus.cc:504] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:03.949072 6793 leader_election.cc:288] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:03.949292 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 442) took 2274 ms. Trace:
I20260928 10:44:03.949503 6269 rpcz_store.cc:276] 0928 10:44:01.675103 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.675430 (+ 327us) service_pool.cc:227] Handling call
0928 10:44:03.949097 (+2273667us) ts_tablet_manager.cc:1145] Deleting tablet 4a9fb31988e4447f9c4a694056d6e54f
0928 10:44:03.949111 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.949243 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2273490}
I20260928 10:44:03.949671 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 0563f8c31f7d43b3b703593dbc562ad6 (table default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]) successfully deleted
I20260928 10:44:03.950229 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d820b51d65fe47c8a8636d537671a0a2" } modify_external_catalogs: true
W20260928 10:44:03.950279 5957 leader_election.cc:341] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: ab1277e4c47141ea9480987eef715528
I20260928 10:44:03.950430 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d820b51d65fe47c8a8636d537671a0a2" } modify_external_catalogs: true
W20260928 10:44:03.950599 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4a9fb31988e4447f9c4a694056d6e54f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a9fb31988e4447f9c4a694056d6e54f already in progress: creating tablet
I20260928 10:44:03.950721 6001 tablet_service.cc:1467] Processing CreateTablet for tablet a0de9e5daf1c46889988bd66f01f11be (DEFAULT_TABLE table=default.Table_093d6eb485344036802223ce544f483a [id=6f5847b912024fa0884625fc673104a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.951180 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0de9e5daf1c46889988bd66f01f11be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.951725 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 443) took 2248 ms. Trace:
I20260928 10:44:03.951850 6269 rpcz_store.cc:276] 0928 10:44:01.703033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:01.703255 (+ 222us) service_pool.cc:227] Handling call
0928 10:44:03.949989 (+2246734us) ts_tablet_manager.cc:1145] Deleting tablet 503a4bcb9d37441aadf66b45238a3737
0928 10:44:03.950000 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.951687 (+ 1687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2246463}
I20260928 10:44:03.952364 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 463) took 1902 ms. Trace:
W20260928 10:44:03.952479 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 503a4bcb9d37441aadf66b45238a3737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503a4bcb9d37441aadf66b45238a3737 already in progress: creating tablet
I20260928 10:44:03.952466 6269 rpcz_store.cc:276] 0928 10:44:02.050279 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.050359 (+ 80us) service_pool.cc:227] Handling call
0928 10:44:03.952222 (+1901863us) ts_tablet_manager.cc:1145] Deleting tablet 877e2d1c734a4e2891119f308f9f3ae8
0928 10:44:03.952232 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.952337 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1831481}
W20260928 10:44:03.952785 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 877e2d1c734a4e2891119f308f9f3ae8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 877e2d1c734a4e2891119f308f9f3ae8 already in progress: creating tablet
I20260928 10:44:03.947366 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:03.950196 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab1277e4c47141ea9480987eef715528" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:03.953022 6273 tablet_bootstrap.cc:654] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:03.953872 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 465) took 1831 ms. Trace:
I20260928 10:44:03.953979 6269 rpcz_store.cc:276] 0928 10:44:02.122312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.122369 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:03.953754 (+1831385us) ts_tablet_manager.cc:1145] Deleting tablet 1f3d2c79118e44bca3540d3e3ff524a6
0928 10:44:03.953764 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:03.953843 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588632}
W20260928 10:44:03.954101 5955 leader_election.cc:341] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:03.954242 5955 leader_election.cc:302] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:03.954671 6793 raft_consensus.cc:2726] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:03.954856 6269 tablet_replica.cc:330] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:03.955168 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1f3d2c79118e44bca3540d3e3ff524a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3d2c79118e44bca3540d3e3ff524a6 already in progress: creating tablet
I20260928 10:44:03.956005 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5abdd2484f41d7bd244db14d2b1916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.956529 6269 raft_consensus.cc:2229] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.956894 6269 raft_consensus.cc:2258] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.957548 6269 ts_tablet_manager.cc:1905] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.961807 5858 tablet_service.cc:1467] Processing CreateTablet for tablet a0de9e5daf1c46889988bd66f01f11be (DEFAULT_TABLE table=default.Table_093d6eb485344036802223ce544f483a [id=6f5847b912024fa0884625fc673104a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.962742 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 29f07262a710456ea0837dc5af3eaebb (DEFAULT_TABLE table=default.Table_4ce39ee8f68841bfacf9e7c5617ac41c [id=f7f72aaf771e45908d676c0febbac942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.962960 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0de9e5daf1c46889988bd66f01f11be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.963181 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f07262a710456ea0837dc5af3eaebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.963248 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60b55bf4bd3f45a99429c0a6e97f63f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.966689 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1812d56c71da48a0ae6b966d8af05408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.968093 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d
I20260928 10:44:03.968943 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:03.971611 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db5f2736588a497ca53d21f0deb71ae2" } modify_external_catalogs: true
I20260928 10:44:03.971961 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db5f2736588a497ca53d21f0deb71ae2" } modify_external_catalogs: true
I20260928 10:44:03.973624 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.975853 6270 tablet_replica.cc:330] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:03.976085 6270 raft_consensus.cc:2229] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:03.977632 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e6bd816447ad4a58b679f83b8acbb4b5
I20260928 10:44:03.978847 6270 raft_consensus.cc:2258] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:03.979332 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:03.979849 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 29f07262a710456ea0837dc5af3eaebb (DEFAULT_TABLE table=default.Table_4ce39ee8f68841bfacf9e7c5617ac41c [id=f7f72aaf771e45908d676c0febbac942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.980268 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f07262a710456ea0837dc5af3eaebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.981076 6270 ts_tablet_manager.cc:1905] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:03.981191 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 7db49404752e4501a594608fc325ebe9 (DEFAULT_TABLE table=default.Table_538716398c7244d295dc35a0876d202b [id=8530ec612d2a46659ac23fd09a728c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.981562 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db49404752e4501a594608fc325ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.986048 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 34e41838d44e400f9934ea40a198e606 (DEFAULT_TABLE table=default.Table_1e522b8f8f72427880d3623ce9b7377b [id=01034df7fac448e4a7aa22f0ff00698c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.986433 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e41838d44e400f9934ea40a198e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.990792 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 734c09c7645c4dd3a05f6508297ee48b (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.991165 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c09c7645c4dd3a05f6508297ee48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.995189 5860 tablet_service.cc:1467] Processing CreateTablet for tablet f0522f74d3274c04a66fb3f5b92dbf5e (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.995615 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 7e507243b81242b096f2fa8b69e45ae3 (DEFAULT_TABLE table=default.Table_e2765a3c31e249c5ae04b511e48c2d3f [id=82487374199a4acdaf8b5ca538ca1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.996352 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e507243b81242b096f2fa8b69e45ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.996538 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0522f74d3274c04a66fb3f5b92dbf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.997658 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 51df1f1107e14996bb1b4787819de64f (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:03.998023 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51df1f1107e14996bb1b4787819de64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:03.999905 6123 tablet_service.cc:1467] Processing CreateTablet for tablet a0de9e5daf1c46889988bd66f01f11be (DEFAULT_TABLE table=default.Table_093d6eb485344036802223ce544f483a [id=6f5847b912024fa0884625fc673104a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.000530 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0de9e5daf1c46889988bd66f01f11be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.002542 5855 tablet_service.cc:1467] Processing CreateTablet for tablet e8e3d92709bb4893973e5d24736bafcf (DEFAULT_TABLE table=default.Table_767ffc9c94824b23bb8020515c96aa8a [id=20554e4232774ce7bac92c4ea1b10f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.003768 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e3d92709bb4893973e5d24736bafcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.004388 5846 tablet_service.cc:1467] Processing CreateTablet for tablet f697a2ecde3d4d0e83dc74917c90cfd7 (DEFAULT_TABLE table=default.Table_e167692a9b0c4332a3095e2bc5ed1e0d [id=a664f3fc6e1449e0951a3a3d794181ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.004540 5856 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 (DEFAULT_TABLE table=default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.004802 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f697a2ecde3d4d0e83dc74917c90cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.005010 5862 tablet_service.cc:1467] Processing CreateTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 (DEFAULT_TABLE table=default.Table_6450b311bb9142c4ab6babb8728fff9c [id=6507332f841842fc86b69093136791e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.007706 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 29f07262a710456ea0837dc5af3eaebb (DEFAULT_TABLE table=default.Table_4ce39ee8f68841bfacf9e7c5617ac41c [id=f7f72aaf771e45908d676c0febbac942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.008320 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f07262a710456ea0837dc5af3eaebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.007491 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 7db49404752e4501a594608fc325ebe9 (DEFAULT_TABLE table=default.Table_538716398c7244d295dc35a0876d202b [id=8530ec612d2a46659ac23fd09a728c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.009253 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 7e507243b81242b096f2fa8b69e45ae3 (DEFAULT_TABLE table=default.Table_e2765a3c31e249c5ae04b511e48c2d3f [id=82487374199a4acdaf8b5ca538ca1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.009524 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db49404752e4501a594608fc325ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.009760 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e507243b81242b096f2fa8b69e45ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.008715 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 734c09c7645c4dd3a05f6508297ee48b (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.014705 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c09c7645c4dd3a05f6508297ee48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.017498 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 2db50601fa874f219d1c093a86f080c1 (DEFAULT_TABLE table=default.Table_74bddb88512b41eea5c0824f27398ea6 [id=3543bf8859234d87b856c2aff0b7d1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.018128 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.008972 6002 tablet_service.cc:1467] Processing CreateTablet for tablet f0522f74d3274c04a66fb3f5b92dbf5e (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.018863 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.019193 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0522f74d3274c04a66fb3f5b92dbf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.019562 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 (DEFAULT_TABLE table=default.Table_d028317843a24ae18ce20c6d26017c92 [id=d37f13067e4a43eab9b52b68e3643f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.020200 6001 tablet_service.cc:1467] Processing CreateTablet for tablet e8e3d92709bb4893973e5d24736bafcf (DEFAULT_TABLE table=default.Table_767ffc9c94824b23bb8020515c96aa8a [id=20554e4232774ce7bac92c4ea1b10f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.020980 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e3d92709bb4893973e5d24736bafcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.023298 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 0807f08b697a408dae06f000f759e09a (DEFAULT_TABLE table=default.Table_5cfed112dcdb41b1ba08631bf2b58f32 [id=11bd8305125d471598ff6bcf338e1617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.023837 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd816447ad4a58b679f83b8acbb4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.024587 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.028694 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 34e41838d44e400f9934ea40a198e606 (DEFAULT_TABLE table=default.Table_1e522b8f8f72427880d3623ce9b7377b [id=01034df7fac448e4a7aa22f0ff00698c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.028882 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a94c95e55fa46d2a8badd9229f55cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.029292 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e41838d44e400f9934ea40a198e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.029398 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0807f08b697a408dae06f000f759e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.008091 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 34e41838d44e400f9934ea40a198e606 (DEFAULT_TABLE table=default.Table_1e522b8f8f72427880d3623ce9b7377b [id=01034df7fac448e4a7aa22f0ff00698c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.030685 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db50601fa874f219d1c093a86f080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.031230 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e41838d44e400f9934ea40a198e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.032922 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 97e20784940a4647a220ad74e3e15f83 (table default.Table_e7636309bdaf45918561f2d8b59f434b [id=8b32c2ee928541488ef106f41ed8bd44]) successfully deleted
I20260928 10:44:04.033242 5996 tablet_service.cc:1467] Processing CreateTablet for tablet f697a2ecde3d4d0e83dc74917c90cfd7 (DEFAULT_TABLE table=default.Table_e167692a9b0c4332a3095e2bc5ed1e0d [id=a664f3fc6e1449e0951a3a3d794181ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.033932 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a390c5e5221f4bbba5c21311860ca5f1" } new_table_name: "default.Table_9d4a7be11896409ebc4138bc454bc2bb" modify_external_catalogs: true
I20260928 10:44:04.034842 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f697a2ecde3d4d0e83dc74917c90cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.040031 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a3854865c7e0490f88fbda7f4b110018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.040644 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3854865c7e0490f88fbda7f4b110018 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.039635 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2df45c20e4924018a625dfdac71f1560"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.041850 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2df45c20e4924018a625dfdac71f1560 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.043843 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9420102eb4994caea7a11294bebbebd0" } modify_external_catalogs: true
I20260928 10:44:04.046089 6131 tablet_service.cc:1467] Processing CreateTablet for tablet f697a2ecde3d4d0e83dc74917c90cfd7 (DEFAULT_TABLE table=default.Table_e167692a9b0c4332a3095e2bc5ed1e0d [id=a664f3fc6e1449e0951a3a3d794181ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.047048 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 51df1f1107e14996bb1b4787819de64f (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.047545 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 51df1f1107e14996bb1b4787819de64f (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.047616 6129 tablet_service.cc:1467] Processing CreateTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 (DEFAULT_TABLE table=default.Table_6450b311bb9142c4ab6babb8728fff9c [id=6507332f841842fc86b69093136791e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.047955 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51df1f1107e14996bb1b4787819de64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.048060 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 2db50601fa874f219d1c093a86f080c1 (DEFAULT_TABLE table=default.Table_74bddb88512b41eea5c0824f27398ea6 [id=3543bf8859234d87b856c2aff0b7d1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.049719 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 0807f08b697a408dae06f000f759e09a (DEFAULT_TABLE table=default.Table_5cfed112dcdb41b1ba08631bf2b58f32 [id=11bd8305125d471598ff6bcf338e1617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.050256 6120 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 (DEFAULT_TABLE table=default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.050657 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f697a2ecde3d4d0e83dc74917c90cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.051903 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0807f08b697a408dae06f000f759e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.052539 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd816447ad4a58b679f83b8acbb4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.053911 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.057128 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 (DEFAULT_TABLE table=default.Table_d028317843a24ae18ce20c6d26017c92 [id=d37f13067e4a43eab9b52b68e3643f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.057729 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51df1f1107e14996bb1b4787819de64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.059064 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 7e507243b81242b096f2fa8b69e45ae3 (DEFAULT_TABLE table=default.Table_e2765a3c31e249c5ae04b511e48c2d3f [id=82487374199a4acdaf8b5ca538ca1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.059880 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e14d183b3e9c4c16887eb2264760edde" } modify_external_catalogs: true
I20260928 10:44:04.062723 5991 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd816447ad4a58b679f83b8acbb4b5 (DEFAULT_TABLE table=default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.062885 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 2db50601fa874f219d1c093a86f080c1 (DEFAULT_TABLE table=default.Table_74bddb88512b41eea5c0824f27398ea6 [id=3543bf8859234d87b856c2aff0b7d1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.063179 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd816447ad4a58b679f83b8acbb4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.063361 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db50601fa874f219d1c093a86f080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.066606 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db50601fa874f219d1c093a86f080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.070091 5985 tablet_service.cc:1467] Processing CreateTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 (DEFAULT_TABLE table=default.Table_6450b311bb9142c4ab6babb8728fff9c [id=6507332f841842fc86b69093136791e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.070333 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 0807f08b697a408dae06f000f759e09a (DEFAULT_TABLE table=default.Table_5cfed112dcdb41b1ba08631bf2b58f32 [id=11bd8305125d471598ff6bcf338e1617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.070575 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.070791 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0807f08b697a408dae06f000f759e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.071137 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 (DEFAULT_TABLE table=default.Table_d028317843a24ae18ce20c6d26017c92 [id=d37f13067e4a43eab9b52b68e3643f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.071509 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a94c95e55fa46d2a8badd9229f55cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.075537 6133 tablet_service.cc:1467] Processing CreateTablet for tablet e8e3d92709bb4893973e5d24736bafcf (DEFAULT_TABLE table=default.Table_767ffc9c94824b23bb8020515c96aa8a [id=20554e4232774ce7bac92c4ea1b10f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.075870 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a94c95e55fa46d2a8badd9229f55cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.068769 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 734c09c7645c4dd3a05f6508297ee48b (DEFAULT_TABLE table=default.Table_c05f29ca725a46b4bef695b530735cf1 [id=0b3c708d5c17469e8d9c6c508b65c6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.004979 6270 ts_tablet_manager.cc:1918] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.078514 6270 log.cc:1196] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/ab1277e4c47141ea9480987eef715528
I20260928 10:44:04.078928 6270 ts_tablet_manager.cc:1939] T ab1277e4c47141ea9480987eef715528 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:04.082399 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9420102eb4994caea7a11294bebbebd0" } modify_external_catalogs: true
I20260928 10:44:04.083950 6118 tablet_service.cc:1467] Processing CreateTablet for tablet f0522f74d3274c04a66fb3f5b92dbf5e (DEFAULT_TABLE table=default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.084741 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ec07c562189f47a280a2e75408d42ff5" } modify_external_catalogs: true
I20260928 10:44:04.084944 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ec07c562189f47a280a2e75408d42ff5" } modify_external_catalogs: true
I20260928 10:44:04.085780 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9bb4d80669c64a3383a666362405452e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.086305 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bb4d80669c64a3383a666362405452e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.086218 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_37f97bd00db641b9963a47334e13ae68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.086723 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37f97bd00db641b9963a47334e13ae68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.087766 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a4f15424f73f4b85b5a6ae0453b232af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.088168 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4f15424f73f4b85b5a6ae0453b232af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.089339 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ed22e348552243ee9081c6889957158c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.089847 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed22e348552243ee9081c6889957158c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.090584 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e14d183b3e9c4c16887eb2264760edde" } modify_external_catalogs: true
I20260928 10:44:04.093183 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e507243b81242b096f2fa8b69e45ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.093938 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 734c09c7645c4dd3a05f6508297ee48b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.094496 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 consensus state has no leader
I20260928 10:44:04.094852 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a8e76b8804da448caf6371b096913891" } new_table_name: "default.Table_a4e91262b8494ef28c172b832589e2c1" modify_external_catalogs: true
I20260928 10:44:04.095448 6793 raft_consensus.cc:482] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.095610 6793 raft_consensus.cc:504] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.096356 6793 leader_election.cc:288] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.098299 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0522f74d3274c04a66fb3f5b92dbf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.100451 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e3d92709bb4893973e5d24736bafcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.106032 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 45a8098440fb4e919bc5e3f4dd3241a7
I20260928 10:44:04.106980 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1a4ef15990d04df2b9e997c08557de9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.107990 5957 leader_election.cc:341] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e40f72ff466e4befb74290fd39285119
W20260928 10:44:04.108568 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a4ef15990d04df2b9e997c08557de9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.108510 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1a6ada6f154c48509e5e70d57c95377c" } new_table_name: "default.Table_f5d854333f804a1485adb1be6a28e11a" modify_external_catalogs: true
I20260928 10:44:04.109385 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 493b1d0e0b884fdfbaa3eb6d55874f2e
I20260928 10:44:04.111696 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.112027 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.120551 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e40f72ff466e4befb74290fd39285119" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.121605 5955 leader_election.cc:341] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.121799 5955 leader_election.cc:302] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.122677 6793 raft_consensus.cc:2726] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.124203 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2f828f5ec19e4fe48fcc0313452241cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.125079 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f828f5ec19e4fe48fcc0313452241cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:04.125600 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d39e1e4d18d6450580e28614ae4c2895 consensus state has no leader
I20260928 10:44:04.126435 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b12c9e0066374ae3a437cd0ebdb3efb0" } new_table_name: "default.Table_45fb73a0f9e1445c8e355b4dad0839df" modify_external_catalogs: true
I20260928 10:44:04.126879 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d8589e4891fc44778c83c70292d08586" } new_table_name: "default.Table_c3a7ffcfabd046f48449d8826b03ad9e" modify_external_catalogs: true
I20260928 10:44:04.130646 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2c683445c12e43cc9379bf465f7e252c
I20260928 10:44:04.131410 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_44112cae47364bd28529eb31c38016db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.132035 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44112cae47364bd28529eb31c38016db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.133127 6732 raft_consensus.cc:482] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.133320 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_82450110c71748558bf2346d11abac19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.133849 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82450110c71748558bf2346d11abac19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.136286 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 23d4da5ccb214a4bbc543c67529b59cf from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:04.136355 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c683445c12e43cc9379bf465f7e252c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.159329 6271 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.159526 6271 ts_tablet_manager.cc:1397] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.270s user 0.019s sys 0.015s
I20260928 10:44:04.160342 6271 raft_consensus.cc:348] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.160593 6271 raft_consensus.cc:374] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.160686 6271 raft_consensus.cc:729] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.160974 6271 consensus_queue.cc:260] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.164889 6271 ts_tablet_manager.cc:1428] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:04.168895 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.170059 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.170578 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9d4a7be11896409ebc4138bc454bc2bb" } modify_external_catalogs: true
I20260928 10:44:04.171164 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9d4a7be11896409ebc4138bc454bc2bb" } modify_external_catalogs: true
I20260928 10:44:04.177534 6732 raft_consensus.cc:504] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.180192 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6cf56fe048a6439b8252398f6bb6e503" } modify_external_catalogs: true
I20260928 10:44:04.180430 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6cf56fe048a6439b8252398f6bb6e503" } modify_external_catalogs: true
I20260928 10:44:04.182677 6732 leader_election.cc:288] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:04.183930 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97401498df144cc689066ea3033d68ef" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:04.185665 5818 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.184521 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c683445c12e43cc9379bf465f7e252c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.190006 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:04.196727 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee0b7f3bd78a49368abc13ab9e171880 consensus state has no leader
W20260928 10:44:04.207715 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e03f686afffc4d47b5e27fdbc8eb8f75 consensus state has no leader
W20260928 10:44:04.209013 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6c48b8a7efa41a684205df3e6969370 consensus state has no leader
I20260928 10:44:04.215343 5990 tablet_service.cc:1467] Processing CreateTablet for tablet e875c832cfc343069c901a3f7c3e4ff0 (DEFAULT_TABLE table=default.Table_710fd0784d404c9a85b86b0251b64b8c [id=948b339823894fed98df36503eab2875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.215879 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e875c832cfc343069c901a3f7c3e4ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.218842 5984 tablet_service.cc:1467] Processing CreateTablet for tablet ba28bafb8dea49f6a477927aea223e1d (DEFAULT_TABLE table=default.Table_2100a4c39c3e4e9ab2b821068dd02ab5 [id=8cf33e75f9b24ce58e037e0aa5f352b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.219334 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba28bafb8dea49f6a477927aea223e1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.223078 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 97335us
I20260928 10:44:04.224028 5661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260928 10:44:04.224483 6270 tablet_replica.cc:330] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:04.224676 6270 raft_consensus.cc:2229] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.224844 6270 raft_consensus.cc:2258] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.225400 6270 ts_tablet_manager.cc:1905] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:04.227662 6271 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.229578 6271 tablet_bootstrap.cc:654] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.232239 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 32ee2c610dc9414caadb779df0259b36 (DEFAULT_TABLE table=default.Table_8a4f5d81e2b44bada43c4c23bfc5c1b3 [id=4e23d82da1a9444882ff60cd6d87327f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.232336 5995 tablet_service.cc:1467] Processing CreateTablet for tablet bbfcdf8895ce49809a8911c819a057e7 (DEFAULT_TABLE table=default.Table_31d744c3757844c388bd3f29ac469dc7 [id=a066ac9eb350431e825af944ecdfc50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.232829 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32ee2c610dc9414caadb779df0259b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.233136 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbfcdf8895ce49809a8911c819a057e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.233508 5994 tablet_service.cc:1467] Processing CreateTablet for tablet d42e218538814686a6c8308b1bc43949 (DEFAULT_TABLE table=default.Table_781804886015445ca7413cdb7e25e9cd [id=fefc489a322a420888016fb65fe50b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.233929 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42e218538814686a6c8308b1bc43949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.239018 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 6216f539f2e940c9b18befaa86c8b046 (DEFAULT_TABLE table=default.Table_48080e9dfbf64580b869f48141af3593 [id=e859ee33b958415eae8e096551a90e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.239643 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6216f539f2e940c9b18befaa86c8b046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.242936 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 9995278ffb164f31aa119f6d392c8814 (DEFAULT_TABLE table=default.Table_1298747f4eef4583b1c6b34e0e32dadc [id=cedef4d82204473bb84e03e467702063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.243396 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9995278ffb164f31aa119f6d392c8814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.246809 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet c1a659100a124506a411c929ddc31f10 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:04.246942 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 861bf895ac104cf79fe49a22ef9253b3 (DEFAULT_TABLE table=default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a [id=c75d3b905f5342f2a81419f7ba28d69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.247382 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861bf895ac104cf79fe49a22ef9253b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.251623 6273 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.253860 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 79d1021f0b844a348e3fbed913758650
I20260928 10:44:04.258949 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d1021f0b844a348e3fbed913758650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.262552 6732 raft_consensus.cc:482] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.262758 6732 raft_consensus.cc:504] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.263573 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c1a659100a124506a411c929ddc31f10
I20260928 10:44:04.264000 5693 catalog_manager.cc:6565] ReplaceTablet: tablet c1a659100a124506a411c929ddc31f10 deleted and replaced by tablet b4bea8f5535c4833bdbb841d42706b78
I20260928 10:44:04.264420 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2635c7c47ba4383b6b0f07cd3b42f74" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.272629 6270 ts_tablet_manager.cc:1918] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.272862 6270 log.cc:1196] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/971f8344436f4e60ac0152e811efea8d
I20260928 10:44:04.275404 6271 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.275605 6271 ts_tablet_manager.cc:1397] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260928 10:44:04.276474 6271 raft_consensus.cc:348] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.276769 6271 raft_consensus.cc:374] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.276845 6271 raft_consensus.cc:729] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.277118 6271 consensus_queue.cc:260] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.277801 6271 ts_tablet_manager.cc:1428] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260928 10:44:04.278891 6271 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.280440 6271 tablet_bootstrap.cc:654] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:04.285111 5818 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.286774 6732 leader_election.cc:288] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:04.286834 6271 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.286967 6271 ts_tablet_manager.cc:1397] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:44:04.288383 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 861bf895ac104cf79fe49a22ef9253b3 (DEFAULT_TABLE table=default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a [id=c75d3b905f5342f2a81419f7ba28d69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.289690 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861bf895ac104cf79fe49a22ef9253b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.289901 6271 raft_consensus.cc:348] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.290130 6271 raft_consensus.cc:374] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.290225 6271 raft_consensus.cc:729] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.290793 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 14184ece25b647f3a2de5990b211eebb (DEFAULT_TABLE table=default.Table_9bb4d80669c64a3383a666362405452e [id=a30d91baf0364d41bffbbb115f98cf21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.291184 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14184ece25b647f3a2de5990b211eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.294767 5992 tablet_service.cc:1467] Processing CreateTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b (DEFAULT_TABLE table=default.Table_44112cae47364bd28529eb31c38016db [id=a4c6debf9953402492c215b19a78b402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.295006 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d1021f0b844a348e3fbed913758650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.295632 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8b8b3a518c42ad9e3c76c9743e361b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.295526 5846 tablet_service.cc:1467] Processing CreateTablet for tablet bbfcdf8895ce49809a8911c819a057e7 (DEFAULT_TABLE table=default.Table_31d744c3757844c388bd3f29ac469dc7 [id=a066ac9eb350431e825af944ecdfc50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.296278 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 3cda7121a474493ea13937ffa5004bb9 (DEFAULT_TABLE table=default.Table_2df45c20e4924018a625dfdac71f1560 [id=88ed16c383824ee5abd15688cd623f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.296809 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cda7121a474493ea13937ffa5004bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.298691 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 914ea799da554974960e7bf142a407b1 (DEFAULT_TABLE table=default.Table_37f97bd00db641b9963a47334e13ae68 [id=ad38848fc5514b6c93b61ed132b752c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.299106 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 914ea799da554974960e7bf142a407b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.299911 5988 tablet_service.cc:1467] Processing CreateTablet for tablet a3d4024e567a4b978bb13dd4b201f440 (DEFAULT_TABLE table=default.Table_82450110c71748558bf2346d11abac19 [id=5966c30e45e94640a8f1049efd006aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.300333 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d4024e567a4b978bb13dd4b201f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.300521 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 (DEFAULT_TABLE table=default.Table_a4f15424f73f4b85b5a6ae0453b232af [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.300990 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85f90d3cbc724e289f525c2a89296ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.301749 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 4bb1214f8880463fb2bb36c8f922174f (DEFAULT_TABLE table=default.Table_a3854865c7e0490f88fbda7f4b110018 [id=875dcbb7310d40d4a0c7eb5811bf035b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.302186 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bb1214f8880463fb2bb36c8f922174f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.302881 5991 tablet_service.cc:1467] Processing CreateTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 (DEFAULT_TABLE table=default.Table_2f828f5ec19e4fe48fcc0313452241cf [id=326ed99b27f9462ba7c5c6d174251df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.305215 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a416d7aa4cc45559e97ce1cd36575a1" } new_table_name: "default.Table_d83c2684cbbe4d368fec763501035650" modify_external_catalogs: true
I20260928 10:44:04.305387 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbfcdf8895ce49809a8911c819a057e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.308846 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6bf7ae81883467095a04ff22fe0c7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.308816 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e3bfd4162a934aa88b977518be6ad38b" } modify_external_catalogs: true
I20260928 10:44:04.309067 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e3bfd4162a934aa88b977518be6ad38b" } modify_external_catalogs: true
I20260928 10:44:04.310779 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 14184ece25b647f3a2de5990b211eebb (DEFAULT_TABLE table=default.Table_9bb4d80669c64a3383a666362405452e [id=a30d91baf0364d41bffbbb115f98cf21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.312249 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14184ece25b647f3a2de5990b211eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.313578 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.310695 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 6216f539f2e940c9b18befaa86c8b046 (DEFAULT_TABLE table=default.Table_48080e9dfbf64580b869f48141af3593 [id=e859ee33b958415eae8e096551a90e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.314267 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6216f539f2e940c9b18befaa86c8b046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.315822 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dd28a9db6baa424eb3bef7f03bd8c02a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.317276 6273 ts_tablet_manager.cc:1397] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.310s user 0.006s sys 0.010s
I20260928 10:44:04.290433 6271 consensus_queue.cc:260] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.320272 6271 ts_tablet_manager.cc:1428] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260928 10:44:04.322580 5850 tablet_service.cc:1467] Processing CreateTablet for tablet ba28bafb8dea49f6a477927aea223e1d (DEFAULT_TABLE table=default.Table_2100a4c39c3e4e9ab2b821068dd02ab5 [id=8cf33e75f9b24ce58e037e0aa5f352b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.323107 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba28bafb8dea49f6a477927aea223e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.327153 5861 tablet_service.cc:1467] Processing CreateTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b (DEFAULT_TABLE table=default.Table_44112cae47364bd28529eb31c38016db [id=a4c6debf9953402492c215b19a78b402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.329561 6271 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.331174 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 882f017dc1df42c89495b4d06bb9f563 (DEFAULT_TABLE table=default.Table_ed22e348552243ee9081c6889957158c [id=a567578fbeff41f8930e427776d99197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.331765 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 882f017dc1df42c89495b4d06bb9f563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.331696 5859 tablet_service.cc:1467] Processing CreateTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 (DEFAULT_TABLE table=default.Table_2f828f5ec19e4fe48fcc0313452241cf [id=326ed99b27f9462ba7c5c6d174251df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.334853 5862 tablet_service.cc:1467] Processing CreateTablet for tablet d42e218538814686a6c8308b1bc43949 (DEFAULT_TABLE table=default.Table_781804886015445ca7413cdb7e25e9cd [id=fefc489a322a420888016fb65fe50b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.336079 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.336920 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 882f017dc1df42c89495b4d06bb9f563 (DEFAULT_TABLE table=default.Table_ed22e348552243ee9081c6889957158c [id=a567578fbeff41f8930e427776d99197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.337180 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 (DEFAULT_TABLE table=default.Table_a4f15424f73f4b85b5a6ae0453b232af [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.341106 6271 tablet_bootstrap.cc:654] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.343694 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 32ee2c610dc9414caadb779df0259b36 (DEFAULT_TABLE table=default.Table_8a4f5d81e2b44bada43c4c23bfc5c1b3 [id=4e23d82da1a9444882ff60cd6d87327f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.344187 5855 tablet_service.cc:1467] Processing CreateTablet for tablet e875c832cfc343069c901a3f7c3e4ff0 (DEFAULT_TABLE table=default.Table_710fd0784d404c9a85b86b0251b64b8c [id=948b339823894fed98df36503eab2875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.344626 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 4bb1214f8880463fb2bb36c8f922174f (DEFAULT_TABLE table=default.Table_a3854865c7e0490f88fbda7f4b110018 [id=875dcbb7310d40d4a0c7eb5811bf035b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.345065 6271 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.345083 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8b8b3a518c42ad9e3c76c9743e361b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.345263 6271 ts_tablet_manager.cc:1397] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20260928 10:44:04.345350 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85f90d3cbc724e289f525c2a89296ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.345651 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6bf7ae81883467095a04ff22fe0c7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.345966 6271 raft_consensus.cc:348] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.346205 6271 raft_consensus.cc:374] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.346297 6271 raft_consensus.cc:729] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.346603 6271 consensus_queue.cc:260] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.347005 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 9995278ffb164f31aa119f6d392c8814 (DEFAULT_TABLE table=default.Table_1298747f4eef4583b1c6b34e0e32dadc [id=cedef4d82204473bb84e03e467702063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.347113 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 882f017dc1df42c89495b4d06bb9f563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.347190 6271 ts_tablet_manager.cc:1428] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:04.347503 6271 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.348604 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 914ea799da554974960e7bf142a407b1 (DEFAULT_TABLE table=default.Table_37f97bd00db641b9963a47334e13ae68 [id=ad38848fc5514b6c93b61ed132b752c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.349697 6271 tablet_bootstrap.cc:654] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.352730 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e875c832cfc343069c901a3f7c3e4ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.353507 5863 tablet_service.cc:1467] Processing CreateTablet for tablet a3d4024e567a4b978bb13dd4b201f440 (DEFAULT_TABLE table=default.Table_82450110c71748558bf2346d11abac19 [id=5966c30e45e94640a8f1049efd006aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.354251 6271 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.354418 6271 ts_tablet_manager.cc:1397] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260928 10:44:04.356607 6271 raft_consensus.cc:348] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.356750 6802 tablet.cc:1722] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:04.356909 6271 raft_consensus.cc:374] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.359217 6271 raft_consensus.cc:729] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.353272 6273 raft_consensus.cc:348] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.359510 6271 consensus_queue.cc:260] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.360155 6271 ts_tablet_manager.cc:1428] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260928 10:44:04.360483 6271 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.362274 6271 tablet_bootstrap.cc:654] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.372167 6271 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.372400 6271 ts_tablet_manager.cc:1397] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.005s
I20260928 10:44:04.373193 6271 raft_consensus.cc:348] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.373499 6271 raft_consensus.cc:374] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.373575 6271 raft_consensus.cc:729] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.375578 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9995278ffb164f31aa119f6d392c8814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.375849 6271 consensus_queue.cc:260] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.376449 6271 ts_tablet_manager.cc:1428] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:04.376765 6271 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.378094 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.378387 6271 tablet_bootstrap.cc:654] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.379541 6732 raft_consensus.cc:482] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.379796 6273 raft_consensus.cc:374] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.381812 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bb1214f8880463fb2bb36c8f922174f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.382184 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d4024e567a4b978bb13dd4b201f440. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.383112 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd28a9db6baa424eb3bef7f03bd8c02a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.383867 6273 raft_consensus.cc:729] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.384342 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6c38f70ac4604d6a9fc9757976da471f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.384675 6804 tablet.cc:1722] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:04.384825 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c38f70ac4604d6a9fc9757976da471f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.383138 6732 raft_consensus.cc:504] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:04.387132 5687 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 55002.9us
I20260928 10:44:04.387398 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.387643 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.388397 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_96b7a476f067469c92fc7fb319db23cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.389003 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.388011 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97401498df144cc689066ea3033d68ef" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.389820 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 3cda7121a474493ea13937ffa5004bb9 (DEFAULT_TABLE table=default.Table_2df45c20e4924018a625dfdac71f1560 [id=88ed16c383824ee5abd15688cd623f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.390897 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5bf4b815e871428f8f85595af83573b5" } modify_external_catalogs: true
I20260928 10:44:04.391086 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5bf4b815e871428f8f85595af83573b5" } modify_external_catalogs: true
I20260928 10:44:04.391918 6270 ts_tablet_manager.cc:1939] T 971f8344436f4e60ac0152e811efea8d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:04.392254 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9722d4e7fad849078d4e52c65f760c45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.394291 6732 leader_election.cc:288] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:04.394312 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9722d4e7fad849078d4e52c65f760c45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.395355 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ed011dc9b1274c1fa91c917961bc6508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.395874 6271 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
W20260928 10:44:04.395697 5818 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:04.395862 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed011dc9b1274c1fa91c917961bc6508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.396031 6271 ts_tablet_manager.cc:1397] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20260928 10:44:04.396768 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:04.396898 6271 raft_consensus.cc:348] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.397113 6271 raft_consensus.cc:374] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.397210 6271 raft_consensus.cc:729] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:04.397269 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.399386 6271 consensus_queue.cc:260] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.400064 6271 ts_tablet_manager.cc:1428] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:04.400369 6271 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.401949 6271 tablet_bootstrap.cc:654] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:04.401891 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96b7a476f067469c92fc7fb319db23cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.402156 6273 consensus_queue.cc:260] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.393600 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 7db49404752e4501a594608fc325ebe9 (DEFAULT_TABLE table=default.Table_538716398c7244d295dc35a0876d202b [id=8530ec612d2a46659ac23fd09a728c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.402944 6273 ts_tablet_manager.cc:1428] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.085s user 0.001s sys 0.001s
I20260928 10:44:04.403417 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42e218538814686a6c8308b1bc43949. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.406177 5817 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.406354 5817 leader_election.cc:302] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.406842 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 914ea799da554974960e7bf142a407b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.406936 6732 raft_consensus.cc:2726] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.407289 6737 consensus_queue.cc:1035] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260928 10:44:04.408056 6271 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.408162 6273 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.408231 6271 ts_tablet_manager.cc:1397] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260928 10:44:04.408607 6272 ts_tablet_manager.cc:1918] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.408876 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.409063 6271 raft_consensus.cc:348] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.409310 6271 raft_consensus.cc:374] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.409387 6271 raft_consensus.cc:729] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.411578 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32ee2c610dc9414caadb779df0259b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.411571 6271 consensus_queue.cc:260] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.409209 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2635c7c47ba4383b6b0f07cd3b42f74" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.412072 6737 consensus_queue.cc:1035] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 10:44:04.412209 6271 ts_tablet_manager.cc:1428] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
W20260928 10:44:04.412464 5817 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.412539 6271 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.412631 5817 leader_election.cc:302] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.413029 6732 raft_consensus.cc:2726] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.414148 6271 tablet_bootstrap.cc:654] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:04.414099 5817 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.414253 5817 leader_election.cc:302] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.414646 6729 raft_consensus.cc:2726] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.415580 6273 tablet_bootstrap.cc:654] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.417829 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cda7121a474493ea13937ffa5004bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.418780 6272 log.cc:1196] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/2ea33fe07f324842823f5f69dcbeec2b
I20260928 10:44:04.419296 6272 ts_tablet_manager.cc:1939] T 2ea33fe07f324842823f5f69dcbeec2b P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:04.421373 6269 ts_tablet_manager.cc:1918] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.421571 6269 log.cc:1196] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:04.421975 6269 ts_tablet_manager.cc:1939] T 87d5dd4e5b544262938b1822510d8b9f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:04.422035 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.423041 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c683445c12e43cc9379bf465f7e252c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:04.424054 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_f5d854333f804a1485adb1be6a28e11a [id=d365b4d48ea44401ae5c5d9c21f0c5ec], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ee0b7f3bd78a49368abc13ab9e171880 consensus state has no leader
I20260928 10:44:04.425263 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db49404752e4501a594608fc325ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.425786 6271 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.425964 6271 ts_tablet_manager.cc:1397] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.004s
I20260928 10:44:04.426910 6271 raft_consensus.cc:348] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.427174 6271 raft_consensus.cc:374] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.427274 6271 raft_consensus.cc:729] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.429777 6271 consensus_queue.cc:260] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.430403 6271 ts_tablet_manager.cc:1428] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:04.430722 6271 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.430807 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 32ee2c610dc9414caadb779df0259b36 (DEFAULT_TABLE table=default.Table_8a4f5d81e2b44bada43c4c23bfc5c1b3 [id=4e23d82da1a9444882ff60cd6d87327f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.432307 6271 tablet_bootstrap.cc:654] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.426755 6123 tablet_service.cc:1467] Processing CreateTablet for tablet e875c832cfc343069c901a3f7c3e4ff0 (DEFAULT_TABLE table=default.Table_710fd0784d404c9a85b86b0251b64b8c [id=948b339823894fed98df36503eab2875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.439252 6122 tablet_service.cc:1467] Processing CreateTablet for tablet d42e218538814686a6c8308b1bc43949 (DEFAULT_TABLE table=default.Table_781804886015445ca7413cdb7e25e9cd [id=fefc489a322a420888016fb65fe50b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.440266 6117 tablet_service.cc:1467] Processing CreateTablet for tablet ba28bafb8dea49f6a477927aea223e1d (DEFAULT_TABLE table=default.Table_2100a4c39c3e4e9ab2b821068dd02ab5 [id=8cf33e75f9b24ce58e037e0aa5f352b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.442219 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 9995278ffb164f31aa119f6d392c8814 (DEFAULT_TABLE table=default.Table_1298747f4eef4583b1c6b34e0e32dadc [id=cedef4d82204473bb84e03e467702063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.446846 6731 raft_consensus.cc:482] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.447043 6731 raft_consensus.cc:504] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.447757 6731 leader_election.cc:288] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:04.449131 5957 leader_election.cc:341] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 118ae3f8af264a31b7c22403c4951bdf
I20260928 10:44:04.449460 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118ae3f8af264a31b7c22403c4951bdf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.452937 5955 leader_election.cc:341] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.453110 5955 leader_election.cc:302] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.453421 6731 raft_consensus.cc:2726] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.453696 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32ee2c610dc9414caadb779df0259b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.454890 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 861bf895ac104cf79fe49a22ef9253b3 (DEFAULT_TABLE table=default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a [id=c75d3b905f5342f2a81419f7ba28d69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.469517 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d1021f0b844a348e3fbed913758650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.471473 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e875c832cfc343069c901a3f7c3e4ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.471990 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 6216f539f2e940c9b18befaa86c8b046 (DEFAULT_TABLE table=default.Table_48080e9dfbf64580b869f48141af3593 [id=e859ee33b958415eae8e096551a90e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.473299 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 971f8344436f4e60ac0152e811efea8d (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
W20260928 10:44:04.474087 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 82b3afe074194023ba788094a2a6b81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82b3afe074194023ba788094a2a6b81c already in progress: creating tablet
I20260928 10:44:04.474493 6270 tablet_replica.cc:330] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:04.474668 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba28bafb8dea49f6a477927aea223e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.474787 6270 raft_consensus.cc:2229] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.474886 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d42e218538814686a6c8308b1bc43949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.475018 6270 raft_consensus.cc:2258] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.475567 6270 ts_tablet_manager.cc:1905] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:04.477630 6131 tablet_service.cc:1467] Processing CreateTablet for tablet bbfcdf8895ce49809a8911c819a057e7 (DEFAULT_TABLE table=default.Table_31d744c3757844c388bd3f29ac469dc7 [id=a066ac9eb350431e825af944ecdfc50f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:04.486696 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20ea1325da4e460da08377f5d6d6a055 consensus state has no leader
I20260928 10:44:04.489537 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:04.490384 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_844c8f80dda04f47b0b920db9a814437" } new_table_name: "default.Table_35e86b6b24f34f20bd7121009fc8dd2e" modify_external_catalogs: true
I20260928 10:44:04.498777 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f5a00b74133a406996820adcb71194df
I20260928 10:44:04.499542 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5" } modify_external_catalogs: true
I20260928 10:44:04.499768 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5db0a7e9c4b04ebb9eac505cbf907fe5" } modify_external_catalogs: true
I20260928 10:44:04.500497 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 14184ece25b647f3a2de5990b211eebb (DEFAULT_TABLE table=default.Table_9bb4d80669c64a3383a666362405452e [id=a30d91baf0364d41bffbbb115f98cf21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.501000 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 (DEFAULT_TABLE table=default.Table_a4f15424f73f4b85b5a6ae0453b232af [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.501407 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fec7d4d51f114043944b5de668a91d15" } new_table_name: "default.Table_5cb651a795e04fc59d29bd7535556cbf" modify_external_catalogs: true
I20260928 10:44:04.501578 6793 raft_consensus.cc:482] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.501796 6793 raft_consensus.cc:504] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.502557 6793 leader_election.cc:288] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.502579 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 4bb1214f8880463fb2bb36c8f922174f (DEFAULT_TABLE table=default.Table_a3854865c7e0490f88fbda7f4b110018 [id=875dcbb7310d40d4a0c7eb5811bf035b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.502789 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 780707959e0e48d6a83b22e6479a5884
I20260928 10:44:04.504045 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6763237a614f41e6b67ca2917d034a8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.504611 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6763237a614f41e6b67ca2917d034a8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.506052 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_28104b0777be477eaacef13fc493ef23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.506629 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28104b0777be477eaacef13fc493ef23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.508157 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
I20260928 10:44:04.508890 6124 tablet_service.cc:1467] Processing CreateTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b (DEFAULT_TABLE table=default.Table_44112cae47364bd28529eb31c38016db [id=a4c6debf9953402492c215b19a78b402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.510572 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861bf895ac104cf79fe49a22ef9253b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.511512 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6c902309876c48ae976ee0fb5e3d43c9" } new_table_name: "default.Table_fd728deb26884d0ab358a6df27ce4026" modify_external_catalogs: true
I20260928 10:44:04.513028 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.513074 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0ef1eb1e0e8e4160aeca25ae64460b48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.513566 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef1eb1e0e8e4160aeca25ae64460b48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:04.513629 5955 leader_election.cc:341] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.515679 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 882f017dc1df42c89495b4d06bb9f563 (DEFAULT_TABLE table=default.Table_ed22e348552243ee9081c6889957158c [id=a567578fbeff41f8930e427776d99197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.517199 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f5d854333f804a1485adb1be6a28e11a" } new_table_name: "default.Table_45deff1f1764494d935c4c88b855e554" modify_external_catalogs: true
I20260928 10:44:04.518755 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_48eadf82cd0f4428b5673ab0b1643fbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.519325 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48eadf82cd0f4428b5673ab0b1643fbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.521322 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet f5a00b74133a406996820adcb71194df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.521582 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 780707959e0e48d6a83b22e6479a5884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.521798 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.522357 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bb1214f8880463fb2bb36c8f922174f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.522647 6793 raft_consensus.cc:482] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.522809 6793 raft_consensus.cc:504] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.523490 6793 leader_election.cc:288] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.525498 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6216f539f2e940c9b18befaa86c8b046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.526607 6130 tablet_service.cc:1467] Processing CreateTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 (DEFAULT_TABLE table=default.Table_2f828f5ec19e4fe48fcc0313452241cf [id=326ed99b27f9462ba7c5c6d174251df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.527038 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6bf7ae81883467095a04ff22fe0c7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.528823 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_af4b71ec0d304f94a6c07ff8ea188704" } modify_external_catalogs: true
I20260928 10:44:04.529045 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_af4b71ec0d304f94a6c07ff8ea188704" } modify_external_catalogs: true
I20260928 10:44:04.530563 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 3cda7121a474493ea13937ffa5004bb9 (DEFAULT_TABLE table=default.Table_2df45c20e4924018a625dfdac71f1560 [id=88ed16c383824ee5abd15688cd623f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.530953 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cda7121a474493ea13937ffa5004bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.534571 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 914ea799da554974960e7bf142a407b1 (DEFAULT_TABLE table=default.Table_37f97bd00db641b9963a47334e13ae68 [id=ad38848fc5514b6c93b61ed132b752c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.535000 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 914ea799da554974960e7bf142a407b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.536476 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbfcdf8895ce49809a8911c819a057e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.538545 6119 tablet_service.cc:1467] Processing CreateTablet for tablet a3d4024e567a4b978bb13dd4b201f440 (DEFAULT_TABLE table=default.Table_82450110c71748558bf2346d11abac19 [id=5966c30e45e94640a8f1049efd006aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.538949 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d4024e567a4b978bb13dd4b201f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.541764 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8b8b3a518c42ad9e3c76c9743e361b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.544957 5957 leader_election.cc:341] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a4ed61f43d5d4a6fa21eb854dae895d8
I20260928 10:44:04.544967 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.546368 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85f90d3cbc724e289f525c2a89296ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.548112 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet f5a00b74133a406996820adcb71194df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.548394 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 780707959e0e48d6a83b22e6479a5884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.549535 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 882f017dc1df42c89495b4d06bb9f563. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.549666 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84912292d6c34a3991bd0f885de240a8 consensus state has no leader
I20260928 10:44:04.551083 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4ed61f43d5d4a6fa21eb854dae895d8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.551604 6272 tablet_replica.cc:330] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:04.551928 6272 raft_consensus.cc:2229] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:04.553570 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22c4cea3f8ea413493c3ac23f83d0801 consensus state has no leader
I20260928 10:44:04.553954 6272 raft_consensus.cc:2258] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:04.554124 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd65a860b00d4a7ba8ae92dde5818212 consensus state has no leader
W20260928 10:44:04.554563 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee0b7f3bd78a49368abc13ab9e171880 consensus state has no leader
I20260928 10:44:04.554852 6272 ts_tablet_manager.cc:1905] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:04.554963 5955 leader_election.cc:341] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.555132 5955 leader_election.cc:302] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.555714 6792 raft_consensus.cc:2726] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.556944 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 32560e881a1d4444a706bb8b60dda499
I20260928 10:44:04.563504 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14184ece25b647f3a2de5990b211eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.570541 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 32560e881a1d4444a706bb8b60dda499 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.443150 6729 raft_consensus.cc:482] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.571096 6729 raft_consensus.cc:504] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.571750 6729 leader_election.cc:288] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:04.572414 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.572551 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bd99e7bdb647ceb9357f88affc45d9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.445304 6732 raft_consensus.cc:482] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.572996 6732 raft_consensus.cc:504] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.573233 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 2ea33fe07f324842823f5f69dcbeec2b (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:04.573566 6732 leader_election.cc:288] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:04.573611 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 402378e09a1d43ea92f694fe24f9c544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 402378e09a1d43ea92f694fe24f9c544 already in progress: creating tablet
I20260928 10:44:04.503273 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:04.510084 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 780707959e0e48d6a83b22e6479a5884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.511502 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet f5a00b74133a406996820adcb71194df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.512960 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.573834 5884 raft_consensus.cc:2454] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:04.563395 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 32560e881a1d4444a706bb8b60dda499 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:04.573972 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 527e00f713214484bfc19ab96044a1be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 527e00f713214484bfc19ab96044a1be already in progress: creating tablet
W20260928 10:44:04.574267 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e9e0bac650904b8f81474ba2dac9c04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9e0bac650904b8f81474ba2dac9c04f already in progress: creating tablet
I20260928 10:44:04.574455 5957 leader_election.cc:302] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:04.574620 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cc2990e37a9648669eb39a865392c9e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc2990e37a9648669eb39a865392c9e7 already in progress: creating tablet
W20260928 10:44:04.574913 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60b55bf4bd3f45a99429c0a6e97f63f6 already in progress: creating tablet
I20260928 10:44:04.575067 6792 raft_consensus.cc:2781] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:04.575176 6792 raft_consensus.cc:482] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:04.575277 6792 raft_consensus.cc:3037] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:04.576169 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3abfedf425b84f679b22d6ca9bef718a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3abfedf425b84f679b22d6ca9bef718a already in progress: creating tablet
W20260928 10:44:04.576375 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e6bd816447ad4a58b679f83b8acbb4b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bd816447ad4a58b679f83b8acbb4b5 already in progress: creating tablet
W20260928 10:44:04.576565 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 45a8098440fb4e919bc5e3f4dd3241a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a8098440fb4e919bc5e3f4dd3241a7 already in progress: creating tablet
W20260928 10:44:04.576716 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d already in progress: creating tablet
W20260928 10:44:04.576992 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 493b1d0e0b884fdfbaa3eb6d55874f2e already in progress: creating tablet
W20260928 10:44:04.577287 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2c683445c12e43cc9379bf465f7e252c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c683445c12e43cc9379bf465f7e252c already in progress: creating tablet
W20260928 10:44:04.577677 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 79d1021f0b844a348e3fbed913758650 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d1021f0b844a348e3fbed913758650 already in progress: creating tablet
W20260928 10:44:04.577987 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f5a00b74133a406996820adcb71194df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5a00b74133a406996820adcb71194df already in progress: creating tablet
I20260928 10:44:04.578091 6792 raft_consensus.cc:504] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:04.578644 5818 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.578928 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b3afe074194023ba788094a2a6b81c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.579272 6793 raft_consensus.cc:482] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.579420 6793 raft_consensus.cc:504] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.579985 6793 leader_election.cc:288] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.580053 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9995278ffb164f31aa119f6d392c8814. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.581163 5818 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:04.581835 5957 leader_election.cc:341] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1e32961679ee47379dab4c62efc53d99
I20260928 10:44:04.582523 6792 leader_election.cc:288] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.582681 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bd99e7bdb647ceb9357f88affc45d9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.583590 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:04.583804 5884 raft_consensus.cc:3037] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:04.586408 5884 raft_consensus.cc:2454] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:04.591130 5957 leader_election.cc:302] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:04.593430 5698 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]). Expected version 1 got 0
I20260928 10:44:04.594550 6792 raft_consensus.cc:2781] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:04.594821 6792 raft_consensus.cc:686] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:04.595122 6792 consensus_queue.cc:237] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.600960 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.583400 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:04.582798 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b3afe074194023ba788094a2a6b81c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.603838 5955 leader_election.cc:341] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:04.601336 6275 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.775s user 0.010s sys 0.037s
I20260928 10:44:04.605119 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e32961679ee47379dab4c62efc53d99" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.605973 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:04.606329 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
W20260928 10:44:04.608081 5955 leader_election.cc:341] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.608301 5955 leader_election.cc:302] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.608768 6793 raft_consensus.cc:2726] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.609530 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:04.616418 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.616631 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.616933 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.617040 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.619903 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 32560e881a1d4444a706bb8b60dda499 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.622455 6732 raft_consensus.cc:482] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.623131 6732 raft_consensus.cc:504] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.623411 5985 tablet_service.cc:1467] Processing CreateTablet for tablet b4bea8f5535c4833bdbb841d42706b78 (DEFAULT_TABLE table=default.Table_1acc77c2d6914c87a340fe67568a2d53 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.623855 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bea8f5535c4833bdbb841d42706b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.623849 6732 leader_election.cc:288] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:04.624261 5862 tablet_service.cc:1467] Processing CreateTablet for tablet b4bea8f5535c4833bdbb841d42706b78 (DEFAULT_TABLE table=default.Table_1acc77c2d6914c87a340fe67568a2d53 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.624625 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bea8f5535c4833bdbb841d42706b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.625043 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 464) took 2501 ms. Trace:
I20260928 10:44:04.625167 6269 rpcz_store.cc:276] 0928 10:44:02.121045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.121158 (+ 113us) service_pool.cc:227] Handling call
0928 10:44:03.954801 (+1833643us) ts_tablet_manager.cc:1145] Deleting tablet 87d5dd4e5b544262938b1822510d8b9f
0928 10:44:03.954810 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.279125 (+324315us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.421238 (+142113us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.622230 (+200992us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588358}
I20260928 10:44:04.625736 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 466) took 2310 ms. Trace:
I20260928 10:44:04.625841 6269 rpcz_store.cc:276] 0928 10:44:02.315514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.316263 (+ 749us) service_pool.cc:227] Handling call
0928 10:44:04.625526 (+2309263us) ts_tablet_manager.cc:1145] Deleting tablet 463cf5ecb52d40069b564698433c6781
0928 10:44:04.625537 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.625670 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2244535}
I20260928 10:44:04.626251 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 468) took 2243 ms. Trace:
I20260928 10:44:04.627043 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 87d5dd4e5b544262938b1822510d8b9f (table default.Table_d8361cd920f64394b922d3f17c2ae915 [id=76c248943ab94632a32893e69fce2205]) successfully deleted
W20260928 10:44:04.627329 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 463cf5ecb52d40069b564698433c6781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 463cf5ecb52d40069b564698433c6781 already in progress: creating tablet
I20260928 10:44:04.627872 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d4da5ccb214a4bbc543c67529b59cf" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.629189 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.630801 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.632655 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1b6c19618aa84f24be0f9b1e4224f47f
I20260928 10:44:04.633701 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.636639 6124 tablet_service.cc:1467] Processing CreateTablet for tablet b4bea8f5535c4833bdbb841d42706b78 (DEFAULT_TABLE table=default.Table_1acc77c2d6914c87a340fe67568a2d53 [id=1ab19896272247a6a5b8ba9d9ee8b463]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:04.637059 6275 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.887s user 0.010s sys 0.037s
I20260928 10:44:04.641672 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.642225 5693 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf] alter complete (version 1)
I20260928 10:44:04.644522 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.644753 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.644811 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.644380 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:04.626350 6269 rpcz_store.cc:276] 0928 10:44:02.382435 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.382520 (+ 85us) service_pool.cc:227] Handling call
0928 10:44:04.626074 (+2243554us) ts_tablet_manager.cc:1145] Deleting tablet ba67a229f61e4a6b8078b59fe89fae7f
0928 10:44:04.626084 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.626188 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2133061}
W20260928 10:44:04.628681 5818 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.633816 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c19618aa84f24be0f9b1e4224f47f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.649639 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:04.650906 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 469) took 2262 ms. Trace:
W20260928 10:44:04.651088 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ba67a229f61e4a6b8078b59fe89fae7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba67a229f61e4a6b8078b59fe89fae7f already in progress: creating tablet
I20260928 10:44:04.651010 6269 rpcz_store.cc:276] 0928 10:44:02.388126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.389245 (+ 1119us) service_pool.cc:227] Handling call
0928 10:44:04.650646 (+2261401us) ts_tablet_manager.cc:1145] Deleting tablet 1c8c53b5ae244cda8dff396935fc8e82
0928 10:44:04.650676 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.650848 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2125531}
I20260928 10:44:04.650429 6273 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:04.651484 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1c8c53b5ae244cda8dff396935fc8e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c8c53b5ae244cda8dff396935fc8e82 already in progress: creating tablet
I20260928 10:44:04.651510 6273 ts_tablet_manager.cc:1397] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.243s user 0.005s sys 0.001s
I20260928 10:44:04.651973 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 467) took 2272 ms. Trace:
I20260928 10:44:04.652447 6273 raft_consensus.cc:348] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.653120 6273 raft_consensus.cc:374] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.653138 6269 rpcz_store.cc:276] 0928 10:44:02.379515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.380529 (+ 1014us) service_pool.cc:227] Handling call
0928 10:44:04.651783 (+2271254us) ts_tablet_manager.cc:1145] Deleting tablet 5f42d5aef2424b3aacc8564d98cd3b67
0928 10:44:04.651794 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.651911 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2123239}
I20260928 10:44:04.653398 6273 raft_consensus.cc:729] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:04.653625 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5f42d5aef2424b3aacc8564d98cd3b67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f42d5aef2424b3aacc8564d98cd3b67 already in progress: creating tablet
I20260928 10:44:04.653730 6273 consensus_queue.cc:260] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.654081 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 491) took 2218 ms. Trace:
I20260928 10:44:04.655673 6269 rpcz_store.cc:276] 0928 10:44:02.435337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.751663 (+316326us) service_pool.cc:227] Handling call
0928 10:44:04.653919 (+1902256us) ts_tablet_manager.cc:1145] Deleting tablet a908ac5d44a74c05b35f6853ab769d91
0928 10:44:04.653933 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.654027 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1864892}
I20260928 10:44:04.656627 6273 ts_tablet_manager.cc:1428] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:04.657003 6273 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.657665 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 495) took 1903 ms. Trace:
I20260928 10:44:04.657809 6269 rpcz_store.cc:276] 0928 10:44:02.754646 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.789057 (+ 34411us) service_pool.cc:227] Handling call
0928 10:44:04.657498 (+1868441us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5590c0fd47fdbf44e5217b8d0be6
0928 10:44:04.657508 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.657606 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1868293}
W20260928 10:44:04.659833 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 already in progress: creating tablet
I20260928 10:44:04.661634 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 496) took 1898 ms. Trace:
I20260928 10:44:04.661787 6269 rpcz_store.cc:276] 0928 10:44:02.763174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.789207 (+ 26033us) service_pool.cc:227] Handling call
0928 10:44:04.661454 (+1872247us) ts_tablet_manager.cc:1145] Deleting tablet 16510244612242f796910cf28e367da9
0928 10:44:04.661464 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.661578 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1872097}
W20260928 10:44:04.662668 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 16510244612242f796910cf28e367da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16510244612242f796910cf28e367da9 already in progress: creating tablet
I20260928 10:44:04.664199 6273 tablet_bootstrap.cc:654] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.671133 6273 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.671643 6273 ts_tablet_manager.cc:1397] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.003s
I20260928 10:44:04.672708 6273 raft_consensus.cc:348] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.673964 6273 raft_consensus.cc:374] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.674232 6273 raft_consensus.cc:729] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.674728 6273 consensus_queue.cc:260] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.677958 6792 raft_consensus.cc:482] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.675091 6732 raft_consensus.cc:482] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.678138 6792 raft_consensus.cc:504] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.678336 6732 raft_consensus.cc:504] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.678894 6792 leader_election.cc:288] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.679000 6732 leader_election.cc:288] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:04.679368 6271 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.679593 6271 ts_tablet_manager.cc:1397] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.249s user 0.037s sys 0.058s
I20260928 10:44:04.679868 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ccd6efe3854d65995b17a38d81eaa5" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.680414 6271 raft_consensus.cc:348] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.680639 6271 raft_consensus.cc:374] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.680713 6271 raft_consensus.cc:729] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.680955 6271 consensus_queue.cc:260] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.681464 6271 ts_tablet_manager.cc:1428] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:04.681661 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb1d807c9f04fe4b02e3343f0c6511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:04.681770 6271 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.682143 6273 ts_tablet_manager.cc:1428] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260928 10:44:04.682142 6793 raft_consensus.cc:482] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.682272 6793 raft_consensus.cc:504] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.682822 6273 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.683451 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a6b418bbb3364006b097e3a78edf5f55 (table default.Table_534373dcfd75430c9608190a3979421a [id=5557e0d93f67480ca44cf2cd28b92e2e]). Expected version 1 got 0
I20260928 10:44:04.683518 6271 tablet_bootstrap.cc:654] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.684556 6273 tablet_bootstrap.cc:654] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:04.687521 5955 leader_election.cc:341] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:04.688426 5818 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.689318 6793 leader_election.cc:288] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:04.689806 5957 leader_election.cc:341] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75ccd6efe3854d65995b17a38d81eaa5
I20260928 10:44:04.689937 5957 leader_election.cc:302] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.693740 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a380da90a76545dba647e0c1b3e05acd" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.694813 5955 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.695024 6793 raft_consensus.cc:2726] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:04.695480 5957 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:04.695613 5957 leader_election.cc:302] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.696178 6793 raft_consensus.cc:2726] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.677327 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 497) took 1896 ms. Trace:
I20260928 10:44:04.699448 6275 tablet_bootstrap.cc:492] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:04.699745 6272 ts_tablet_manager.cc:1918] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:04.701270 6269 rpcz_store.cc:276] 0928 10:44:02.784961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.789361 (+ 4400us) service_pool.cc:227] Handling call
0928 10:44:04.677132 (+1887771us) ts_tablet_manager.cc:1145] Deleting tablet 1c056c078c95461b82c1ca1f31d90752
0928 10:44:04.677145 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.677272 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1887646}
I20260928 10:44:04.701905 6275 ts_tablet_manager.cc:1397] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 1.005s user 0.012s sys 0.038s
W20260928 10:44:04.702050 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1c056c078c95461b82c1ca1f31d90752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c056c078c95461b82c1ca1f31d90752 already in progress: creating tablet
I20260928 10:44:04.703078 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bea8f5535c4833bdbb841d42706b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.704438 6273 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.704602 6273 ts_tablet_manager.cc:1397] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.003s
I20260928 10:44:04.705382 6273 raft_consensus.cc:348] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.705611 6273 raft_consensus.cc:374] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.705684 6273 raft_consensus.cc:729] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.705960 6270 ts_tablet_manager.cc:1918] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.705926 6273 consensus_queue.cc:260] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.710915 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 500) took 1915 ms. Trace:
I20260928 10:44:04.711894 6272 log.cc:1196] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/780707959e0e48d6a83b22e6479a5884
I20260928 10:44:04.711210 6273 ts_tablet_manager.cc:1428] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:44:04.713845 6270 log.cc:1196] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e40f72ff466e4befb74290fd39285119
I20260928 10:44:04.713486 6269 rpcz_store.cc:276] 0928 10:44:02.795761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.800750 (+ 4989us) service_pool.cc:227] Handling call
0928 10:44:04.710672 (+1909922us) ts_tablet_manager.cc:1145] Deleting tablet 9319d4d4102e43b19c0caa0b0a4b4740
0928 10:44:04.710689 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.710841 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1875769}
W20260928 10:44:04.714705 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9319d4d4102e43b19c0caa0b0a4b4740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9319d4d4102e43b19c0caa0b0a4b4740 already in progress: creating tablet
I20260928 10:44:04.715276 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 503) took 1885 ms. Trace:
I20260928 10:44:04.716143 6269 rpcz_store.cc:276] 0928 10:44:02.830028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.834918 (+ 4890us) service_pool.cc:227] Handling call
0928 10:44:04.715092 (+1880174us) ts_tablet_manager.cc:1145] Deleting tablet 9afe3c828c9747958a7c558716643007
0928 10:44:04.715104 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.715223 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1879906}
I20260928 10:44:04.716885 6270 ts_tablet_manager.cc:1939] T e40f72ff466e4befb74290fd39285119 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:04.717329 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9afe3c828c9747958a7c558716643007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9afe3c828c9747958a7c558716643007 already in progress: creating tablet
I20260928 10:44:04.717782 6269 tablet_replica.cc:330] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:04.719214 6269 raft_consensus.cc:2229] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.719501 6269 raft_consensus.cc:2258] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.719694 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e40f72ff466e4befb74290fd39285119 (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
I20260928 10:44:04.718139 6273 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:04.720894 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 527e00f713214484bfc19ab96044a1be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 527e00f713214484bfc19ab96044a1be already in progress: creating tablet
I20260928 10:44:04.721753 6269 ts_tablet_manager.cc:1905] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:04.722216 6273 tablet_bootstrap.cc:654] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.724529 6272 ts_tablet_manager.cc:1939] T 780707959e0e48d6a83b22e6479a5884 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:04.724968 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 402378e09a1d43ea92f694fe24f9c544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 402378e09a1d43ea92f694fe24f9c544 already in progress: creating tablet
I20260928 10:44:04.725415 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
W20260928 10:44:04.725736 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cc2990e37a9648669eb39a865392c9e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc2990e37a9648669eb39a865392c9e7 already in progress: creating tablet
W20260928 10:44:04.725916 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c1a659100a124506a411c929ddc31f10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1a659100a124506a411c929ddc31f10 already in progress: creating tablet
W20260928 10:44:04.726372 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e9e0bac650904b8f81474ba2dac9c04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9e0bac650904b8f81474ba2dac9c04f already in progress: creating tablet
W20260928 10:44:04.726339 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 already in progress: creating tablet
W20260928 10:44:04.727535 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 32560e881a1d4444a706bb8b60dda499 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32560e881a1d4444a706bb8b60dda499 already in progress: creating tablet
I20260928 10:44:04.728164 6275 raft_consensus.cc:348] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:04.728343 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1b6c19618aa84f24be0f9b1e4224f47f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b6c19618aa84f24be0f9b1e4224f47f already in progress: creating tablet
I20260928 10:44:04.728704 6275 raft_consensus.cc:374] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.728858 6275 raft_consensus.cc:729] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.729722 6275 consensus_queue.cc:260] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.730288 6275 ts_tablet_manager.cc:1428] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260928 10:44:04.732128 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d83c2684cbbe4d368fec763501035650" } modify_external_catalogs: true
I20260928 10:44:04.732352 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d83c2684cbbe4d368fec763501035650" } modify_external_catalogs: true
I20260928 10:44:04.732928 6275 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:04.733007 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ed33c2546a3642f6a2a41c9bb2a66d92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.733623 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed33c2546a3642f6a2a41c9bb2a66d92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.734778 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3cf99208c954433e88dbc4d3315576ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.735328 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cf99208c954433e88dbc4d3315576ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.736600 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_393615b6c4fc47f483918d58dc0cfae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.737085 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393615b6c4fc47f483918d58dc0cfae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.738273 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2d2474fbee91493e81f8329da40be4c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.738875 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d2474fbee91493e81f8329da40be4c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.740031 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_754bf685bb8c4369a74a707d39d5ec08" } modify_external_catalogs: true
I20260928 10:44:04.740243 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_754bf685bb8c4369a74a707d39d5ec08" } modify_external_catalogs: true
I20260928 10:44:04.740746 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cc2a07c9718f4d569d7fcbbc6ebf79b1" } modify_external_catalogs: true
I20260928 10:44:04.740890 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cc2a07c9718f4d569d7fcbbc6ebf79b1" } modify_external_catalogs: true
I20260928 10:44:04.744099 6275 tablet_bootstrap.cc:654] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.751777 6269 ts_tablet_manager.cc:1918] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.752005 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_320ffa6517e14f969247ecdd0b4a7ca8" } new_table_name: "default.Table_88d07a9bf5e545e1a6b1bf8b19669858" modify_external_catalogs: true
I20260928 10:44:04.752343 6269 log.cc:1196] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d40123712b17464e87023f69a6235640
I20260928 10:44:04.757874 6269 ts_tablet_manager.cc:1939] T d40123712b17464e87023f69a6235640 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:04.760047 6802 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:04.761226 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 509) took 1822 ms. Trace:
I20260928 10:44:04.761519 6269 rpcz_store.cc:276] 0928 10:44:02.939204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.939654 (+ 450us) service_pool.cc:227] Handling call
0928 10:44:04.717685 (+1778031us) ts_tablet_manager.cc:1145] Deleting tablet d40123712b17464e87023f69a6235640
0928 10:44:04.717698 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.735903 (+ 18205us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.751608 (+ 15705us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.761182 (+ 9574us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1743664}
I20260928 10:44:04.762163 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d40123712b17464e87023f69a6235640 (table default.Table_296151ac6be54c6487d713bcebc2d867 [id=beb0af193f5f4677ad125facb05b7cf0]) successfully deleted
I20260928 10:44:04.762619 6269 tablet_replica.cc:330] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:04.762909 6269 raft_consensus.cc:2229] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.763152 6269 raft_consensus.cc:2258] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.763759 6269 ts_tablet_manager.cc:1905] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:04.768186 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 178065us
I20260928 10:44:04.769519 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d4da5ccb214a4bbc543c67529b59cf" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.770004 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb1d807c9f04fe4b02e3343f0c6511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.768617 5817 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.770603 5817 leader_election.cc:302] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.770820 6826 tablet.cc:1722] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:04.771019 5817 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.771152 5817 leader_election.cc:302] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.771394 6732 raft_consensus.cc:2726] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.771559 6732 raft_consensus.cc:2726] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.771739 6804 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:04.790807 6270 tablet_replica.cc:330] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:04.792490 6270 raft_consensus.cc:2229] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.793176 6270 raft_consensus.cc:2258] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.769254 6824 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:04.797389 6270 ts_tablet_manager.cc:1905] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:04.807689 6271 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.807886 6271 ts_tablet_manager.cc:1397] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.126s user 0.040s sys 0.019s
I20260928 10:44:04.808730 6271 raft_consensus.cc:348] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.808970 6271 raft_consensus.cc:374] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.809053 6271 raft_consensus.cc:729] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.809291 6271 consensus_queue.cc:260] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.809819 6271 ts_tablet_manager.cc:1428] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:04.810137 6271 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.810137 5701 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 1677f971c9384d519f1ce94da1b7ef2a (table default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710]). Expected version 1 got 0
I20260928 10:44:04.811877 6271 tablet_bootstrap.cc:654] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.812139 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_18ea40c9c4d247179baafb67f810b161" } modify_external_catalogs: true
I20260928 10:44:04.812373 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_18ea40c9c4d247179baafb67f810b161" } modify_external_catalogs: true
I20260928 10:44:04.813294 6275 tablet_bootstrap.cc:492] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:04.813205 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7a26d53dfe2c44d2be4451fde7f892b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.813882 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a26d53dfe2c44d2be4451fde7f892b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:04.814016 5817 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.814246 5817 leader_election.cc:302] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:04.814669 5817 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.814816 5817 leader_election.cc:302] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.815065 6729 raft_consensus.cc:2726] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.815231 6729 raft_consensus.cc:2726] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.815744 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a80e33d33ba64ee59584c0969fc7fafa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.816325 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a80e33d33ba64ee59584c0969fc7fafa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.817431 6792 raft_consensus.cc:482] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.817584 6792 raft_consensus.cc:504] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.817737 6273 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.817906 6273 ts_tablet_manager.cc:1397] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.003s
I20260928 10:44:04.818241 6792 leader_election.cc:288] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.819067 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:04.819427 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:04.819582 6275 ts_tablet_manager.cc:1397] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.000s
I20260928 10:44:04.819655 5884 raft_consensus.cc:2454] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:04.819741 6273 raft_consensus.cc:348] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.820015 6273 raft_consensus.cc:374] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.820081 6273 raft_consensus.cc:729] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:04.820061 5955 leader_election.cc:341] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.820349 6275 raft_consensus.cc:348] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:04.820549 5957 leader_election.cc:302] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.820613 6275 raft_consensus.cc:374] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.820811 6275 raft_consensus.cc:729] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.820708 6273 consensus_queue.cc:260] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.820958 6792 raft_consensus.cc:2781] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:04.821064 6792 raft_consensus.cc:482] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:04.821146 6792 raft_consensus.cc:3037] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:04.821161 6275 consensus_queue.cc:260] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:04.821364 6273 ts_tablet_manager.cc:1428] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:04.821664 6273 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.823952 6792 raft_consensus.cc:504] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.825229 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:04.826134 5955 leader_election.cc:341] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.826360 6793 raft_consensus.cc:482] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.826548 6793 raft_consensus.cc:504] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.827148 6793 leader_election.cc:288] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.827780 6792 leader_election.cc:288] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.828166 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a51d9a67e15479587ab2d5a492bb7c2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.829979 5955 leader_election.cc:341] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.835721 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 0563f8c31f7d43b3b703593dbc562ad6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ced63ab7188472e80d4ff52350be3e0) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.836174 6272 tablet_replica.cc:330] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:04.836427 6272 raft_consensus.cc:2229] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.836607 6272 raft_consensus.cc:2258] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.838716 6273 tablet_bootstrap.cc:654] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.839303 6272 ts_tablet_manager.cc:1905] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:04.842288 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dddbd630c6d9446b9ff317c963cd00d3 consensus state has no leader
I20260928 10:44:04.848461 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bf940beada1a4c9a97761e9d2dc66c94" } new_table_name: "default.Table_2b67503f83f34747a19b8737a4983db4" modify_external_catalogs: true
I20260928 10:44:04.850853 6272 ts_tablet_manager.cc:1918] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.851361 6272 log.cc:1196] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/0563f8c31f7d43b3b703593dbc562ad6
I20260928 10:44:04.851876 6272 ts_tablet_manager.cc:1939] T 0563f8c31f7d43b3b703593dbc562ad6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:04.853008 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 0563f8c31f7d43b3b703593dbc562ad6 (table default.Table_f63b5fc9650c4300b6109a4bb30a6cef [id=5a4de2bdb6d54d4ea3944c41df33dc24]) successfully deleted
I20260928 10:44:04.851897 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:04.854686 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 99202cf0cfac40b2aa54b10b4d96939d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99202cf0cfac40b2aa54b10b4d96939d already in progress: creating tablet
I20260928 10:44:04.856055 6275 ts_tablet_manager.cc:1428] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260928 10:44:04.857625 6275 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:04.859380 6275 tablet_bootstrap.cc:654] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:04.861044 5957 leader_election.cc:341] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5a51d9a67e15479587ab2d5a492bb7c2
I20260928 10:44:04.861198 5957 leader_election.cc:302] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.862671 6271 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.863102 6271 ts_tablet_manager.cc:1397] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.013s
I20260928 10:44:04.863978 6271 raft_consensus.cc:348] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.864395 6271 raft_consensus.cc:374] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.864513 6271 raft_consensus.cc:729] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.864773 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_159c3cb36a0148e29f7d1be2eed024f7" } new_table_name: "default.Table_a74bbb6670bc44b2880e7e7e36ba415c" modify_external_catalogs: true
I20260928 10:44:04.864837 6271 consensus_queue.cc:260] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.865545 6271 ts_tablet_manager.cc:1428] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:04.865865 6271 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.867619 6271 tablet_bootstrap.cc:654] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.869439 6793 raft_consensus.cc:482] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:04.869601 6793 raft_consensus.cc:504] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.870240 6793 leader_election.cc:288] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:04.871134 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d841c2f9b844208173f982b9eb7818" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:04.871727 5955 leader_election.cc:341] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:04.864137 6792 raft_consensus.cc:2726] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.874233 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:04.874500 5884 raft_consensus.cc:3037] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:04.875826 5957 leader_election.cc:341] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: b2d841c2f9b844208173f982b9eb7818
I20260928 10:44:04.875968 5957 leader_election.cc:302] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:04.879477 6792 raft_consensus.cc:2726] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:04.881580 6271 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.881773 6271 ts_tablet_manager.cc:1397] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.001s
I20260928 10:44:04.882256 5884 raft_consensus.cc:2454] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:04.882593 6271 raft_consensus.cc:348] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.882789 5957 leader_election.cc:302] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:04.882898 6271 raft_consensus.cc:374] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.883059 6271 raft_consensus.cc:729] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.883302 6792 raft_consensus.cc:2781] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:04.883355 6271 consensus_queue.cc:260] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.883754 6792 raft_consensus.cc:686] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:04.884114 6271 ts_tablet_manager.cc:1428] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:04.884091 6792 consensus_queue.cc:237] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.884471 6271 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.889473 6273 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.889635 6273 ts_tablet_manager.cc:1397] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.008s
I20260928 10:44:04.889820 6271 tablet_bootstrap.cc:654] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.890430 6273 raft_consensus.cc:348] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.890692 6273 raft_consensus.cc:374] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.890796 6273 raft_consensus.cc:729] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.891041 6273 consensus_queue.cc:260] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.891664 6273 ts_tablet_manager.cc:1428] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:04.891947 6273 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.893491 6273 tablet_bootstrap.cc:654] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.895555 6273 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:04.895720 6273 ts_tablet_manager.cc:1397] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260928 10:44:04.896436 6273 raft_consensus.cc:348] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.896713 6273 raft_consensus.cc:374] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.896806 6273 raft_consensus.cc:729] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.897083 6273 consensus_queue.cc:260] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.897701 6273 ts_tablet_manager.cc:1428] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:04.898038 6273 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:04.899703 6273 tablet_bootstrap.cc:654] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.901082 6271 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:04.901328 6271 ts_tablet_manager.cc:1397] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260928 10:44:04.902101 6271 raft_consensus.cc:348] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.902419 6271 raft_consensus.cc:374] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.902557 6271 raft_consensus.cc:729] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.902858 6271 consensus_queue.cc:260] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:04.903558 6271 ts_tablet_manager.cc:1428] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:04.903895 6271 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.906071 6271 tablet_bootstrap.cc:654] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.909988 6270 ts_tablet_manager.cc:1918] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.911999 5693 catalog_manager.cc:5495] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:04.926384 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a6b418bbb3364006b097e3a78edf5f55 (table default.Table_534373dcfd75430c9608190a3979421a [id=5557e0d93f67480ca44cf2cd28b92e2e]). Expected version 1 got 0
I20260928 10:44:04.943958 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a226e8713af44a92aeb71304999de0f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.944593 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a226e8713af44a92aeb71304999de0f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:04.947482 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 99202cf0cfac40b2aa54b10b4d96939d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:04.947827 6272 tablet_replica.cc:330] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:04.948036 6272 raft_consensus.cc:2229] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:04.948220 6272 raft_consensus.cc:2258] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:04.948866 5631 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:55071 (request call id 150) took 781 ms (client timeout 1000 ms). Trace:
I20260928 10:44:04.949064 6272 ts_tablet_manager.cc:1905] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:04.949018 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9739c0bb9db8453bb01925f26e19cd83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:04.949622 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9739c0bb9db8453bb01925f26e19cd83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:04.949018 5631 rpcz_store.cc:269] 0928 10:44:04.167033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.167516 (+ 483us) service_pool.cc:227] Handling call
0928 10:44:04.229192 (+ 61676us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x615000033024. stack: 00007f32cd1c066e 00007f32cd1c0430 00007f32cc2475ed 00000000008ea064 00000000008ea02d 00007f32db8d927d 00007f32db8d9373 00007f32d86fb361 00007f32e006e66a 00007f32e01f0d8f 00007f32d74e5946 00007f32d74e5675 00007f32d3cfc9be 00007f32d3cfb79e 00007f32d3d01b25 00007f32d3d0254f
0928 10:44:04.948800 (+719608us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140822912}
I20260928 10:44:04.951190 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_45deff1f1764494d935c4c88b855e554" } new_table_name: "default.Table_e51c54bdc7ea467491d09018c4ea3e3c" modify_external_catalogs: true
I20260928 10:44:04.955261 6275 tablet_bootstrap.cc:492] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:04.955448 6275 ts_tablet_manager.cc:1397] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.007s
I20260928 10:44:04.956173 6124 tablet_service.cc:1467] Processing CreateTablet for tablet ed1d3dd8a4d741199a8349a4d9520432 (DEFAULT_TABLE table=default.Table_48eadf82cd0f4428b5673ab0b1643fbc [id=474cfbc929794a06b3ac6de7e68aefb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.956300 6275 raft_consensus.cc:348] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.956525 6275 raft_consensus.cc:374] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.956606 6275 raft_consensus.cc:729] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.956610 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed1d3dd8a4d741199a8349a4d9520432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.956897 6275 consensus_queue.cc:260] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:04.958844 6275 ts_tablet_manager.cc:1428] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:04.959244 6275 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:04.960927 6275 tablet_bootstrap.cc:654] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.966768 6269 ts_tablet_manager.cc:1918] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.968564 6136 tablet_service.cc:1467] Processing CreateTablet for tablet cac941c364584322ae85798731680a6e (DEFAULT_TABLE table=default.Table_28104b0777be477eaacef13fc493ef23 [id=0d5fda7e3139471aaa4cf73fb8b00a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.971191 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cac941c364584322ae85798731680a6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:04.975447 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f913900914d149b48d64a0d53908482c consensus state has no leader
W20260928 10:44:04.976172 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e15b3cc46734ed5b8f0aef2f50025dd consensus state has no leader
I20260928 10:44:04.968833 6272 ts_tablet_manager.cc:1918] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:04.970337 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 8eea070b68384ea4958215b783685253 (DEFAULT_TABLE table=default.Table_9722d4e7fad849078d4e52c65f760c45 [id=1f7834a39c3e4968ab3471b34f84b347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.978807 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eea070b68384ea4958215b783685253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.979113 5521 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu with pid 5597
I20260928 10:44:04.982384 5862 tablet_service.cc:1467] Processing CreateTablet for tablet ed1d3dd8a4d741199a8349a4d9520432 (DEFAULT_TABLE table=default.Table_48eadf82cd0f4428b5673ab0b1643fbc [id=474cfbc929794a06b3ac6de7e68aefb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.983356 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed1d3dd8a4d741199a8349a4d9520432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.984030 5848 tablet_service.cc:1467] Processing CreateTablet for tablet cac941c364584322ae85798731680a6e (DEFAULT_TABLE table=default.Table_28104b0777be477eaacef13fc493ef23 [id=0d5fda7e3139471aaa4cf73fb8b00a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.984367 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cac941c364584322ae85798731680a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.985611 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 86b16eb36c034591ac1603ab84fd9342 (table default.Table_6279d9ee60ce44759d7bc1ae62dd2073 [id=d006fbd87b934957b39ed53725c2eb78]). Expected version 1 got 0
I20260928 10:44:04.986802 6275 tablet_bootstrap.cc:492] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:04.986963 6275 ts_tablet_manager.cc:1397] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
I20260928 10:44:04.987742 6275 raft_consensus.cc:348] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:04.988027 6275 raft_consensus.cc:374] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:04.988119 6275 raft_consensus.cc:729] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:04.988353 6275 consensus_queue.cc:260] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:04.989202 6275 ts_tablet_manager.cc:1428] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:04.989620 6275 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:04.990407 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 8eea070b68384ea4958215b783685253 (DEFAULT_TABLE table=default.Table_9722d4e7fad849078d4e52c65f760c45 [id=1f7834a39c3e4968ab3471b34f84b347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:04.991178 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eea070b68384ea4958215b783685253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.991961 6275 tablet_bootstrap.cc:654] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.982409 6269 log.cc:1196] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/01433ce37b2c49cd858ea88877ca56da
I20260928 10:44:04.996767 6272 log.cc:1196] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/99202cf0cfac40b2aa54b10b4d96939d
I20260928 10:44:04.997447 6272 ts_tablet_manager.cc:1939] T 99202cf0cfac40b2aa54b10b4d96939d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.002609 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 99202cf0cfac40b2aa54b10b4d96939d (table default.Table_f4bc1e73b1804c52ad90b1c61738b77c [id=1d83f40c8ad34f4188d45dde57de2106]) successfully deleted
I20260928 10:44:05.005874 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a4f15424f73f4b85b5a6ae0453b232af" } new_table_name: "default.Table_a2df4c84bb2e4b3095ad3099ac5093bf" modify_external_catalogs: true
I20260928 10:44:05.012650 6275 tablet_bootstrap.cc:492] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.014919 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 20ea1325da4e460da08377f5d6d6a055
I20260928 10:44:05.017138 5695 catalog_manager.cc:5495] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:05.017638 5695 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:05.012960 6275 ts_tablet_manager.cc:1397] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.011s
I20260928 10:44:05.018720 6275 raft_consensus.cc:348] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.018863 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 20ea1325da4e460da08377f5d6d6a055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.018954 6269 ts_tablet_manager.cc:1939] T 01433ce37b2c49cd858ea88877ca56da P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.018980 6275 raft_consensus.cc:374] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.019078 6275 raft_consensus.cc:729] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.019322 6275 consensus_queue.cc:260] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:05.019763 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 20ea1325da4e460da08377f5d6d6a055 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20ea1325da4e460da08377f5d6d6a055 already in progress: creating tablet
I20260928 10:44:05.020011 6275 ts_tablet_manager.cc:1428] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:05.019995 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 508) took 2081 ms. Trace:
I20260928 10:44:05.020313 6275 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.020506 6827 raft_consensus.cc:482] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.020677 6827 raft_consensus.cc:504] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.021347 6827 leader_election.cc:288] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.022040 6275 tablet_bootstrap.cc:654] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.022297 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.022807 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.022957 5817 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.023243 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeb55c2547e417090fd36664cbe69f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.023419 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 20ea1325da4e460da08377f5d6d6a055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.020092 6269 rpcz_store.cc:276] 0928 10:44:02.938920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.939876 (+ 956us) service_pool.cc:227] Handling call
0928 10:44:04.762551 (+1822675us) ts_tablet_manager.cc:1145] Deleting tablet 01433ce37b2c49cd858ea88877ca56da
0928 10:44:04.762563 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.860424 (+ 97861us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.953616 (+ 93192us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.019939 (+ 66323us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788471}
I20260928 10:44:05.024566 6273 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.024919 6275 tablet_bootstrap.cc:492] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.025121 6273 ts_tablet_manager.cc:1397] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.127s user 0.026s sys 0.007s
I20260928 10:44:05.025128 6275 ts_tablet_manager.cc:1397] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260928 10:44:05.025602 6737 raft_consensus.cc:482] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.025784 6737 raft_consensus.cc:504] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:05.025897 6273 raft_consensus.cc:348] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.025946 6275 raft_consensus.cc:348] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.026086 6273 raft_consensus.cc:374] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.026146 6275 raft_consensus.cc:374] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.026170 6273 raft_consensus.cc:729] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.026232 6275 raft_consensus.cc:729] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.024974 6269 tablet_replica.cc:330] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.026446 6737 leader_election.cc:288] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:05.026508 6269 raft_consensus.cc:2229] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.026510 6275 consensus_queue.cc:260] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.026676 6269 raft_consensus.cc:2258] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:04.923637 6271 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.027976 6270 log.cc:1196] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:05.028052 6271 ts_tablet_manager.cc:1397] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.124s user 0.002s sys 0.002s
I20260928 10:44:05.028414 6270 ts_tablet_manager.cc:1939] T a380da90a76545dba647e0c1b3e05acd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.028471 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.028911 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeb55c2547e417090fd36664cbe69f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.028852 6271 raft_consensus.cc:348] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.029098 6271 raft_consensus.cc:374] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.029184 6271 raft_consensus.cc:729] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.029417 6271 consensus_queue.cc:260] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.030025 6271 ts_tablet_manager.cc:1428] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:05.030349 6271 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:04.959026 5990 tablet_service.cc:1467] Processing CreateTablet for tablet ed1d3dd8a4d741199a8349a4d9520432 (DEFAULT_TABLE table=default.Table_48eadf82cd0f4428b5673ab0b1643fbc [id=474cfbc929794a06b3ac6de7e68aefb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.030835 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed1d3dd8a4d741199a8349a4d9520432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:04.969178 5995 tablet_service.cc:1467] Processing CreateTablet for tablet cac941c364584322ae85798731680a6e (DEFAULT_TABLE table=default.Table_28104b0777be477eaacef13fc493ef23 [id=0d5fda7e3139471aaa4cf73fb8b00a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.034809 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cac941c364584322ae85798731680a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.036289 6271 tablet_bootstrap.cc:654] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:04.988011 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 8eea070b68384ea4958215b783685253 (DEFAULT_TABLE table=default.Table_9722d4e7fad849078d4e52c65f760c45 [id=1f7834a39c3e4968ab3471b34f84b347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.038853 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eea070b68384ea4958215b783685253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.040642 6269 ts_tablet_manager.cc:1905] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.043419 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 90b3f24cd74248f9bc89dac0f6363d2f (DEFAULT_TABLE table=default.Table_ed011dc9b1274c1fa91c917961bc6508 [id=ca6e6a5683a940b0b5401ba19600f8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.043841 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b3f24cd74248f9bc89dac0f6363d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.046852 6273 consensus_queue.cc:260] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.049081 6001 tablet_service.cc:1467] Processing CreateTablet for tablet dfe5dbc497224077aa1462c6a9409ee0 (DEFAULT_TABLE table=default.Table_0ef1eb1e0e8e4160aeca25ae64460b48 [id=f37e574e9e744fd9bf2772299bc4478e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.049568 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe5dbc497224077aa1462c6a9409ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.054857 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 975fffba16ba46a295df724d65cf319a (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.055338 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 975fffba16ba46a295df724d65cf319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.057972 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b (DEFAULT_TABLE table=default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5 [id=22c72f1501ca45dba92479b0dac3e22a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.058408 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ecd8d56d7a945a0afbd9541048f232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.049082 5984 tablet_service.cc:1467] Processing CreateTablet for tablet e89d3b5d65454b2982e625dd4f909bfb (DEFAULT_TABLE table=default.Table_96b7a476f067469c92fc7fb319db23cd [id=3178c73409444e85b5a163ae055c9c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.062687 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d3b5d65454b2982e625dd4f909bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.064826 6793 raft_consensus.cc:482] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.064993 6793 raft_consensus.cc:504] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.065681 6793 leader_election.cc:288] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:05.067070 5957 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:05.026687 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 01433ce37b2c49cd858ea88877ca56da (table default.Table_c54e444afb3043c0adbaeafa7e6edb1c [id=ba1f625ad33143bca567a8788d0d95b2]) successfully deleted
I20260928 10:44:05.027194 6275 ts_tablet_manager.cc:1428] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:05.070179 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 03ebfc156361479c909ff263c3be4601 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.070303 6275 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.032675 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 263b9844bdf6465fa7894ddcf2809f24
I20260928 10:44:05.071098 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a3854865c7e0490f88fbda7f4b110018" } modify_external_catalogs: true
I20260928 10:44:05.071270 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a3854865c7e0490f88fbda7f4b110018" } modify_external_catalogs: true
I20260928 10:44:05.071419 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.072082 6275 tablet_bootstrap.cc:654] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:05.072134 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 263b9844bdf6465fa7894ddcf2809f24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263b9844bdf6465fa7894ddcf2809f24 already in progress: creating tablet
I20260928 10:44:05.057112 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 57b7976063024775b9dde91b32010754
I20260928 10:44:05.072335 6273 ts_tablet_manager.cc:1428] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260928 10:44:05.072664 6273 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.072858 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet dfd9b4092b1242b8a60974c445a2789a from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.073343 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.073762 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet e03f686afffc4d47b5e27fdbc8eb8f75 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.073921 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b7976063024775b9dde91b32010754 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:05.074530 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 57b7976063024775b9dde91b32010754 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57b7976063024775b9dde91b32010754 already in progress: creating tablet
W20260928 10:44:05.027634 6091 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 971f8344436f4e60ac0152e811efea8d
W20260928 10:44:05.074929 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 47301.1us
I20260928 10:44:05.029872 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 24d6b096201747beac9b765b1958d5bb (DEFAULT_TABLE table=default.Table_dd28a9db6baa424eb3bef7f03bd8c02a [id=864dcf4e207c4ecfa04c7c380f399fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.075357 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d6b096201747beac9b765b1958d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.075320 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.075701 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeb55c2547e417090fd36664cbe69f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.075822 5857 tablet_service.cc:1467] Processing CreateTablet for tablet dfe5dbc497224077aa1462c6a9409ee0 (DEFAULT_TABLE table=default.Table_0ef1eb1e0e8e4160aeca25ae64460b48 [id=f37e574e9e744fd9bf2772299bc4478e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.075953 5847 tablet_service.cc:1467] Processing CreateTablet for tablet e89d3b5d65454b2982e625dd4f909bfb (DEFAULT_TABLE table=default.Table_96b7a476f067469c92fc7fb319db23cd [id=3178c73409444e85b5a163ae055c9c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.076175 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe5dbc497224077aa1462c6a9409ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.076509 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b (DEFAULT_TABLE table=default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5 [id=22c72f1501ca45dba92479b0dac3e22a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.076843 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ecd8d56d7a945a0afbd9541048f232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.063184 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b217b6d4ad9a495795fe2b923144e8d3
I20260928 10:44:05.079145 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_672b2cbddad04c62b6c82a92f7b6ff8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.079695 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_672b2cbddad04c62b6c82a92f7b6ff8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:05.081153 6090 leader_election.cc:341] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 971f8344436f4e60ac0152e811efea8d
I20260928 10:44:05.030623 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 90b3f24cd74248f9bc89dac0f6363d2f (DEFAULT_TABLE table=default.Table_ed011dc9b1274c1fa91c917961bc6508 [id=ca6e6a5683a940b0b5401ba19600f8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.081399 6090 leader_election.cc:302] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.081712 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b3f24cd74248f9bc89dac0f6363d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.082056 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59bfe1f8050f47429ef80a19fdcd8198" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.075706 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 975fffba16ba46a295df724d65cf319a (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.082880 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 975fffba16ba46a295df724d65cf319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.082968 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.083215 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b7976063024775b9dde91b32010754 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.084774 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.084990 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.085153 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.085335 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.085496 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b7976063024775b9dde91b32010754 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.085675 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.044453 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 975fffba16ba46a295df724d65cf319a (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.086690 6737 raft_consensus.cc:2726] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:05.086809 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85f90d3cbc724e289f525c2a89296ce4 consensus state has no leader
I20260928 10:44:05.086990 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.087226 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f4ec87e39b70409fa42c35946fa4269e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.087831 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4ec87e39b70409fa42c35946fa4269e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.088492 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 24d6b096201747beac9b765b1958d5bb (DEFAULT_TABLE table=default.Table_dd28a9db6baa424eb3bef7f03bd8c02a [id=864dcf4e207c4ecfa04c7c380f399fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.045189 6117 tablet_service.cc:1467] Processing CreateTablet for tablet e89d3b5d65454b2982e625dd4f909bfb (DEFAULT_TABLE table=default.Table_96b7a476f067469c92fc7fb319db23cd [id=3178c73409444e85b5a163ae055c9c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.088873 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d6b096201747beac9b765b1958d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.045852 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b (DEFAULT_TABLE table=default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5 [id=22c72f1501ca45dba92479b0dac3e22a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.089620 5955 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.089774 5955 leader_election.cc:302] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.090296 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d3b5d65454b2982e625dd4f909bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.091578 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 975fffba16ba46a295df724d65cf319a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.063969 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.095013 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:05.068276 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee0b7f3bd78a49368abc13ab9e171880 consensus state has no leader
I20260928 10:44:05.097045 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_971a8f1c1bc840f992dbf5d357debe39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.097693 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_971a8f1c1bc840f992dbf5d357debe39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.098984 6827 raft_consensus.cc:482] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.099150 6827 raft_consensus.cc:504] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.099783 6827 leader_election.cc:288] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.100526 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.100927 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.101542 5817 leader_election.cc:341] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.068718 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9cd9abadc5e546f8b73c683c41c6c1b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.102227 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cd9abadc5e546f8b73c683c41c6c1b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.069067 5700 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_19bc838ee7264d68bb6451efa0fce66f [id=688359adeeea4de79516ab81770bb710] alter complete (version 1)
I20260928 10:44:05.103902 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet bd225da0b4b445c6ac03634d975e8396 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.104575 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_37f97bd00db641b9963a47334e13ae68" } new_table_name: "default.Table_8cfcbe514c50405d849db4b55a930620" modify_external_catalogs: true
I20260928 10:44:04.999277 6792 raft_consensus.cc:482] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.015667 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 20ea1325da4e460da08377f5d6d6a055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.022207 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.105472 6792 raft_consensus.cc:504] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.106143 6792 leader_election.cc:288] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:05.106117 5818 leader_election.cc:341] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.106274 5818 leader_election.cc:302] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.106305 6792 raft_consensus.cc:2726] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:05.106712 5818 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.106820 5818 leader_election.cc:302] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.107149 6729 raft_consensus.cc:2726] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.107309 6729 raft_consensus.cc:2726] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.108726 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:05.111338 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b217b6d4ad9a495795fe2b923144e8d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b217b6d4ad9a495795fe2b923144e8d3 already in progress: creating tablet
I20260928 10:44:05.074379 6273 tablet_bootstrap.cc:654] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.114367 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28eb4bef35cc413ebbdc177de1d7b057" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.115347 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 90b3f24cd74248f9bc89dac0f6363d2f (DEFAULT_TABLE table=default.Table_ed011dc9b1274c1fa91c917961bc6508 [id=ca6e6a5683a940b0b5401ba19600f8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.115854 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b3f24cd74248f9bc89dac0f6363d2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.117146 5957 leader_election.cc:341] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 28eb4bef35cc413ebbdc177de1d7b057
W20260928 10:44:05.117764 5955 leader_election.cc:341] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.117911 5955 leader_election.cc:302] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.118376 6793 raft_consensus.cc:2726] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.046234 6120 tablet_service.cc:1467] Processing CreateTablet for tablet dfe5dbc497224077aa1462c6a9409ee0 (DEFAULT_TABLE table=default.Table_0ef1eb1e0e8e4160aeca25ae64460b48 [id=f37e574e9e744fd9bf2772299bc4478e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.119114 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe5dbc497224077aa1462c6a9409ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.120630 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d3b5d65454b2982e625dd4f909bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.121013 6269 ts_tablet_manager.cc:1918] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.124104 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ecd8d56d7a945a0afbd9541048f232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.125427 6269 log.cc:1196] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d257233e5b934d619e2289a6df55d65a
I20260928 10:44:05.125850 6269 ts_tablet_manager.cc:1939] T d257233e5b934d619e2289a6df55d65a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.128368 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 510) took 2189 ms. Trace:
I20260928 10:44:05.137001 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 24d6b096201747beac9b765b1958d5bb (DEFAULT_TABLE table=default.Table_dd28a9db6baa424eb3bef7f03bd8c02a [id=864dcf4e207c4ecfa04c7c380f399fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.137643 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d6b096201747beac9b765b1958d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.133236 6827 raft_consensus.cc:482] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.138657 6827 raft_consensus.cc:504] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.139369 6827 leader_election.cc:288] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.140991 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd225da0b4b445c6ac03634d975e8396" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.141693 5817 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.142863 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd225da0b4b445c6ac03634d975e8396" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:05.143541 5818 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.143682 5818 leader_election.cc:302] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.144142 6827 raft_consensus.cc:2726] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.146883 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.147233 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.147295 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet bae5a2038947413f95f134602081c889 (table default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]). Expected version 2 got 0
I20260928 10:44:05.147524 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 92912af8cba4453a8e3422896d586855 with delete_type TABLET_DATA_DELETED (replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.147703 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.147993 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.149592 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4bb1214f8880463fb2bb36c8f922174f
I20260928 10:44:05.150553 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e03f686afffc4d47b5e27fdbc8eb8f75
I20260928 10:44:05.150918 5701 catalog_manager.cc:6565] ReplaceTablet: tablet e03f686afffc4d47b5e27fdbc8eb8f75 deleted and replaced by tablet 0471473cce114d3985f9a8de2de77d39
I20260928 10:44:05.150985 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 549) took 1317 ms. Trace:
I20260928 10:44:05.152245 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bb1214f8880463fb2bb36c8f922174f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.152488 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 0471473cce114d3985f9a8de2de77d39) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.151114 6270 rpcz_store.cc:276] 0928 10:44:03.833528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.833580 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:04.726637 (+893057us) ts_tablet_manager.cc:1145] Deleting tablet a380da90a76545dba647e0c1b3e05acd
0928 10:44:04.726647 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:04.906365 (+179718us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:04.909834 (+ 3469us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.150944 (+241110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12544,"tablet-delete.queue_time_us":887194}
I20260928 10:44:05.159441 6793 raft_consensus.cc:482] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.159646 6793 raft_consensus.cc:504] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.160230 6793 leader_election.cc:288] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:05.161382 5957 leader_election.cc:341] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 317446124e354bbeaaef608d9e8852fd
I20260928 10:44:05.162330 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "317446124e354bbeaaef608d9e8852fd" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.162992 5955 leader_election.cc:341] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.163154 5955 leader_election.cc:302] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.164897 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 0471473cce114d3985f9a8de2de77d39) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.164964 6793 raft_consensus.cc:2726] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:05.165663 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e03f686afffc4d47b5e27fdbc8eb8f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03f686afffc4d47b5e27fdbc8eb8f75 already in progress: creating tablet
I20260928 10:44:05.166828 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a380da90a76545dba647e0c1b3e05acd (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
I20260928 10:44:05.167331 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 551) took 1324 ms. Trace:
I20260928 10:44:05.167550 6270 rpcz_store.cc:276] 0928 10:44:03.843071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.843126 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:05.167150 (+1324024us) ts_tablet_manager.cc:1145] Deleting tablet 60b55bf4bd3f45a99429c0a6e97f63f6
0928 10:44:05.167164 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.167295 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1320391}
W20260928 10:44:05.168145 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60b55bf4bd3f45a99429c0a6e97f63f6 already in progress: creating tablet
I20260928 10:44:05.170137 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 0471473cce114d3985f9a8de2de77d39) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.170430 6269 rpcz_store.cc:276] 0928 10:44:02.939304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.944563 (+ 5259us) service_pool.cc:227] Handling call
0928 10:44:05.024896 (+2080333us) ts_tablet_manager.cc:1145] Deleting tablet d257233e5b934d619e2289a6df55d65a
0928 10:44:05.024907 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.043890 (+ 18983us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.120867 (+ 76977us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.128315 (+ 7448us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047952}
I20260928 10:44:05.172000 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bb1214f8880463fb2bb36c8f922174f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.172103 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d257233e5b934d619e2289a6df55d65a (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:05.172286 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bb1214f8880463fb2bb36c8f922174f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.172705 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet ab1277e4c47141ea9480987eef715528 with delete_type TABLET_DATA_DELETED (replaced by tablet 3abfedf425b84f679b22d6ca9bef718a) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.172951 6272 tablet_replica.cc:330] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:05.172933 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4bb1214f8880463fb2bb36c8f922174f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bb1214f8880463fb2bb36c8f922174f already in progress: creating tablet
I20260928 10:44:05.173003 6269 tablet_replica.cc:330] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.173163 6272 raft_consensus.cc:2229] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.173202 6269 raft_consensus.cc:2229] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.173341 6272 raft_consensus.cc:2258] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.173367 6269 raft_consensus.cc:2258] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.173769 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 118ae3f8af264a31b7c22403c4951bdf with delete_type TABLET_DATA_DELETED (replaced by tablet 3c957158dbd949e88554e70fe6146089) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.173947 6269 ts_tablet_manager.cc:1905] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.174067 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a51d9a67e15479587ab2d5a492bb7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.174118 6272 ts_tablet_manager.cc:1905] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.174808 6275 tablet_bootstrap.cc:492] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.174978 6275 ts_tablet_manager.cc:1397] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.105s user 0.020s sys 0.009s
I20260928 10:44:05.175379 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cfde87d7ea184dada39c96e04bfaf744"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.175724 6275 raft_consensus.cc:348] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:05.175944 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfde87d7ea184dada39c96e04bfaf744 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.175997 6275 raft_consensus.cc:374] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.176071 6275 raft_consensus.cc:729] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.176285 6275 consensus_queue.cc:260] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.176751 6275 ts_tablet_manager.cc:1428] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:05.177045 6275 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.177234 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ac7d5d88ccd34b58b200efcbbfb94173"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.177732 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac7d5d88ccd34b58b200efcbbfb94173 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.178814 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a11e380b1c87489488dab8b4580b38aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.179286 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a11e380b1c87489488dab8b4580b38aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.181074 6275 tablet_bootstrap.cc:654] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.183658 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_672b2cbddad04c62b6c82a92f7b6ff8c" } new_table_name: "default.Table_48c975dd6a964ba3872c1953b0008bf0" modify_external_catalogs: true
I20260928 10:44:05.184825 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 75ccd6efe3854d65995b17a38d81eaa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:55 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.191028 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_78298d55e7474d6da0c4ea464abb2b15" } new_table_name: "default.Table_f049c872214e4df18f99f9fb5a53066e" modify_external_catalogs: true
I20260928 10:44:05.192945 6793 raft_consensus.cc:482] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.193125 6793 raft_consensus.cc:504] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.193792 6793 leader_election.cc:288] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.194378 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01433ce37b2c49cd858ea88877ca56da" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.194656 5957 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 01433ce37b2c49cd858ea88877ca56da
W20260928 10:44:05.194937 5955 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.195072 5955 leader_election.cc:302] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.195416 6793 raft_consensus.cc:2726] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.196115 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.196445 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 971f8344436f4e60ac0152e811efea8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.197948 6272 ts_tablet_manager.cc:1918] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.198112 6272 log.cc:1196] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/ab1277e4c47141ea9480987eef715528
I20260928 10:44:05.198505 6272 ts_tablet_manager.cc:1939] T ab1277e4c47141ea9480987eef715528 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.199497 6272 tablet_replica.cc:330] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.199692 6272 raft_consensus.cc:2229] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.199713 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet ab1277e4c47141ea9480987eef715528 (table default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]) successfully deleted
I20260928 10:44:05.199884 6272 raft_consensus.cc:2258] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.200667 6272 ts_tablet_manager.cc:1905] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:05.201583 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 914ea799da554974960e7bf142a407b1 consensus state has no leader
I20260928 10:44:05.202338 6270 tablet_replica.cc:330] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:05.202610 6270 raft_consensus.cc:2229] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.202883 6270 raft_consensus.cc:2258] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.203487 6270 ts_tablet_manager.cc:1905] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.206090 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 024c12c4a3d44c21b6bccc69b92a6323 (DEFAULT_TABLE table=default.Table_2d2474fbee91493e81f8329da40be4c3 [id=ec0ba039eb09486f99423e567699c312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.206630 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024c12c4a3d44c21b6bccc69b92a6323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.212965 6117 tablet_service.cc:1467] Processing CreateTablet for tablet b7065d8329b146b789216da84c9357b2 (DEFAULT_TABLE table=default.Table_7a26d53dfe2c44d2be4451fde7f892b4 [id=90780bc9dbd9473689499384cf68b3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.213528 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7065d8329b146b789216da84c9357b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.217767 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 969cd0bea65344c787308737da1efd46 (DEFAULT_TABLE table=default.Table_a80e33d33ba64ee59584c0969fc7fafa [id=e62f321756d14f689b86d3f661272e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.218241 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969cd0bea65344c787308737da1efd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.218439 6118 tablet_service.cc:1467] Processing CreateTablet for tablet f63312cb046844dc8eddbb76f614029b (DEFAULT_TABLE table=default.Table_ed33c2546a3642f6a2a41c9bb2a66d92 [id=fa30aeda67de4c4990d351a0b5461ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.218936 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f63312cb046844dc8eddbb76f614029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.208561 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 03349ec4f7de48939ac81ed3db60b7b0 (DEFAULT_TABLE table=default.Table_393615b6c4fc47f483918d58dc0cfae6 [id=eb0182daeb52412b9494d14fb6a94ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.223034 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03349ec4f7de48939ac81ed3db60b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.223325 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 969cd0bea65344c787308737da1efd46 (DEFAULT_TABLE table=default.Table_a80e33d33ba64ee59584c0969fc7fafa [id=e62f321756d14f689b86d3f661272e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.223795 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969cd0bea65344c787308737da1efd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.208931 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 024c12c4a3d44c21b6bccc69b92a6323 (DEFAULT_TABLE table=default.Table_2d2474fbee91493e81f8329da40be4c3 [id=ec0ba039eb09486f99423e567699c312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.226006 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024c12c4a3d44c21b6bccc69b92a6323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.226526 5984 tablet_service.cc:1467] Processing CreateTablet for tablet b7065d8329b146b789216da84c9357b2 (DEFAULT_TABLE table=default.Table_7a26d53dfe2c44d2be4451fde7f892b4 [id=90780bc9dbd9473689499384cf68b3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.209213 5855 tablet_service.cc:1467] Processing CreateTablet for tablet b7065d8329b146b789216da84c9357b2 (DEFAULT_TABLE table=default.Table_7a26d53dfe2c44d2be4451fde7f892b4 [id=90780bc9dbd9473689499384cf68b3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.226949 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7065d8329b146b789216da84c9357b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.227053 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7065d8329b146b789216da84c9357b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.211781 5858 tablet_service.cc:1467] Processing CreateTablet for tablet f63312cb046844dc8eddbb76f614029b (DEFAULT_TABLE table=default.Table_ed33c2546a3642f6a2a41c9bb2a66d92 [id=fa30aeda67de4c4990d351a0b5461ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.230792 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f63312cb046844dc8eddbb76f614029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.230958 5986 tablet_service.cc:1467] Processing CreateTablet for tablet f63312cb046844dc8eddbb76f614029b (DEFAULT_TABLE table=default.Table_ed33c2546a3642f6a2a41c9bb2a66d92 [id=fa30aeda67de4c4990d351a0b5461ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.231300 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f63312cb046844dc8eddbb76f614029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.234804 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2adfb715d87e4f0a8e837a43938de99e" } modify_external_catalogs: true
I20260928 10:44:05.235069 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2adfb715d87e4f0a8e837a43938de99e" } modify_external_catalogs: true
I20260928 10:44:05.235810 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 024c12c4a3d44c21b6bccc69b92a6323 (DEFAULT_TABLE table=default.Table_2d2474fbee91493e81f8329da40be4c3 [id=ec0ba039eb09486f99423e567699c312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.236207 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024c12c4a3d44c21b6bccc69b92a6323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.239317 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 03349ec4f7de48939ac81ed3db60b7b0 (DEFAULT_TABLE table=default.Table_393615b6c4fc47f483918d58dc0cfae6 [id=eb0182daeb52412b9494d14fb6a94ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.239740 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03349ec4f7de48939ac81ed3db60b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.241969 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 03349ec4f7de48939ac81ed3db60b7b0 (DEFAULT_TABLE table=default.Table_393615b6c4fc47f483918d58dc0cfae6 [id=eb0182daeb52412b9494d14fb6a94ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.242537 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03349ec4f7de48939ac81ed3db60b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.215881 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 969cd0bea65344c787308737da1efd46 (DEFAULT_TABLE table=default.Table_a80e33d33ba64ee59584c0969fc7fafa [id=e62f321756d14f689b86d3f661272e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.246387 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969cd0bea65344c787308737da1efd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.250341 6120 tablet_service.cc:1467] Processing CreateTablet for tablet e3a5246fa46e4753885784f87343c0ce (DEFAULT_TABLE table=default.Table_3cf99208c954433e88dbc4d3315576ef [id=0bf82e1915aa48f9acaacc50ff62e6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.260464 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3a5246fa46e4753885784f87343c0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.260891 5854 tablet_service.cc:1467] Processing CreateTablet for tablet e3a5246fa46e4753885784f87343c0ce (DEFAULT_TABLE table=default.Table_3cf99208c954433e88dbc4d3315576ef [id=0bf82e1915aa48f9acaacc50ff62e6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.261149 6827 raft_consensus.cc:482] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.261355 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3a5246fa46e4753885784f87343c0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.261330 6827 raft_consensus.cc:504] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.262089 6827 leader_election.cc:288] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.263025 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.263226 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:05.263664 5817 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:05.263866 5818 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.263995 5818 leader_election.cc:302] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.264629 6827 raft_consensus.cc:2726] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.268927 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3bbdfde366124ee2b57a8e1eaca2e658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.269634 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bbdfde366124ee2b57a8e1eaca2e658 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.271265 6271 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.271544 6271 ts_tablet_manager.cc:1397] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.241s user 0.006s sys 0.010s
I20260928 10:44:05.272362 6271 raft_consensus.cc:348] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.272728 6271 raft_consensus.cc:374] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.272984 6271 raft_consensus.cc:729] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.273077 6827 raft_consensus.cc:482] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.273248 6827 raft_consensus.cc:504] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.273294 6271 consensus_queue.cc:260] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.273967 6827 leader_election.cc:288] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.274040 6271 ts_tablet_manager.cc:1428] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:05.274742 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.275317 5817 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.276183 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a226e8713af44a92aeb71304999de0f3" } modify_external_catalogs: true
I20260928 10:44:05.276279 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_df04fd38822944cc8bbfb2765e68488a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.276408 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a226e8713af44a92aeb71304999de0f3" } modify_external_catalogs: true
I20260928 10:44:05.276561 6273 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.276705 6273 ts_tablet_manager.cc:1397] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.204s user 0.001s sys 0.007s
W20260928 10:44:05.276856 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df04fd38822944cc8bbfb2765e68488a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.277463 6273 raft_consensus.cc:348] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.277593 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a76680616cce463084d329ce2930c487" } modify_external_catalogs: true
I20260928 10:44:05.277693 6273 raft_consensus.cc:374] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.277763 6273 raft_consensus.cc:729] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.277782 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a76680616cce463084d329ce2930c487" } modify_external_catalogs: true
I20260928 10:44:05.278865 5990 tablet_service.cc:1467] Processing CreateTablet for tablet e3a5246fa46e4753885784f87343c0ce (DEFAULT_TABLE table=default.Table_3cf99208c954433e88dbc4d3315576ef [id=0bf82e1915aa48f9acaacc50ff62e6a8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.284533 5686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.100.125:37939 (error 108) [suppressed 9 similar messages]
I20260928 10:44:05.286615 6273 consensus_queue.cc:260] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.287417 6273 ts_tablet_manager.cc:1428] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260928 10:44:05.287844 6273 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.290056 6273 tablet_bootstrap.cc:654] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.295132 6271 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:05.296545 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.296872 6271 tablet_bootstrap.cc:654] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:05.297384 5818 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.297524 5818 leader_election.cc:302] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.297987 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3a5246fa46e4753885784f87343c0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.298465 6827 raft_consensus.cc:2726] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.303256 6269 ts_tablet_manager.cc:1918] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.303543 6269 log.cc:1196] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:05.304011 6269 ts_tablet_manager.cc:1939] T dbd5d1ccd2e54f3884af3af327bb892e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.304999 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 511) took 2365 ms. Trace:
I20260928 10:44:05.305181 6269 rpcz_store.cc:276] 0928 10:44:02.939431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.947091 (+ 7660us) service_pool.cc:227] Handling call
0928 10:44:05.172945 (+2225854us) ts_tablet_manager.cc:1145] Deleting tablet dbd5d1ccd2e54f3884af3af327bb892e
0928 10:44:05.172956 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.263973 (+ 91017us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.303107 (+ 39134us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.304934 (+ 1827us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2174314}
I20260928 10:44:05.305830 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet dbd5d1ccd2e54f3884af3af327bb892e (table default.Table_dd487bf423e44aa3b7c72ea54b5f2283 [id=e00c83d4870444d3ab8051f21ece4c22]) successfully deleted
I20260928 10:44:05.306443 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 507) took 2408 ms. Trace:
W20260928 10:44:05.307122 6849 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:44:05.230734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.125:37939 (local address 127.5.100.67:41895)
0928 10:44:05.279229 (+ 48495us) negotiation.cc:107] Waiting for socket to connect
0928 10:44:05.279250 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0928 10:44:05.279387 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 10:44:05.306752 (+ 27365us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":48352,"thread_start_us":48751,"threads_started":1}
I20260928 10:44:05.308208 6269 rpcz_store.cc:276] 0928 10:44:02.898262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.961112 (+ 62850us) service_pool.cc:227] Handling call
0928 10:44:05.306254 (+2345142us) ts_tablet_manager.cc:1145] Deleting tablet c00ec4cec42a48388360e8723283829b
0928 10:44:05.306267 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.306394 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2307465}
W20260928 10:44:05.309144 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c00ec4cec42a48388360e8723283829b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00ec4cec42a48388360e8723283829b already in progress: creating tablet
I20260928 10:44:05.309651 6269 tablet_replica.cc:330] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.310012 6269 raft_consensus.cc:2229] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.310345 6269 raft_consensus.cc:2258] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.311024 6269 ts_tablet_manager.cc:1905] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.312769 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_34c0c54e906048a6981e6e89da155bc0" } modify_external_catalogs: true
I20260928 10:44:05.313011 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_34c0c54e906048a6981e6e89da155bc0" } modify_external_catalogs: true
I20260928 10:44:05.309772 6272 ts_tablet_manager.cc:1918] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.330717 6272 log.cc:1196] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/118ae3f8af264a31b7c22403c4951bdf
I20260928 10:44:05.331033 6269 ts_tablet_manager.cc:1918] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.331271 6272 ts_tablet_manager.cc:1939] T 118ae3f8af264a31b7c22403c4951bdf P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.332038 6272 tablet_replica.cc:330] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:05.332399 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 47832.6us
I20260928 10:44:05.334154 6272 raft_consensus.cc:2229] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:05.335093 6847 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:44:05.216003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.125:37939 (local address 127.5.100.66:45795)
0928 10:44:05.334745 (+118742us) negotiation.cc:107] Waiting for socket to connect
0928 10:44:05.334883 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":118603,"threads_started":1}
I20260928 10:44:05.335906 6272 raft_consensus.cc:2258] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.340227 6270 ts_tablet_manager.cc:1918] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.340507 6270 log.cc:1196] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/b2d841c2f9b844208173f982b9eb7818
I20260928 10:44:05.340878 6270 ts_tablet_manager.cc:1939] T b2d841c2f9b844208173f982b9eb7818 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.341758 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 553) took 1457 ms. Trace:
I20260928 10:44:05.344055 6269 log.cc:1196] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:05.344520 6269 ts_tablet_manager.cc:1939] T cd13e6a9d8f04fa3abb8d22a80932dae P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.345341 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 512) took 2405 ms. Trace:
I20260928 10:44:05.345520 6269 rpcz_store.cc:276] 0928 10:44:02.939510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.961735 (+ 22225us) service_pool.cc:227] Handling call
0928 10:44:05.309554 (+2347819us) ts_tablet_manager.cc:1145] Deleting tablet cd13e6a9d8f04fa3abb8d22a80932dae
0928 10:44:05.309569 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.327858 (+ 18289us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.330882 (+ 3024us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.345305 (+ 14423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2277100}
I20260928 10:44:05.346825 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet cd13e6a9d8f04fa3abb8d22a80932dae (table default.Table_30de79cdae684abc96a9f7a080d00f02 [id=4a75e89669ef4e509eb3d9b832262916]) successfully deleted
I20260928 10:44:05.347270 6269 tablet_replica.cc:330] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.347527 6269 raft_consensus.cc:2229] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.347745 6269 raft_consensus.cc:2258] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.353837 6269 ts_tablet_manager.cc:1905] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.338809 6273 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.355645 6273 ts_tablet_manager.cc:1397] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.001s
I20260928 10:44:05.356501 6273 raft_consensus.cc:348] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.356745 6273 raft_consensus.cc:374] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.356882 6273 raft_consensus.cc:729] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.357184 6273 consensus_queue.cc:260] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.357834 6273 ts_tablet_manager.cc:1428] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:05.358963 6272 ts_tablet_manager.cc:1905] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.362569 6270 rpcz_store.cc:276] 0928 10:44:03.884027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.884081 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:05.202123 (+1318042us) ts_tablet_manager.cc:1145] Deleting tablet b2d841c2f9b844208173f982b9eb7818
0928 10:44:05.202137 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.304078 (+101941us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.340095 (+ 36017us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.341702 (+ 1607us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1316590}
I20260928 10:44:05.363893 6273 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.364321 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet b2d841c2f9b844208173f982b9eb7818 (table default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]) successfully deleted
W20260928 10:44:05.355392 5955 consensus_peers.cc:487] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 780707959e0e48d6a83b22e6479a5884. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:05.346971 6271 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.365077 6275 tablet_bootstrap.cc:492] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.365128 6271 ts_tablet_manager.cc:1397] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
I20260928 10:44:05.365232 6275 ts_tablet_manager.cc:1397] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.188s user 0.041s sys 0.082s
I20260928 10:44:05.365980 6275 raft_consensus.cc:348] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.366219 6275 raft_consensus.cc:374] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.366324 6275 raft_consensus.cc:729] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.366158 6271 raft_consensus.cc:348] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.366671 6271 raft_consensus.cc:374] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.366799 6271 raft_consensus.cc:729] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.367098 6271 consensus_queue.cc:260] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.367192 6275 consensus_queue.cc:260] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.368278 6275 ts_tablet_manager.cc:1428] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:05.369004 6275 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.370520 6793 raft_consensus.cc:482] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.370700 6275 tablet_bootstrap.cc:654] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.370666 6793 raft_consensus.cc:504] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.371217 6793 leader_election.cc:288] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:05.374058 5957 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e25db69b15eb445792e6168f99304bf2
I20260928 10:44:05.375207 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25db69b15eb445792e6168f99304bf2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.375824 5955 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.375986 5955 leader_election.cc:302] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.376269 6793 raft_consensus.cc:2726] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.377280 6271 ts_tablet_manager.cc:1428] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260928 10:44:05.381801 6273 tablet_bootstrap.cc:654] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.383052 6271 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:05.385046 6271 tablet_bootstrap.cc:654] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:05.390189 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4ddf3ba4d594607b3fc3ae96797bd03 has no consensus state
W20260928 10:44:05.390377 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 383eb18f1c0c46209ff5b47e468b9950 consensus state has no leader
I20260928 10:44:05.390905 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_61f4d2d6955a481097b344272b388925" } new_table_name: "default.Table_c08de4d3d9ce4f20bed63a830c987c35" modify_external_catalogs: true
I20260928 10:44:05.392168 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_63fa40ed403746539e45b1b98250d0c5" } new_table_name: "default.Table_da453b1c08bf4157826d53f8fc65d2e5" modify_external_catalogs: true
I20260928 10:44:05.395537 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet db824b43256640e9bfef44da1ccf8e1a from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.396097 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6063c7c57810402b9a28be794c2fe2f4" } modify_external_catalogs: true
I20260928 10:44:05.396258 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6063c7c57810402b9a28be794c2fe2f4" } modify_external_catalogs: true
I20260928 10:44:05.402346 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 03ebfc156361479c909ff263c3be4601
I20260928 10:44:05.402889 5698 catalog_manager.cc:6565] ReplaceTablet: tablet 03ebfc156361479c909ff263c3be4601 deleted and replaced by tablet e94c1f9d646646d88e675d56046c5392
I20260928 10:44:05.404488 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7f8750cfcc114e129f68d52b41c70a46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.405139 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f8750cfcc114e129f68d52b41c70a46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.406375 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7c3bf7a6b83344c886362cc216c9e26e
I20260928 10:44:05.407035 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9b2a4e1e67c04db091c4a34ea453abfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.407536 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b2a4e1e67c04db091c4a34ea453abfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.408929 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4b775dafa08f42cc9c34848213b744ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.409449 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b775dafa08f42cc9c34848213b744ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.410588 5700 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2c84caa3220d4ba5b53dbac07a897d16
I20260928 10:44:05.410967 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8037e52845d14b45a299988713dc062b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.411469 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8037e52845d14b45a299988713dc062b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.412853 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7f29612692c449a4b55e3c61b0995a1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.413297 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f29612692c449a4b55e3c61b0995a1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.414362 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2eded874aa094054b0c2e7c2e592dba1
I20260928 10:44:05.415004 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.415450 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.416579 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 118ae3f8af264a31b7c22403c4951bdf (table default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9 [id=c8d4a6587af14ea39b7ace0ce005588b]) successfully deleted
I20260928 10:44:05.418032 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ebfc156361479c909ff263c3be4601 with delete_type TABLET_DATA_DELETED (replaced by tablet e94c1f9d646646d88e675d56046c5392) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.418291 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:05.418747 5686 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939): Couldn't send request to peer 7a1529a7b0d7479db7dabebf471795b5. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:05.420051 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet a380da90a76545dba647e0c1b3e05acd with delete_type TABLET_DATA_DELETED (replaced by tablet c5c1a1c5e22e455d91de92f0aa3535c7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.418591 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.421979 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1d0584d6b80e43eb913c3932256cd89e
I20260928 10:44:05.422646 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:05.426096 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet d39e1e4d18d6450580e28614ae4c2895 (table default.Table_a4e91262b8494ef28c172b832589e2c1 [id=db68c7086ebf437fa18f398767d98b0a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d39e1e4d18d6450580e28614ae4c2895 consensus state has no leader
I20260928 10:44:05.434804 6272 ts_tablet_manager.cc:1918] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.436352 6272 log.cc:1196] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/75ccd6efe3854d65995b17a38d81eaa5
I20260928 10:44:05.436856 6272 ts_tablet_manager.cc:1939] T 75ccd6efe3854d65995b17a38d81eaa5 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.437924 6272 tablet_replica.cc:330] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.437978 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 37a685d70ec44acb9f9ffadec2105307
W20260928 10:44:05.438088 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb5eed4318fe482789fee32e24a49bfc consensus state has no leader
I20260928 10:44:05.438197 6272 raft_consensus.cc:2229] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.436201 6275 tablet_bootstrap.cc:492] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.438792 6275 ts_tablet_manager.cc:1397] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.070s user 0.008s sys 0.026s
I20260928 10:44:05.438894 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_09beab8bce2441ef9483b354af9ecbc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.439543 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09beab8bce2441ef9483b354af9ecbc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.439884 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:05.439679 6275 raft_consensus.cc:348] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.440086 6275 raft_consensus.cc:374] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.440168 6275 raft_consensus.cc:729] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.440367 6275 consensus_queue.cc:260] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.440654 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 975fffba16ba46a295df724d65cf319a from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.440891 6275 ts_tablet_manager.cc:1428] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260928 10:44:05.441802 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15f3f3bff84a416494431a19887bb88d consensus state has no leader
I20260928 10:44:05.442380 6275 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.443840 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 75ccd6efe3854d65995b17a38d81eaa5 (table default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]) successfully deleted
I20260928 10:44:05.444164 6275 tablet_bootstrap.cc:654] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.445107 6272 raft_consensus.cc:2258] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.446652 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a685d70ec44acb9f9ffadec2105307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.449326 6548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:05.449595 6548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:44:05.449654 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet a4ed61f43d5d4a6fa21eb854dae895d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.452574 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ac7d5d88ccd34b58b200efcbbfb94173" } new_table_name: "default.Table_54aa2c9cbabd4ed5a56af1cd2080d610" modify_external_catalogs: true
I20260928 10:44:05.457718 6272 ts_tablet_manager.cc:1905] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.467093 6275 tablet_bootstrap.cc:492] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.467284 6275 ts_tablet_manager.cc:1397] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.007s
I20260928 10:44:05.468097 6275 raft_consensus.cc:348] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.468341 6275 raft_consensus.cc:374] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.468441 6275 raft_consensus.cc:729] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.468739 6272 ts_tablet_manager.cc:1918] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.468674 6275 consensus_queue.cc:260] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.468878 6272 log.cc:1196] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/5a51d9a67e15479587ab2d5a492bb7c2
I20260928 10:44:05.469270 6275 ts_tablet_manager.cc:1428] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:05.476789 6272 ts_tablet_manager.cc:1939] T 5a51d9a67e15479587ab2d5a492bb7c2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.476868 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 87d5dd4e5b544262938b1822510d8b9f from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.477921 6275 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:05.480669 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7b83cabf9a844139e74b8b73200645b has no consensus state
I20260928 10:44:05.481019 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 975fffba16ba46a295df724d65cf319a
I20260928 10:44:05.481091 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d841c2f9b844208173f982b9eb7818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.482101 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 975fffba16ba46a295df724d65cf319a deleted and replaced by tablet bb1b5a7494414c3ba3f2b176cde0eeb5
I20260928 10:44:05.482095 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 975fffba16ba46a295df724d65cf319a with delete_type TABLET_DATA_DELETED (replaced by tablet bb1b5a7494414c3ba3f2b176cde0eeb5) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.484004 6275 tablet_bootstrap.cc:654] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.488319 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet a4ed61f43d5d4a6fa21eb854dae895d8 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.488636 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 5a51d9a67e15479587ab2d5a492bb7c2 (table default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]) successfully deleted
I20260928 10:44:05.488992 6272 tablet_replica.cc:330] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.489223 6272 raft_consensus.cc:2229] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.489507 6272 raft_consensus.cc:2258] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.490245 6272 ts_tablet_manager.cc:1905] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.367027 6269 ts_tablet_manager.cc:1918] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.494314 6269 log.cc:1196] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:05.494760 6269 ts_tablet_manager.cc:1939] T e2d38c0ed54b45a89f8e1daefd5b67a1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.495438 6737 raft_consensus.cc:482] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.495633 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 513) took 2555 ms. Trace:
I20260928 10:44:05.495615 6737 raft_consensus.cc:504] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.495725 6269 rpcz_store.cc:276] 0928 10:44:02.939607 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.968115 (+ 28508us) service_pool.cc:227] Handling call
0928 10:44:05.347201 (+2379086us) ts_tablet_manager.cc:1145] Deleting tablet e2d38c0ed54b45a89f8e1daefd5b67a1
0928 10:44:05.347213 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.363718 (+ 16505us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.366896 (+ 3178us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.495570 (+128674us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2314680}
I20260928 10:44:05.496112 6269 tablet_replica.cc:330] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.496274 6737 leader_election.cc:288] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:05.496315 6269 raft_consensus.cc:2229] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.496527 6269 raft_consensus.cc:2258] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.497047 6272 ts_tablet_manager.cc:1918] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.497097 6269 ts_tablet_manager.cc:1905] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.497202 6272 log.cc:1196] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/971f8344436f4e60ac0152e811efea8d
I20260928 10:44:05.497617 6272 ts_tablet_manager.cc:1939] T 971f8344436f4e60ac0152e811efea8d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:05.497627 6091 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:05.404544 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ebfc156361479c909ff263c3be4601 with delete_type TABLET_DATA_DELETED (replaced by tablet e94c1f9d646646d88e675d56046c5392) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.421710 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.421872 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.425602 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.425836 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.445094 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a685d70ec44acb9f9ffadec2105307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.481930 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 975fffba16ba46a295df724d65cf319a with delete_type TABLET_DATA_DELETED (replaced by tablet bb1b5a7494414c3ba3f2b176cde0eeb5) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:05.499150 6090 leader_election.cc:341] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:05.499321 6090 leader_election.cc:302] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.499310 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (table default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]) successfully deleted
I20260928 10:44:05.499722 6737 raft_consensus.cc:2726] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.499900 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 971f8344436f4e60ac0152e811efea8d (table default.Table_64f2ffa93db34653b515aa6d668ed2a2 [id=8864e41fe4f24b709e61352c0b6d0e2b]) successfully deleted
W20260928 10:44:05.500715 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 03ebfc156361479c909ff263c3be4601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ebfc156361479c909ff263c3be4601 already in progress: creating tablet
W20260928 10:44:05.501386 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7c3bf7a6b83344c886362cc216c9e26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3bf7a6b83344c886362cc216c9e26e already in progress: creating tablet
I20260928 10:44:05.501832 6272 tablet_replica.cc:330] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.502166 6272 raft_consensus.cc:2229] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.502425 6272 raft_consensus.cc:2258] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.503332 6272 ts_tablet_manager.cc:1905] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.504558 6269 ts_tablet_manager.cc:1918] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:05.504688 6269 log.cc:1196] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d103af0b1cb24cda882cc2e3d95a558d
I20260928 10:44:05.505100 6269 ts_tablet_manager.cc:1939] T d103af0b1cb24cda882cc2e3d95a558d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.505805 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 514) took 2543 ms. Trace:
I20260928 10:44:05.505944 6269 rpcz_store.cc:276] 0928 10:44:02.962463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:02.969314 (+ 6851us) service_pool.cc:227] Handling call
0928 10:44:05.496008 (+2526694us) ts_tablet_manager.cc:1145] Deleting tablet d103af0b1cb24cda882cc2e3d95a558d
0928 10:44:05.496019 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.501485 (+ 5466us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.504435 (+ 2950us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.505765 (+ 1330us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463417}
I20260928 10:44:05.506865 6118 tablet_service.cc:1467] Processing CreateTablet for tablet a7b83cabf9a844139e74b8b73200645b (DEFAULT_TABLE table=default.Table_54aa2c9cbabd4ed5a56af1cd2080d610 [id=a73833a15ef140de92e0ba4b6d51d6d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.506845 5848 tablet_service.cc:1467] Processing CreateTablet for tablet a7b83cabf9a844139e74b8b73200645b (DEFAULT_TABLE table=default.Table_54aa2c9cbabd4ed5a56af1cd2080d610 [id=a73833a15ef140de92e0ba4b6d51d6d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.507313 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b83cabf9a844139e74b8b73200645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.507320 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 374a90b1d7f24b84a32a571ea9e781a6 (DEFAULT_TABLE table=default.Table_cfde87d7ea184dada39c96e04bfaf744 [id=0c09e453278842b580bc4bbcd6abbda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.507328 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b83cabf9a844139e74b8b73200645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.509948 6272 ts_tablet_manager.cc:1918] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.510078 6272 log.cc:1196] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a380da90a76545dba647e0c1b3e05acd
I20260928 10:44:05.510437 6272 ts_tablet_manager.cc:1939] T a380da90a76545dba647e0c1b3e05acd P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.512563 5994 tablet_service.cc:1467] Processing CreateTablet for tablet a7b83cabf9a844139e74b8b73200645b (DEFAULT_TABLE table=default.Table_54aa2c9cbabd4ed5a56af1cd2080d610 [id=a73833a15ef140de92e0ba4b6d51d6d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.512676 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 374a90b1d7f24b84a32a571ea9e781a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.512971 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b83cabf9a844139e74b8b73200645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.515102 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 374a90b1d7f24b84a32a571ea9e781a6 (DEFAULT_TABLE table=default.Table_cfde87d7ea184dada39c96e04bfaf744 [id=0c09e453278842b580bc4bbcd6abbda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.515643 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 374a90b1d7f24b84a32a571ea9e781a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.516812 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 515) took 2453 ms. Trace:
I20260928 10:44:05.516975 6269 rpcz_store.cc:276] 0928 10:44:03.062964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.071710 (+ 8746us) service_pool.cc:227] Handling call
0928 10:44:05.516616 (+2444906us) ts_tablet_manager.cc:1145] Deleting tablet 78295825061a4d75984e2d6e110e1c55
0928 10:44:05.516629 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.516772 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2444629}
I20260928 10:44:05.517344 6269 tablet_replica.cc:330] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.517586 6269 raft_consensus.cc:2229] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.517791 6269 raft_consensus.cc:2258] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.518394 6269 ts_tablet_manager.cc:1905] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.519140 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d103af0b1cb24cda882cc2e3d95a558d (table default.Table_ac97228d056a4e5c94a51b6decaf589f [id=cf392bda49fa4d0f925d9b807d1b2d39]) successfully deleted
W20260928 10:44:05.519515 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 78295825061a4d75984e2d6e110e1c55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78295825061a4d75984e2d6e110e1c55 already in progress: creating tablet
I20260928 10:44:05.511327 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 374a90b1d7f24b84a32a571ea9e781a6 (DEFAULT_TABLE table=default.Table_cfde87d7ea184dada39c96e04bfaf744 [id=0c09e453278842b580bc4bbcd6abbda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.520416 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 374a90b1d7f24b84a32a571ea9e781a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.521472 6272 tablet_replica.cc:330] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.521699 6272 raft_consensus.cc:2229] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.521890 6272 raft_consensus.cc:2258] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.523269 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a380da90a76545dba647e0c1b3e05acd (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
W20260928 10:44:05.523592 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2eded874aa094054b0c2e7c2e592dba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2eded874aa094054b0c2e7c2e592dba1 already in progress: creating tablet
W20260928 10:44:05.523797 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1d0584d6b80e43eb913c3932256cd89e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0584d6b80e43eb913c3932256cd89e already in progress: creating tablet
W20260928 10:44:05.523980 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 37a685d70ec44acb9f9ffadec2105307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37a685d70ec44acb9f9ffadec2105307 already in progress: creating tablet
I20260928 10:44:05.527616 6271 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.527833 6271 ts_tablet_manager.cc:1397] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.145s user 0.003s sys 0.001s
I20260928 10:44:05.528651 6271 raft_consensus.cc:348] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.528928 6271 raft_consensus.cc:374] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.529012 6271 raft_consensus.cc:729] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.529251 6271 consensus_queue.cc:260] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.530633 6273 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.530810 6273 ts_tablet_manager.cc:1397] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.167s user 0.004s sys 0.001s
I20260928 10:44:05.531613 6273 raft_consensus.cc:348] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.531863 6273 raft_consensus.cc:374] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.531814 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecf9d689328472794664ee7c14e4d52 (DEFAULT_TABLE table=default.Table_971a8f1c1bc840f992dbf5d357debe39 [id=263c8e3a19504ca2a67eee8214cc0d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.531951 6273 raft_consensus.cc:729] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.532258 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecf9d689328472794664ee7c14e4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.532177 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecf9d689328472794664ee7c14e4d52 (DEFAULT_TABLE table=default.Table_971a8f1c1bc840f992dbf5d357debe39 [id=263c8e3a19504ca2a67eee8214cc0d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.532227 6273 consensus_queue.cc:260] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.534137 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecf9d689328472794664ee7c14e4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.535022 6273 ts_tablet_manager.cc:1428] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:05.535374 6273 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.537953 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.538432 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.547680 6273 tablet_bootstrap.cc:654] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.548992 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 0471473cce114d3985f9a8de2de77d39 (DEFAULT_TABLE table=default.Table_c3a7ffcfabd046f48449d8826b03ad9e [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.549077 6271 ts_tablet_manager.cc:1428] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260928 10:44:05.549124 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 20d2496eaae44b02852cfdc928c7f172 (DEFAULT_TABLE table=default.Table_9cd9abadc5e546f8b73c683c41c6c1b8 [id=d25c509c00af44d99164d9856871fe1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.549316 6272 ts_tablet_manager.cc:1905] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.549425 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471473cce114d3985f9a8de2de77d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.549710 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 (DEFAULT_TABLE table=default.Table_f4ec87e39b70409fa42c35946fa4269e [id=af84e50e37a94f26b2e0f214e010cc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.550060 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.552850 6271 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:05.554621 6271 tablet_bootstrap.cc:654] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.554895 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 9381f40c881d45a18a6a6449d3294055 (DEFAULT_TABLE table=default.Table_9739c0bb9db8453bb01925f26e19cd83 [id=17548c2bc7d443169b48ccc5d717313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.555341 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9381f40c881d45a18a6a6449d3294055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.556324 6275 tablet_bootstrap.cc:492] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.556519 6275 ts_tablet_manager.cc:1397] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.019s
I20260928 10:44:05.557456 6272 ts_tablet_manager.cc:1918] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.557298 6275 raft_consensus.cc:348] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.557765 6275 raft_consensus.cc:374] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.557890 6275 raft_consensus.cc:729] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.558240 6275 consensus_queue.cc:260] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.558521 6119 tablet_service.cc:1467] Processing CreateTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 (DEFAULT_TABLE table=default.Table_48c975dd6a964ba3872c1953b0008bf0 [id=17616ea443ad4eb3bf8a914f3e4b090e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.558929 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ddf3ba4d594607b3fc3ae96797bd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.559283 6275 ts_tablet_manager.cc:1428] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:05.560423 6275 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.562304 6275 tablet_bootstrap.cc:654] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.562973 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d2496eaae44b02852cfdc928c7f172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.568243 6273 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.568410 6273 ts_tablet_manager.cc:1397] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260928 10:44:05.569231 6273 raft_consensus.cc:348] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.569448 6273 raft_consensus.cc:374] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.569542 6273 raft_consensus.cc:729] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.569743 6273 consensus_queue.cc:260] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.570130 6269 ts_tablet_manager.cc:1918] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.570289 6269 log.cc:1196] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:05.557614 6272 log.cc:1196] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a4ed61f43d5d4a6fa21eb854dae895d8
I20260928 10:44:05.570657 6269 ts_tablet_manager.cc:1939] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.571103 6272 ts_tablet_manager.cc:1939] T a4ed61f43d5d4a6fa21eb854dae895d8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.572062 6272 tablet_replica.cc:330] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.572499 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.572772 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 20d2496eaae44b02852cfdc928c7f172 (DEFAULT_TABLE table=default.Table_9cd9abadc5e546f8b73c683c41c6c1b8 [id=d25c509c00af44d99164d9856871fe1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.572901 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.573163 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d2496eaae44b02852cfdc928c7f172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.574524 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.575300 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a4ed61f43d5d4a6fa21eb854dae895d8 (table default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]) successfully deleted
I20260928 10:44:05.576050 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f72ff466e4befb74290fd39285119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4a973a1d20e3437c87ad889c723e7ebc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.577751 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 (DEFAULT_TABLE table=default.Table_f4ec87e39b70409fa42c35946fa4269e [id=af84e50e37a94f26b2e0f214e010cc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.578174 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.581822 6272 raft_consensus.cc:2229] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.582085 6272 raft_consensus.cc:2258] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.582757 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 0471473cce114d3985f9a8de2de77d39 (DEFAULT_TABLE table=default.Table_c3a7ffcfabd046f48449d8826b03ad9e [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.582985 6272 ts_tablet_manager.cc:1905] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.583122 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471473cce114d3985f9a8de2de77d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.586752 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 9381f40c881d45a18a6a6449d3294055 (DEFAULT_TABLE table=default.Table_9739c0bb9db8453bb01925f26e19cd83 [id=17548c2bc7d443169b48ccc5d717313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.587131 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9381f40c881d45a18a6a6449d3294055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.588811 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecf9d689328472794664ee7c14e4d52 (DEFAULT_TABLE table=default.Table_971a8f1c1bc840f992dbf5d357debe39 [id=263c8e3a19504ca2a67eee8214cc0d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.589182 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 20d2496eaae44b02852cfdc928c7f172 (DEFAULT_TABLE table=default.Table_9cd9abadc5e546f8b73c683c41c6c1b8 [id=d25c509c00af44d99164d9856871fe1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.589423 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.589898 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 (DEFAULT_TABLE table=default.Table_f4ec87e39b70409fa42c35946fa4269e [id=af84e50e37a94f26b2e0f214e010cc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.589202 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecf9d689328472794664ee7c14e4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.590363 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 0471473cce114d3985f9a8de2de77d39 (DEFAULT_TABLE table=default.Table_c3a7ffcfabd046f48449d8826b03ad9e [id=742b25738289453d88e91cc9849a7eb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.590682 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471473cce114d3985f9a8de2de77d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.590788 5854 tablet_service.cc:1467] Processing CreateTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 (DEFAULT_TABLE table=default.Table_48c975dd6a964ba3872c1953b0008bf0 [id=17616ea443ad4eb3bf8a914f3e4b090e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.591117 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ddf3ba4d594607b3fc3ae96797bd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.594632 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d2496eaae44b02852cfdc928c7f172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.594884 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.595316 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 9381f40c881d45a18a6a6449d3294055 (DEFAULT_TABLE table=default.Table_9739c0bb9db8453bb01925f26e19cd83 [id=17548c2bc7d443169b48ccc5d717313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.595757 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9381f40c881d45a18a6a6449d3294055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.417798 6793 raft_consensus.cc:482] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.596221 6793 raft_consensus.cc:504] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.596992 6793 leader_election.cc:288] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.598345 6827 raft_consensus.cc:482] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.598527 6827 raft_consensus.cc:504] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.599167 6827 leader_election.cc:288] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.426903 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3bf7a6b83344c886362cc216c9e26e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.427073 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.427207 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.427387 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ebfc156361479c909ff263c3be4601 with delete_type TABLET_DATA_DELETED (replaced by tablet e94c1f9d646646d88e675d56046c5392) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.450312 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a685d70ec44acb9f9ffadec2105307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.482705 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 975fffba16ba46a295df724d65cf319a with delete_type TABLET_DATA_DELETED (replaced by tablet bb1b5a7494414c3ba3f2b176cde0eeb5) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.485834 6792 raft_consensus.cc:482] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.599960 6792 raft_consensus.cc:504] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.600251 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4aa2279fd7f446ab9d4110a026c09706"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.600590 6792 leader_election.cc:288] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.486545 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:05.600852 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aa2279fd7f446ab9d4110a026c09706 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.601104 5985 tablet_service.cc:1467] Processing CreateTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 (DEFAULT_TABLE table=default.Table_48c975dd6a964ba3872c1953b0008bf0 [id=17616ea443ad4eb3bf8a914f3e4b090e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.601581 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ddf3ba4d594607b3fc3ae96797bd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.602295 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.492861 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.594569 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.603586 6792 raft_consensus.cc:482] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.603734 6792 raft_consensus.cc:504] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.604323 6792 leader_election.cc:288] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.606137 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2d2474fbee91493e81f8329da40be4c3" } new_table_name: "default.Table_0d618d28e1ed430ba13e26013a6e4a78" modify_external_catalogs: true
I20260928 10:44:05.606686 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_19bc838ee7264d68bb6451efa0fce66f" } new_table_name: "default.Table_79deab792b4344e281995d6a3cf65486" modify_external_catalogs: true
I20260928 10:44:05.612325 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86b16eb36c034591ac1603ab84fd9342" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.612975 5817 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.613248 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01f1354d2ff6487a90ac060ac64c8723"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.613924 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01f1354d2ff6487a90ac060ac64c8723 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.615059 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40123712b17464e87023f69a6235640" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.616604 5955 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.618498 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b73a1edf5a204eaea434f196b48efb2b" } modify_external_catalogs: true
I20260928 10:44:05.618650 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733ca22794da4015bbe09ed6c374ad05" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.618721 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b73a1edf5a204eaea434f196b48efb2b" } modify_external_catalogs: true
I20260928 10:44:05.619068 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d38c0ed54b45a89f8e1daefd5b67a1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.619544 5955 leader_election.cc:341] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:05.619853 5955 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.620043 6827 raft_consensus.cc:482] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.620208 6827 raft_consensus.cc:504] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.620844 6827 leader_election.cc:288] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.621847 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.622435 5817 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.623461 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.623698 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_09beab8bce2441ef9483b354af9ecbc7" } modify_external_catalogs: true
I20260928 10:44:05.623905 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_09beab8bce2441ef9483b354af9ecbc7" } modify_external_catalogs: true
I20260928 10:44:05.383318 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 552) took 1499 ms. Trace:
I20260928 10:44:05.629136 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8e39f8abe6304e5e820a8c3550ac7f39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.629822 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e39f8abe6304e5e820a8c3550ac7f39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.631142 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4a0284bba8ca439b994fe58c3a2f38e2" } modify_external_catalogs: true
I20260928 10:44:05.631366 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4a0284bba8ca439b994fe58c3a2f38e2" } modify_external_catalogs: true
I20260928 10:44:05.632014 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c05f29ca725a46b4bef695b530735cf1" } modify_external_catalogs: true
I20260928 10:44:05.632230 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c05f29ca725a46b4bef695b530735cf1" } modify_external_catalogs: true
I20260928 10:44:05.642765 6273 ts_tablet_manager.cc:1428] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.074s user 0.002s sys 0.000s
I20260928 10:44:05.646461 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc" } new_table_name: "default.Table_2c752d706211447a99440f2b3234b2e4" modify_external_catalogs: true
W20260928 10:44:05.647395 5957 leader_election.cc:341] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 733ca22794da4015bbe09ed6c374ad05
I20260928 10:44:05.647583 5957 leader_election.cc:302] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:05.648036 5957 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d40123712b17464e87023f69a6235640
I20260928 10:44:05.648175 5957 leader_election.cc:302] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.648233 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e980d7f015ba49d1b8b828e2d1f89593" } modify_external_catalogs: true
I20260928 10:44:05.648452 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e980d7f015ba49d1b8b828e2d1f89593" } modify_external_catalogs: true
W20260928 10:44:05.648533 5957 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:05.648629 5957 leader_election.cc:302] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.648893 6793 raft_consensus.cc:2726] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.649111 6793 raft_consensus.cc:2726] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.648913 6792 raft_consensus.cc:2726] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.649400 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.649396 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86b16eb36c034591ac1603ab84fd9342" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.651352 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 516) took 2511 ms. Trace:
I20260928 10:44:05.652114 6269 rpcz_store.cc:276] 0928 10:44:03.139939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.139995 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:05.517279 (+2377284us) ts_tablet_manager.cc:1145] Deleting tablet 3d5b422c70a84cc0bc9f8a686f4e2c82
0928 10:44:05.517290 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.521568 (+ 4278us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.570015 (+ 48447us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.651286 (+ 81271us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2377072}
I20260928 10:44:05.653070 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (table default.Table_de468dcafe554bba9d4279813098e5d5 [id=92f40b0873ca472db40650520fdfa06a]) successfully deleted
I20260928 10:44:05.656695 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d (DEFAULT_TABLE table=default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc [id=74a6cd3295ef40c59dced11d7bfe38d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.657359 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.659801 5818 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.659962 5818 leader_election.cc:302] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.660254 6827 raft_consensus.cc:2726] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:05.660413 5818 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.660526 5818 leader_election.cc:302] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.660786 6827 raft_consensus.cc:2726] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.661441 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cfde87d7ea184dada39c96e04bfaf744" } new_table_name: "default.Table_0a3842cded6d42dd87e750ca24e8d371" modify_external_catalogs: true
I20260928 10:44:05.651654 6270 rpcz_store.cc:276] 0928 10:44:03.883860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.892937 (+ 9077us) service_pool.cc:227] Handling call
0928 10:44:05.377485 (+1484548us) ts_tablet_manager.cc:1145] Deleting tablet 3abfedf425b84f679b22d6ca9bef718a
0928 10:44:05.383162 (+ 5677us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.383269 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1481301}
W20260928 10:44:05.662824 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 024c12c4a3d44c21b6bccc69b92a6323 consensus state has no leader
I20260928 10:44:05.665660 5848 tablet_service.cc:1467] Processing CreateTablet for tablet e94c1f9d646646d88e675d56046c5392 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.666105 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94c1f9d646646d88e675d56046c5392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.666688 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 556) took 1697 ms. Trace:
I20260928 10:44:05.666829 6270 rpcz_store.cc:276] 0928 10:44:03.968771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.968830 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:05.662909 (+1694079us) ts_tablet_manager.cc:1145] Deleting tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d
0928 10:44:05.662925 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.666618 (+ 3693us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1693797}
I20260928 10:44:05.667317 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 557) took 1660 ms. Trace:
I20260928 10:44:05.667409 6270 rpcz_store.cc:276] 0928 10:44:04.006647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.018022 (+ 11375us) service_pool.cc:227] Handling call
0928 10:44:05.667138 (+1649116us) ts_tablet_manager.cc:1145] Deleting tablet e6bd816447ad4a58b679f83b8acbb4b5
0928 10:44:05.667151 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.667264 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1648857}
I20260928 10:44:05.667755 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 571) took 1556 ms. Trace:
I20260928 10:44:05.667848 6270 rpcz_store.cc:276] 0928 10:44:04.111535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.111599 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:05.667601 (+1556002us) ts_tablet_manager.cc:1145] Deleting tablet 45a8098440fb4e919bc5e3f4dd3241a7
0928 10:44:05.667610 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.667693 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1555734}
I20260928 10:44:05.668222 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 572) took 1556 ms. Trace:
I20260928 10:44:05.668311 6270 rpcz_store.cc:276] 0928 10:44:04.111873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.111921 (+ 48us) service_pool.cc:227] Handling call
0928 10:44:05.668060 (+1556139us) ts_tablet_manager.cc:1145] Deleting tablet 493b1d0e0b884fdfbaa3eb6d55874f2e
0928 10:44:05.668069 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.668178 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1555903}
I20260928 10:44:05.668633 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 573) took 1532 ms. Trace:
I20260928 10:44:05.668718 6270 rpcz_store.cc:276] 0928 10:44:04.136213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.136270 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:05.668497 (+1532227us) ts_tablet_manager.cc:1145] Deleting tablet 2c683445c12e43cc9379bf465f7e252c
0928 10:44:05.668506 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.668586 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1531996}
I20260928 10:44:05.668995 6270 tablet_replica.cc:330] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:05.669202 6270 raft_consensus.cc:2229] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.669391 6270 raft_consensus.cc:2258] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.669987 6270 ts_tablet_manager.cc:1905] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.671375 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 30889bfbf1894e74ac6555c0cabc529c (DEFAULT_TABLE table=default.Table_9b2a4e1e67c04db091c4a34ea453abfb [id=9836f23323714ee4914f99114c054cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.671797 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30889bfbf1894e74ac6555c0cabc529c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.675386 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd (DEFAULT_TABLE table=default.Table_09beab8bce2441ef9483b354af9ecbc7 [id=e9343c120c2549ebbc806c15cde3f207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.675804 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc439f216a04f2e861c2d87364eb3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.675756 5859 tablet_service.cc:1467] Processing CreateTablet for tablet bb1b5a7494414c3ba3f2b176cde0eeb5 (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.676081 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1b5a7494414c3ba3f2b176cde0eeb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.677927 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3abfedf425b84f679b22d6ca9bef718a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3abfedf425b84f679b22d6ca9bef718a already in progress: creating tablet
W20260928 10:44:05.678237 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d already in progress: creating tablet
W20260928 10:44:05.678419 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e6bd816447ad4a58b679f83b8acbb4b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bd816447ad4a58b679f83b8acbb4b5 already in progress: creating tablet
I20260928 10:44:05.675447 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 (DEFAULT_TABLE table=default.Table_7f8750cfcc114e129f68d52b41c70a46 [id=6d7a1571cf674d5b9381cdecd6c834a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.678606 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 45a8098440fb4e919bc5e3f4dd3241a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a8098440fb4e919bc5e3f4dd3241a7 already in progress: creating tablet
I20260928 10:44:05.678768 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.678777 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 493b1d0e0b884fdfbaa3eb6d55874f2e already in progress: creating tablet
W20260928 10:44:05.678920 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2c683445c12e43cc9379bf465f7e252c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c683445c12e43cc9379bf465f7e252c already in progress: creating tablet
I20260928 10:44:05.679983 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d (DEFAULT_TABLE table=default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc [id=74a6cd3295ef40c59dced11d7bfe38d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.680351 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.681387 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0795c9d84aac4678b774d26253e5791b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.681986 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0795c9d84aac4678b774d26253e5791b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.684098 5994 tablet_service.cc:1467] Processing CreateTablet for tablet be50535c36a54453b2a1a6d6d09207eb (DEFAULT_TABLE table=default.Table_df04fd38822944cc8bbfb2765e68488a [id=90dd5d6c0cbf4fc7b807d3a98612dd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.684151 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 977064ff0d5e4186b3e2556367c60805 (DEFAULT_TABLE table=default.Table_a11e380b1c87489488dab8b4580b38aa [id=95414f82d8354a33bbcad8b2f233c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.684479 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be50535c36a54453b2a1a6d6d09207eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.684485 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 977064ff0d5e4186b3e2556367c60805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.685241 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f71db539df0449a1bde6ce7863dbdff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.685724 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f71db539df0449a1bde6ce7863dbdff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.686272 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 11b732758c1f4565b3051309cdfd9649 (DEFAULT_TABLE table=default.Table_8037e52845d14b45a299988713dc062b [id=e04bd5c1b932479a97d6007603d8969d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.686614 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1312101176de4669988b8e0090027832"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.686776 5849 tablet_service.cc:1467] Processing CreateTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 (DEFAULT_TABLE table=default.Table_3bbdfde366124ee2b57a8e1eaca2e658 [id=24c00c4cd959457dad1ab7e6a5943c95]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.687080 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1312101176de4669988b8e0090027832 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.687151 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40b1b2d2377425d8e0a78da3f1c43a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.688441 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 3bf72559c7f74acd8f1e7fd88cc67f38 (DEFAULT_TABLE table=default.Table_7f29612692c449a4b55e3c61b0995a1d [id=19711a147f4a44a3b433468477ba670f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.688877 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bf72559c7f74acd8f1e7fd88cc67f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.690470 5995 tablet_service.cc:1467] Processing CreateTablet for tablet e94c1f9d646646d88e675d56046c5392 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.690922 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94c1f9d646646d88e675d56046c5392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.692983 6861 raft_consensus.cc:482] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.693152 6861 raft_consensus.cc:504] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.693894 6861 leader_election.cc:288] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.697310 5847 tablet_service.cc:1467] Processing CreateTablet for tablet be50535c36a54453b2a1a6d6d09207eb (DEFAULT_TABLE table=default.Table_df04fd38822944cc8bbfb2765e68488a [id=90dd5d6c0cbf4fc7b807d3a98612dd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.698261 5988 tablet_service.cc:1467] Processing CreateTablet for tablet bb1b5a7494414c3ba3f2b176cde0eeb5 (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.699275 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd (DEFAULT_TABLE table=default.Table_09beab8bce2441ef9483b354af9ecbc7 [id=e9343c120c2549ebbc806c15cde3f207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.699908 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 (DEFAULT_TABLE table=default.Table_7f8750cfcc114e129f68d52b41c70a46 [id=6d7a1571cf674d5b9381cdecd6c834a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.700270 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 30889bfbf1894e74ac6555c0cabc529c (DEFAULT_TABLE table=default.Table_9b2a4e1e67c04db091c4a34ea453abfb [id=9836f23323714ee4914f99114c054cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.703754 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92912af8cba4453a8e3422896d586855" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.704424 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 977064ff0d5e4186b3e2556367c60805 (DEFAULT_TABLE table=default.Table_a11e380b1c87489488dab8b4580b38aa [id=95414f82d8354a33bbcad8b2f233c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.705235 5957 leader_election.cc:341] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 92912af8cba4453a8e3422896d586855
I20260928 10:44:05.705443 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5bec611c95429ab309957f74b70eea (DEFAULT_TABLE table=default.Table_4b775dafa08f42cc9c34848213b744ba [id=90ada35eef5c42e195226ba9b6e0ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.705440 5955 leader_election.cc:341] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.706709 5955 leader_election.cc:302] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.706935 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1b5a7494414c3ba3f2b176cde0eeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.707216 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc439f216a04f2e861c2d87364eb3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.707494 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.707887 6272 ts_tablet_manager.cc:1918] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.708040 6272 log.cc:1196] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/b2d841c2f9b844208173f982b9eb7818
I20260928 10:44:05.708452 6272 ts_tablet_manager.cc:1939] T b2d841c2f9b844208173f982b9eb7818 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.709136 6272 tablet_replica.cc:330] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.709143 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11b732758c1f4565b3051309cdfd9649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.709338 6272 raft_consensus.cc:2229] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.709513 6272 raft_consensus.cc:2258] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.709913 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 3bf72559c7f74acd8f1e7fd88cc67f38 (DEFAULT_TABLE table=default.Table_7f29612692c449a4b55e3c61b0995a1d [id=19711a147f4a44a3b433468477ba670f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.710098 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30889bfbf1894e74ac6555c0cabc529c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.705070 6827 raft_consensus.cc:482] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.710770 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be50535c36a54453b2a1a6d6d09207eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.710804 6827 raft_consensus.cc:504] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.711267 6272 ts_tablet_manager.cc:1905] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.711651 6827 leader_election.cc:288] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.711781 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 11b732758c1f4565b3051309cdfd9649 (DEFAULT_TABLE table=default.Table_8037e52845d14b45a299988713dc062b [id=e04bd5c1b932479a97d6007603d8969d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.709900 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 3bf72559c7f74acd8f1e7fd88cc67f38 (DEFAULT_TABLE table=default.Table_7f29612692c449a4b55e3c61b0995a1d [id=19711a147f4a44a3b433468477ba670f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.712249 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11b732758c1f4565b3051309cdfd9649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.712368 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b4deb353974c8aae4bb8148869758d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.712518 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bf72559c7f74acd8f1e7fd88cc67f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.712752 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5bec611c95429ab309957f74b70eea (DEFAULT_TABLE table=default.Table_4b775dafa08f42cc9c34848213b744ba [id=90ada35eef5c42e195226ba9b6e0ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:05.713157 5817 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.713204 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5bec611c95429ab309957f74b70eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.713338 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5bec611c95429ab309957f74b70eea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.715536 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d consensus state has no leader
I20260928 10:44:05.716073 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_513b29114e86449fbb9605c07529bc8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.716629 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_513b29114e86449fbb9605c07529bc8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.720993 6861 raft_consensus.cc:2726] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.723781 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d (DEFAULT_TABLE table=default.Table_fcc9f0f8226a40e4a53fa2b81f6bc2cc [id=74a6cd3295ef40c59dced11d7bfe38d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.724483 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bf72559c7f74acd8f1e7fd88cc67f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.725538 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.726703 6275 tablet_bootstrap.cc:492] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.730659 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 30fb3f88e66b4f8582fb348e035af290
I20260928 10:44:05.731673 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_94ac43322633474fba62c1a5be97085b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.732337 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94ac43322633474fba62c1a5be97085b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.732957 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 734c09c7645c4dd3a05f6508297ee48b
I20260928 10:44:05.733651 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9cc439f216a04f2e861c2d87364eb3dd
I20260928 10:44:05.733891 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 66f13643dbb64dcf97c4d6d94c22d8b1
I20260928 10:44:05.734243 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c3a7ffcfabd046f48449d8826b03ad9e" } new_table_name: "default.Table_9f9ce53bc5bf4d87ae8e51adc7d25447" modify_external_catalogs: true
I20260928 10:44:05.734391 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6d4a32d90f93464e8962fdc09b63dd1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.734988 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d4a32d90f93464e8962fdc09b63dd1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:05.736219 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 374a90b1d7f24b84a32a571ea9e781a6 consensus state has no leader
I20260928 10:44:05.733671 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ece70b41d4eb46518b578adcd84e586d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.737747 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b6d5121db2d34ea99c851595c395f3be
W20260928 10:44:05.738044 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ece70b41d4eb46518b578adcd84e586d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.651997 6273 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.741856 6002 tablet_service.cc:1467] Processing CreateTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 (DEFAULT_TABLE table=default.Table_3bbdfde366124ee2b57a8e1eaca2e658 [id=24c00c4cd959457dad1ab7e6a5943c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.742626 6273 tablet_bootstrap.cc:654] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.743068 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 977064ff0d5e4186b3e2556367c60805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.743746 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 30fb3f88e66b4f8582fb348e035af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.745059 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet 30fb3f88e66b4f8582fb348e035af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.745294 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c09c7645c4dd3a05f6508297ee48b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.747486 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.747706 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.747857 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:05.747891 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b4deb353974c8aae4bb8148869758d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:05.748777 5818 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.748911 5818 leader_election.cc:302] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.749311 6827 raft_consensus.cc:2726] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.750953 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c09c7645c4dd3a05f6508297ee48b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.726841 6275 ts_tablet_manager.cc:1397] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.167s user 0.031s sys 0.044s
W20260928 10:44:05.751868 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0471473cce114d3985f9a8de2de77d39 consensus state has no leader
I20260928 10:44:05.754104 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.756580 6117 tablet_service.cc:1467] Processing CreateTablet for tablet e94c1f9d646646d88e675d56046c5392 (DEFAULT_TABLE table=default.Table_884fb10fbd3649ed8e069634d78d3042 [id=803cffb501814ffa9eb23a9ee59d801b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.757051 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94c1f9d646646d88e675d56046c5392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.759025 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:05.759354 5955 consensus_peers.cc:487] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:05.761854 6127 tablet_service.cc:1467] Processing CreateTablet for tablet be50535c36a54453b2a1a6d6d09207eb (DEFAULT_TABLE table=default.Table_df04fd38822944cc8bbfb2765e68488a [id=90dd5d6c0cbf4fc7b807d3a98612dd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.762880 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40b1b2d2377425d8e0a78da3f1c43a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.761683 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 11b732758c1f4565b3051309cdfd9649 (DEFAULT_TABLE table=default.Table_8037e52845d14b45a299988713dc062b [id=e04bd5c1b932479a97d6007603d8969d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.769845 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.772408 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be50535c36a54453b2a1a6d6d09207eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.772883 6269 tablet_replica.cc:330] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.773180 6269 raft_consensus.cc:2229] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.772244 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 30889bfbf1894e74ac6555c0cabc529c (DEFAULT_TABLE table=default.Table_9b2a4e1e67c04db091c4a34ea453abfb [id=9836f23323714ee4914f99114c054cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.777273 6271 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.777328 6275 raft_consensus.cc:348] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.777535 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11b732758c1f4565b3051309cdfd9649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.777571 6275 raft_consensus.cc:374] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.777864 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5bec611c95429ab309957f74b70eea (DEFAULT_TABLE table=default.Table_4b775dafa08f42cc9c34848213b744ba [id=90ada35eef5c42e195226ba9b6e0ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.778627 6275 raft_consensus.cc:729] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.778865 6270 ts_tablet_manager.cc:1918] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.779011 6270 log.cc:1196] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/5a51d9a67e15479587ab2d5a492bb7c2
I20260928 10:44:05.779539 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd (DEFAULT_TABLE table=default.Table_09beab8bce2441ef9483b354af9ecbc7 [id=e9343c120c2549ebbc806c15cde3f207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.779878 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 (DEFAULT_TABLE table=default.Table_7f8750cfcc114e129f68d52b41c70a46 [id=6d7a1571cf674d5b9381cdecd6c834a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.780771 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30889bfbf1894e74ac6555c0cabc529c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.781523 6827 raft_consensus.cc:482] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.781688 6827 raft_consensus.cc:504] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.782330 6827 leader_election.cc:288] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.782586 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc439f216a04f2e861c2d87364eb3dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.783450 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet b2d841c2f9b844208173f982b9eb7818 (table default.Table_03aaae30a2054fa09078e7fd2d90d84b [id=f3dfa01a3e294c67bc947650b6287aa3]) successfully deleted
W20260928 10:44:05.783803 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 975fffba16ba46a295df724d65cf319a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 975fffba16ba46a295df724d65cf319a already in progress: creating tablet
I20260928 10:44:05.784425 6130 tablet_service.cc:1467] Processing CreateTablet for tablet bb1b5a7494414c3ba3f2b176cde0eeb5 (DEFAULT_TABLE table=default.Table_6c38f70ac4604d6a9fc9757976da471f [id=ffa14badcb4845b98a091f369d3e47a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.784814 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c09c7645c4dd3a05f6508297ee48b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.784992 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 30fb3f88e66b4f8582fb348e035af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.785033 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104a223ec6ef47988d0aa3335a1f81de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:05.785615 5818 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.786011 6122 tablet_service.cc:1467] Processing CreateTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 (DEFAULT_TABLE table=default.Table_3bbdfde366124ee2b57a8e1eaca2e658 [id=24c00c4cd959457dad1ab7e6a5943c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.786388 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.786561 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 977064ff0d5e4186b3e2556367c60805 (DEFAULT_TABLE table=default.Table_a11e380b1c87489488dab8b4580b38aa [id=95414f82d8354a33bbcad8b2f233c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:05.787281 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.787101 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104a223ec6ef47988d0aa3335a1f81de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.787815 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.786937 6861 consensus_queue.cc:1035] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260928 10:44:05.787824 5817 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.787953 5817 leader_election.cc:302] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.788897 6827 raft_consensus.cc:2726] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.791061 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1b5a7494414c3ba3f2b176cde0eeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.791263 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 977064ff0d5e4186b3e2556367c60805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.791461 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5bec611c95429ab309957f74b70eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.791540 6827 raft_consensus.cc:482] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.791659 6827 raft_consensus.cc:504] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.792263 6827 leader_election.cc:288] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.794742 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40b1b2d2377425d8e0a78da3f1c43a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:05.794988 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b21a965426145c9b678ae80869be833" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.795182 6269 raft_consensus.cc:2258] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.797910 6269 ts_tablet_manager.cc:1905] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.798767 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc439f216a04f2e861c2d87364eb3dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:05.798979 5817 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.800730 6270 ts_tablet_manager.cc:1939] T 5a51d9a67e15479587ab2d5a492bb7c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.800789 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b21a965426145c9b678ae80869be833" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.801589 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 574) took 1632 ms. Trace:
I20260928 10:44:05.801713 6271 ts_tablet_manager.cc:1397] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.225s user 0.001s sys 0.008s
W20260928 10:44:05.801697 5818 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.801862 5818 leader_election.cc:302] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.801985 6270 rpcz_store.cc:276] 0928 10:44:04.168731 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.168797 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:05.668918 (+1500121us) ts_tablet_manager.cc:1145] Deleting tablet 5a51d9a67e15479587ab2d5a492bb7c2
0928 10:44:05.668926 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.693432 (+ 24506us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.776746 (+ 83314us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.801550 (+ 24804us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499717}
I20260928 10:44:05.802456 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 583) took 1543 ms. Trace:
I20260928 10:44:05.802691 6827 raft_consensus.cc:2726] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.802888 6827 raft_consensus.cc:482] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.802994 6827 raft_consensus.cc:504] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.803658 6827 leader_election.cc:288] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.804345 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b77c90bc2ecc4fc29a4786152cb977bd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.805050 5817 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.778882 6275 consensus_queue.cc:260] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.809898 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b77c90bc2ecc4fc29a4786152cb977bd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.810463 6275 ts_tablet_manager.cc:1428] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.059s user 0.002s sys 0.000s
I20260928 10:44:05.810832 6275 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:05.810842 5818 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.811002 5818 leader_election.cc:302] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.811398 6827 raft_consensus.cc:2726] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.812592 6275 tablet_bootstrap.cc:654] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.814638 6861 consensus_queue.cc:1035] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260928 10:44:05.815552 6271 raft_consensus.cc:348] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.815785 6271 raft_consensus.cc:374] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.816198 6271 raft_consensus.cc:729] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.816439 6271 consensus_queue.cc:260] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.817965 6271 ts_tablet_manager.cc:1428] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260928 10:44:05.818352 6271 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:05.808073 6270 rpcz_store.cc:276] 0928 10:44:04.258767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.258831 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:05.802298 (+1543467us) ts_tablet_manager.cc:1145] Deleting tablet 79d1021f0b844a348e3fbed913758650
0928 10:44:05.802310 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.802417 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1543185}
I20260928 10:44:05.832293 6270 tablet_replica.cc:330] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:05.832770 6270 raft_consensus.cc:2229] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.832984 6270 raft_consensus.cc:2258] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.833853 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 28eb4bef35cc413ebbdc177de1d7b057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:05.834026 6270 ts_tablet_manager.cc:1905] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.839847 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_aa89702c7876438ba5eba7feb8e98dad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.840610 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa89702c7876438ba5eba7feb8e98dad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.842021 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_74bddb88512b41eea5c0824f27398ea6" } new_table_name: "default.Table_ba84b52ee40c448da886f41dc6516b8c" modify_external_catalogs: true
I20260928 10:44:05.842188 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5e1e3ea1a661416086c4d032a3722b2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.842754 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e1e3ea1a661416086c4d032a3722b2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.844156 6827 raft_consensus.cc:482] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.844347 6827 raft_consensus.cc:504] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.845111 6827 leader_election.cc:288] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:05.845973 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5a2038947413f95f134602081c889" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:05.846606 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 58c0af95fa58451490947176ec9301e3 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:05.846769 5817 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.847572 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5a2038947413f95f134602081c889" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:05.848248 5818 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.848412 5818 leader_election.cc:302] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.848835 6827 raft_consensus.cc:2726] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.850731 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eca95ad570e74db0860997757b1e15df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:05.851577 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eca95ad570e74db0860997757b1e15df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.859062 6271 tablet_bootstrap.cc:654] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.866433 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ee62d5e7316b47c1b5cd01f4710b2f0a" } new_table_name: "default.Table_692466d3eea6458f89119ea800b09e3c" modify_external_catalogs: true
I20260928 10:44:05.870849 6272 ts_tablet_manager.cc:1918] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.871022 6272 log.cc:1196] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e40f72ff466e4befb74290fd39285119
I20260928 10:44:05.871440 6272 ts_tablet_manager.cc:1939] T e40f72ff466e4befb74290fd39285119 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:05.872015 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e40f72ff466e4befb74290fd39285119 (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
I20260928 10:44:05.874142 6270 ts_tablet_manager.cc:1918] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.874305 6270 log.cc:1196] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/75ccd6efe3854d65995b17a38d81eaa5
I20260928 10:44:05.877506 6273 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.877702 6273 ts_tablet_manager.cc:1397] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.226s user 0.004s sys 0.001s
I20260928 10:44:05.878531 6273 raft_consensus.cc:348] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:05.878823 6273 raft_consensus.cc:374] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.878902 6273 raft_consensus.cc:729] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.879963 6273 consensus_queue.cc:260] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:05.885051 6270 ts_tablet_manager.cc:1939] T 75ccd6efe3854d65995b17a38d81eaa5 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.885910 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 585) took 1602 ms. Trace:
I20260928 10:44:05.886027 6270 rpcz_store.cc:276] 0928 10:44:04.283078 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.335886 (+ 52808us) service_pool.cc:227] Handling call
0928 10:44:05.827736 (+1491850us) ts_tablet_manager.cc:1145] Deleting tablet 75ccd6efe3854d65995b17a38d81eaa5
0928 10:44:05.830762 (+ 3026us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.871095 (+ 40333us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.874031 (+ 2936us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.885853 (+ 11822us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1491422}
I20260928 10:44:05.886538 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 584) took 1619 ms. Trace:
I20260928 10:44:05.886638 6270 rpcz_store.cc:276] 0928 10:44:04.266964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.377932 (+110968us) service_pool.cc:227] Handling call
0928 10:44:05.886334 (+1508402us) ts_tablet_manager.cc:1145] Deleting tablet c1a659100a124506a411c929ddc31f10
0928 10:44:05.886345 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.886469 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507883}
I20260928 10:44:05.887022 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 597) took 1365 ms. Trace:
I20260928 10:44:05.887121 6270 rpcz_store.cc:276] 0928 10:44:04.521173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.521228 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:05.886878 (+1365650us) ts_tablet_manager.cc:1145] Deleting tablet f5a00b74133a406996820adcb71194df
0928 10:44:05.886887 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.886974 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1365381}
I20260928 10:44:05.887398 6270 tablet_replica.cc:330] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:05.887589 6270 raft_consensus.cc:2229] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:05.887934 6270 raft_consensus.cc:2258] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.888192 6273 ts_tablet_manager.cc:1428] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260928 10:44:05.888500 6270 ts_tablet_manager.cc:1905] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.889578 6273 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:05.891094 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9cc439f216a04f2e861c2d87364eb3dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cc439f216a04f2e861c2d87364eb3dd already in progress: creating tablet
I20260928 10:44:05.891644 6269 ts_tablet_manager.cc:1918] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.891845 6269 log.cc:1196] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/734c3196929d4814b77bce7938bf598e
I20260928 10:44:05.891968 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.892227 6269 ts_tablet_manager.cc:1939] T 734c3196929d4814b77bce7938bf598e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.892436 6273 tablet_bootstrap.cc:654] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.892797 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 5a51d9a67e15479587ab2d5a492bb7c2 (table default.Table_4938837463c94e6787ec7868085a9b35 [id=9551953b3e924296b32b9aa36a43e585]) successfully deleted
I20260928 10:44:05.893011 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 517) took 2570 ms. Trace:
I20260928 10:44:05.893128 6269 rpcz_store.cc:276] 0928 10:44:03.322299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.322558 (+ 259us) service_pool.cc:227] Handling call
0928 10:44:05.771396 (+2448838us) ts_tablet_manager.cc:1145] Deleting tablet 734c3196929d4814b77bce7938bf598e
0928 10:44:05.771406 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.823459 (+ 52053us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.882388 (+ 58929us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.892963 (+ 10575us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448560}
I20260928 10:44:05.893575 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 523) took 2518 ms. Trace:
I20260928 10:44:05.893707 6269 rpcz_store.cc:276] 0928 10:44:03.374863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.374927 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:05.893446 (+2518519us) ts_tablet_manager.cc:1145] Deleting tablet 11c6ed97f74540b786ed3a6378dea0d3
0928 10:44:05.893456 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.893546 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2518289}
I20260928 10:44:05.894032 6269 tablet_replica.cc:330] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.894269 6269 raft_consensus.cc:2229] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.894439 6269 raft_consensus.cc:2258] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.895015 6269 ts_tablet_manager.cc:1905] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.899386 6273 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:05.893654 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 734c3196929d4814b77bce7938bf598e (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
I20260928 10:44:05.900344 6273 ts_tablet_manager.cc:1397] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
W20260928 10:44:05.900585 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 11c6ed97f74540b786ed3a6378dea0d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c6ed97f74540b786ed3a6378dea0d3 already in progress: creating tablet
W20260928 10:44:05.893590 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 734c09c7645c4dd3a05f6508297ee48b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c09c7645c4dd3a05f6508297ee48b already in progress: creating tablet
W20260928 10:44:05.901283 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 30fb3f88e66b4f8582fb348e035af290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fb3f88e66b4f8582fb348e035af290 already in progress: creating tablet
I20260928 10:44:05.901583 6827 raft_consensus.cc:482] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.901732 6827 raft_consensus.cc:504] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:05.902421 6827 leader_election.cc:288] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:05.902694 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b6d5121db2d34ea99c851595c395f3be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6d5121db2d34ea99c851595c395f3be already in progress: creating tablet
W20260928 10:44:05.903275 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 79d1021f0b844a348e3fbed913758650 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d1021f0b844a348e3fbed913758650 already in progress: creating tablet
I20260928 10:44:05.903291 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:05.904024 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.904701 5817 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:05.904754 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f13643dbb64dcf97c4d6d94c22d8b1 already in progress: creating tablet
W20260928 10:44:05.905126 5818 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.905260 5818 leader_election.cc:302] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:05.905642 6827 raft_consensus.cc:2726] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:05.905671 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 75ccd6efe3854d65995b17a38d81eaa5 (table default.Table_3dee98906e7e474cb198741b880a15be [id=399cef1c19b949fda35abe87028aca97]) successfully deleted
I20260928 10:44:05.906217 6272 tablet_replica.cc:330] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:05.906755 6272 raft_consensus.cc:2229] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.908517 6272 raft_consensus.cc:2258] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:05.905874 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c1a659100a124506a411c929ddc31f10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1a659100a124506a411c929ddc31f10 already in progress: creating tablet
I20260928 10:44:05.908994 6269 ts_tablet_manager.cc:1918] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:05.909076 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f5a00b74133a406996820adcb71194df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5a00b74133a406996820adcb71194df already in progress: creating tablet
I20260928 10:44:05.909199 6269 log.cc:1196] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/97401498df144cc689066ea3033d68ef
I20260928 10:44:05.909621 6269 ts_tablet_manager.cc:1939] T 97401498df144cc689066ea3033d68ef P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.910442 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 527) took 2527 ms. Trace:
I20260928 10:44:05.910652 6269 rpcz_store.cc:276] 0928 10:44:03.382580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.382625 (+ 45us) service_pool.cc:227] Handling call
0928 10:44:05.893957 (+2511332us) ts_tablet_manager.cc:1145] Deleting tablet 97401498df144cc689066ea3033d68ef
0928 10:44:05.893980 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.905482 (+ 11502us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.908876 (+ 3394us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.910390 (+ 1514us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2510548}
I20260928 10:44:05.911273 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 97401498df144cc689066ea3033d68ef (table default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]) successfully deleted
I20260928 10:44:05.901224 6273 raft_consensus.cc:348] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.911578 6273 raft_consensus.cc:374] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.911687 6273 raft_consensus.cc:729] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.911873 6269 tablet_replica.cc:330] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.912137 6269 raft_consensus.cc:2229] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.912421 6269 raft_consensus.cc:2258] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.913021 6272 ts_tablet_manager.cc:1905] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.913102 6269 ts_tablet_manager.cc:1905] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.916455 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 383eb18f1c0c46209ff5b47e468b9950 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:05.917225 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2c752d706211447a99440f2b3234b2e4" } new_table_name: "default.Table_bfe8dc92029d4e1295963813649f8d7d" modify_external_catalogs: true
I20260928 10:44:05.912418 6273 consensus_queue.cc:260] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.918938 6273 ts_tablet_manager.cc:1428] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260928 10:44:05.919273 6273 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:05.923695 6269 ts_tablet_manager.cc:1918] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.924467 6275 tablet_bootstrap.cc:492] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:05.924695 6275 ts_tablet_manager.cc:1397] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.114s user 0.006s sys 0.003s
I20260928 10:44:05.924958 6269 log.cc:1196] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:05.925383 6269 ts_tablet_manager.cc:1939] T f9a0d63c6cbc4eebaf42dc7f969f243c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.926023 6275 raft_consensus.cc:348] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.926224 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 526) took 2543 ms. Trace:
I20260928 10:44:05.926437 6269 rpcz_store.cc:276] 0928 10:44:03.382452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.382710 (+ 258us) service_pool.cc:227] Handling call
0928 10:44:05.911734 (+2529024us) ts_tablet_manager.cc:1145] Deleting tablet f9a0d63c6cbc4eebaf42dc7f969f243c
0928 10:44:05.911792 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.920382 (+ 8590us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.923543 (+ 3161us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.926185 (+ 2642us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528014}
I20260928 10:44:05.924840 6273 tablet_bootstrap.cc:654] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.928017 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f9a0d63c6cbc4eebaf42dc7f969f243c (table default.Table_60251724bf62411b81c9c535aaf6a52e [id=52bab93af95a4a3a8daa8e675154d7d3]) successfully deleted
I20260928 10:44:05.928521 6269 tablet_replica.cc:330] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.928560 6275 raft_consensus.cc:374] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.928861 6269 raft_consensus.cc:2229] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.928900 6275 raft_consensus.cc:729] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.929090 6269 raft_consensus.cc:2258] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.929453 6275 consensus_queue.cc:260] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:05.929813 6269 ts_tablet_manager.cc:1905] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.932034 6275 ts_tablet_manager.cc:1428] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:44:05.932824 6275 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:05.936569 6275 tablet_bootstrap.cc:654] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:05.940698 6271 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:05.941000 6271 ts_tablet_manager.cc:1397] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.123s user 0.006s sys 0.001s
I20260928 10:44:05.941977 6271 raft_consensus.cc:348] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.942358 6271 raft_consensus.cc:374] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:05.942516 6271 raft_consensus.cc:729] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:05.942883 6271 consensus_queue.cc:260] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.944731 6269 ts_tablet_manager.cc:1918] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.949625 6269 log.cc:1196] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0e9583b5637a428db383320d98a7a280
I20260928 10:44:05.950350 6269 ts_tablet_manager.cc:1939] T 0e9583b5637a428db383320d98a7a280 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.950367 6270 ts_tablet_manager.cc:1918] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:05.952069 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 524) took 2569 ms. Trace:
I20260928 10:44:05.953157 6269 rpcz_store.cc:276] 0928 10:44:03.382172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.382731 (+ 559us) service_pool.cc:227] Handling call
0928 10:44:05.928450 (+2545719us) ts_tablet_manager.cc:1145] Deleting tablet 0e9583b5637a428db383320d98a7a280
0928 10:44:05.928463 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.941284 (+ 12821us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.944599 (+ 3315us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.952005 (+ 7406us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2544560}
I20260928 10:44:05.954058 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0e9583b5637a428db383320d98a7a280 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:05.954706 6269 tablet_replica.cc:330] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.955155 6269 raft_consensus.cc:2229] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.955749 6269 raft_consensus.cc:2258] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.956727 6269 ts_tablet_manager.cc:1905] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.958895 6270 log.cc:1196] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/780707959e0e48d6a83b22e6479a5884
W20260928 10:44:05.959331 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db50601fa874f219d1c093a86f080c1 consensus state has no leader
I20260928 10:44:05.959877 6270 ts_tablet_manager.cc:1939] T 780707959e0e48d6a83b22e6479a5884 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.960722 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 598) took 1439 ms. Trace:
I20260928 10:44:05.960856 6270 rpcz_store.cc:276] 0928 10:44:04.521304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.521488 (+ 184us) service_pool.cc:227] Handling call
0928 10:44:05.887318 (+1365830us) ts_tablet_manager.cc:1145] Deleting tablet 780707959e0e48d6a83b22e6479a5884
0928 10:44:05.887327 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.934313 (+ 46986us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.950219 (+ 15906us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.960682 (+ 10463us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1365619}
I20260928 10:44:05.962963 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_538716398c7244d295dc35a0876d202b" } modify_external_catalogs: true
I20260928 10:44:05.963198 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_538716398c7244d295dc35a0876d202b" } modify_external_catalogs: true
I20260928 10:44:05.965003 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6450b311bb9142c4ab6babb8728fff9c" } new_table_name: "default.Table_21b652941323487eb33c10f586d9a2ca" modify_external_catalogs: true
I20260928 10:44:05.966032 6793 raft_consensus.cc:482] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:05.966180 6793 raft_consensus.cc:504] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:05.966344 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1e522b8f8f72427880d3623ce9b7377b" } modify_external_catalogs: true
I20260928 10:44:05.966562 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1e522b8f8f72427880d3623ce9b7377b" } modify_external_catalogs: true
I20260928 10:44:05.966874 6793 leader_election.cc:288] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:05.967104 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6279d9ee60ce44759d7bc1ae62dd2073" } modify_external_catalogs: true
I20260928 10:44:05.967257 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6279d9ee60ce44759d7bc1ae62dd2073" } modify_external_catalogs: true
I20260928 10:44:05.967888 6269 ts_tablet_manager.cc:1918] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.967882 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2100a4c39c3e4e9ab2b821068dd02ab5" } modify_external_catalogs: true
W20260928 10:44:05.967954 5957 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d257233e5b934d619e2289a6df55d65a
I20260928 10:44:05.968039 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2100a4c39c3e4e9ab2b821068dd02ab5" } modify_external_catalogs: true
I20260928 10:44:05.968659 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d257233e5b934d619e2289a6df55d65a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:05.969367 5955 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:05.969513 5955 leader_election.cc:302] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:05.970242 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fa9c7d7c4ca44bfda746f4060a8177df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:05.970849 6793 raft_consensus.cc:2726] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:05.970857 5955 consensus_peers.cc:487] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:05.971570 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa9c7d7c4ca44bfda746f4060a8177df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:05.972056 6269 log.cc:1196] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1631d396362a4cffa1dec06d00894c63
I20260928 10:44:05.972445 6269 ts_tablet_manager.cc:1939] T 1631d396362a4cffa1dec06d00894c63 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.973223 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 525) took 2590 ms. Trace:
I20260928 10:44:05.973357 6269 rpcz_store.cc:276] 0928 10:44:03.382337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.385830 (+ 3493us) service_pool.cc:227] Handling call
0928 10:44:05.954617 (+2568787us) ts_tablet_manager.cc:1145] Deleting tablet 1631d396362a4cffa1dec06d00894c63
0928 10:44:05.954629 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.964692 (+ 10063us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.967756 (+ 3064us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.973178 (+ 5422us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568606}
I20260928 10:44:05.973302 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 599) took 1451 ms. Trace:
I20260928 10:44:05.974081 6270 rpcz_store.cc:276] 0928 10:44:04.521439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.521739 (+ 300us) service_pool.cc:227] Handling call
0928 10:44:05.973148 (+1451409us) ts_tablet_manager.cc:1145] Deleting tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
0928 10:44:05.973160 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.973266 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1451212}
I20260928 10:44:05.974366 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d5dd4e5b544262938b1822510d8b9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:05.974431 6270 tablet_replica.cc:330] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:05.974674 6270 raft_consensus.cc:2229] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.974828 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
I20260928 10:44:05.975698 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1631d396362a4cffa1dec06d00894c63 (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:05.976543 6270 raft_consensus.cc:2258] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.976887 6269 tablet_replica.cc:330] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:05.977151 6270 ts_tablet_manager.cc:1905] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:05.977443 6269 raft_consensus.cc:2229] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:05.978432 6269 raft_consensus.cc:2258] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:05.956092 6271 ts_tablet_manager.cc:1428] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 10:44:05.979245 6269 ts_tablet_manager.cc:1905] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:05.986547 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 already in progress: creating tablet
I20260928 10:44:05.988965 6269 ts_tablet_manager.cc:1918] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.993178 6269 log.cc:1196] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c2635c7c47ba4383b6b0f07cd3b42f74
I20260928 10:44:05.993814 6269 ts_tablet_manager.cc:1939] T c2635c7c47ba4383b6b0f07cd3b42f74 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:05.995311 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 529) took 2604 ms. Trace:
I20260928 10:44:05.989636 6270 ts_tablet_manager.cc:1918] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:05.996207 6269 rpcz_store.cc:276] 0928 10:44:03.391269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.391320 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:05.976825 (+2585505us) ts_tablet_manager.cc:1145] Deleting tablet c2635c7c47ba4383b6b0f07cd3b42f74
0928 10:44:05.976836 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.985741 (+ 8905us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.988860 (+ 3119us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.995248 (+ 6388us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585302}
I20260928 10:44:05.996553 6270 log.cc:1196] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/28eb4bef35cc413ebbdc177de1d7b057
I20260928 10:44:05.997040 6270 ts_tablet_manager.cc:1939] T 28eb4bef35cc413ebbdc177de1d7b057 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:05.997129 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c2635c7c47ba4383b6b0f07cd3b42f74 (table default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]) successfully deleted
I20260928 10:44:05.992535 6271 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:05.997740 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 536) took 2517 ms. Trace:
I20260928 10:44:05.998296 6269 rpcz_store.cc:276] 0928 10:44:03.480139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.480187 (+ 48us) service_pool.cc:227] Handling call
0928 10:44:05.997552 (+2517365us) ts_tablet_manager.cc:1145] Deleting tablet ed443629ab604099a6fe5aff1840a553
0928 10:44:05.997565 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.997688 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2517123}
I20260928 10:44:05.999256 6271 tablet_bootstrap.cc:654] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:05.999328 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ed443629ab604099a6fe5aff1840a553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed443629ab604099a6fe5aff1840a553 already in progress: creating tablet
I20260928 10:44:05.999939 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 535) took 2519 ms. Trace:
I20260928 10:44:06.000483 6269 rpcz_store.cc:276] 0928 10:44:03.480000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.481266 (+ 1266us) service_pool.cc:227] Handling call
0928 10:44:05.999758 (+2518492us) ts_tablet_manager.cc:1145] Deleting tablet ea90e2cbd7624baab1522b8b4afa5f32
0928 10:44:05.999770 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.999890 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2518307}
I20260928 10:44:05.999934 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 595) took 1483 ms. Trace:
I20260928 10:44:06.000993 6270 rpcz_store.cc:276] 0928 10:44:04.516662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.544830 (+ 28168us) service_pool.cc:227] Handling call
0928 10:44:05.974357 (+1429527us) ts_tablet_manager.cc:1145] Deleting tablet 28eb4bef35cc413ebbdc177de1d7b057
0928 10:44:05.974368 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:05.986573 (+ 12205us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.989538 (+ 2965us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:05.999876 (+ 10338us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429073}
I20260928 10:44:06.001655 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 534) took 2521 ms. Trace:
I20260928 10:44:06.001860 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 600) took 1437 ms. Trace:
I20260928 10:44:06.002140 6269 rpcz_store.cc:276] 0928 10:44:03.479862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.481950 (+ 2088us) service_pool.cc:227] Handling call
0928 10:44:06.001490 (+2519540us) ts_tablet_manager.cc:1145] Deleting tablet c780d8c23a764f769848fa04550ceff6
0928 10:44:06.001502 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.001608 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2519347}
I20260928 10:44:06.002468 6270 rpcz_store.cc:276] 0928 10:44:04.564508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.570290 (+ 5782us) service_pool.cc:227] Handling call
0928 10:44:06.001681 (+1431391us) ts_tablet_manager.cc:1145] Deleting tablet 32560e881a1d4444a706bb8b60dda499
0928 10:44:06.001692 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.001801 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1430811}
W20260928 10:44:06.002916 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c780d8c23a764f769848fa04550ceff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c780d8c23a764f769848fa04550ceff6 already in progress: creating tablet
I20260928 10:44:06.003486 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 533) took 2561 ms. Trace:
I20260928 10:44:06.003585 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 605) took 1370 ms. Trace:
W20260928 10:44:06.003852 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 51933.8us
I20260928 10:44:06.004108 6888 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:06.004297 6270 rpcz_store.cc:276] 0928 10:44:04.633536 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.633593 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:06.003440 (+1369847us) ts_tablet_manager.cc:1145] Deleting tablet 1b6c19618aa84f24be0f9b1e4224f47f
0928 10:44:06.003450 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.003541 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1369576}
I20260928 10:44:06.005126 6270 tablet_replica.cc:330] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.005728 6270 raft_consensus.cc:2229] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.006553 6269 rpcz_store.cc:276] 0928 10:44:03.442097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.487332 (+ 45235us) service_pool.cc:227] Handling call
0928 10:44:06.003333 (+2516001us) ts_tablet_manager.cc:1145] Deleting tablet a25c7f3b94e94cafb3275a2e190be0ed
0928 10:44:06.003344 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.003439 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515772}
I20260928 10:44:06.006908 6270 raft_consensus.cc:2258] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.005236 6889 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:06.007689 6270 ts_tablet_manager.cc:1905] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.008036 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 537) took 2507 ms. Trace:
I20260928 10:44:06.008591 6269 rpcz_store.cc:276] 0928 10:44:03.500259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.501429 (+ 1170us) service_pool.cc:227] Handling call
0928 10:44:06.007879 (+2506450us) ts_tablet_manager.cc:1145] Deleting tablet a61d97ed6b7b4dcba34a7a2190316b02
0928 10:44:06.007890 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.007984 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506220}
W20260928 10:44:06.009080 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a61d97ed6b7b4dcba34a7a2190316b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61d97ed6b7b4dcba34a7a2190316b02 already in progress: creating tablet
I20260928 10:44:06.007828 6890 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:06.009434 6269 tablet_replica.cc:330] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.009807 6269 raft_consensus.cc:2229] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.010071 6269 raft_consensus.cc:2258] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.010707 6269 ts_tablet_manager.cc:1905] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.012686 6273 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.012916 6273 ts_tablet_manager.cc:1397] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.094s user 0.033s sys 0.002s
I20260928 10:44:06.002589 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 28eb4bef35cc413ebbdc177de1d7b057 (table default.Table_31cadc2943274de99ca4c78618ea19fd [id=387c96b6b1cd436381e2b8011d66aa74]) successfully deleted
I20260928 10:44:06.013841 6273 raft_consensus.cc:348] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.014133 6273 raft_consensus.cc:374] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.014199 6273 raft_consensus.cc:729] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.014572 6273 consensus_queue.cc:260] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:06.015405 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 861bf895ac104cf79fe49a22ef9253b3 consensus state has no leader
I20260928 10:44:06.017436 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:06.021795 6270 ts_tablet_manager.cc:1918] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.021937 6270 log.cc:1196] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1e32961679ee47379dab4c62efc53d99
I20260928 10:44:06.023239 6273 ts_tablet_manager.cc:1428] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 10:44:06.023861 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:06.026049 6273 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.026559 6866 raft_consensus.cc:482] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.026840 6866 raft_consensus.cc:504] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.027668 6866 leader_election.cc:288] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.028350 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54b78fbf508f4e47bd31661e05dcaa16" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.028952 5818 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.028968 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54b78fbf508f4e47bd31661e05dcaa16" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.029312 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.125:37939
--webserver_interface=127.5.100.125
--webserver_port=45673
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 10:44:06.029801 5817 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.029938 5817 leader_election.cc:302] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.030176 6866 raft_consensus.cc:2726] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.029008 6273 tablet_bootstrap.cc:654] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.034307 6269 ts_tablet_manager.cc:1918] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.034577 6269 log.cc:1196] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/82b3afe074194023ba788094a2a6b81c
I20260928 10:44:06.035037 6269 ts_tablet_manager.cc:1939] T 82b3afe074194023ba788094a2a6b81c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.036027 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 538) took 2471 ms. Trace:
I20260928 10:44:06.036254 6269 rpcz_store.cc:276] 0928 10:44:03.564314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.564389 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:06.009359 (+2444970us) ts_tablet_manager.cc:1145] Deleting tablet 82b3afe074194023ba788094a2a6b81c
0928 10:44:06.009369 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.030922 (+ 21553us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.034162 (+ 3240us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.035977 (+ 1815us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2444717}
I20260928 10:44:06.036994 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 82b3afe074194023ba788094a2a6b81c (table default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]) successfully deleted
W20260928 10:44:06.041785 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 32560e881a1d4444a706bb8b60dda499 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32560e881a1d4444a706bb8b60dda499 already in progress: creating tablet
W20260928 10:44:06.042207 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1b6c19618aa84f24be0f9b1e4224f47f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b6c19618aa84f24be0f9b1e4224f47f already in progress: creating tablet
W20260928 10:44:06.044552 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d consensus state has no leader
W20260928 10:44:06.045327 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 consensus state has no leader
I20260928 10:44:06.046650 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6 (DEFAULT_TABLE table=default.Table_4aa2279fd7f446ab9d4110a026c09706 [id=c42af70e380a46198db242c45f3dc0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.047212 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.047190 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:06.047454 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:06.047662 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 1 got 0
I20260928 10:44:06.050719 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7f8750cfcc114e129f68d52b41c70a46" } modify_external_catalogs: true
I20260928 10:44:06.050943 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7f8750cfcc114e129f68d52b41c70a46" } modify_external_catalogs: true
I20260928 10:44:06.051189 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6 (DEFAULT_TABLE table=default.Table_4aa2279fd7f446ab9d4110a026c09706 [id=c42af70e380a46198db242c45f3dc0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.051263 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 (DEFAULT_TABLE table=default.Table_8e39f8abe6304e5e820a8c3550ac7f39 [id=8d13f1f3cc5f4acba74f4765dd63be9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.051736 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 137ef0978ed540f88fddfa70eb9c2ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.054690 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.058347 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 (DEFAULT_TABLE table=default.Table_01f1354d2ff6487a90ac060ac64c8723 [id=30be1aec485b4f58b9152a61e41b9347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.059304 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6 (DEFAULT_TABLE table=default.Table_4aa2279fd7f446ab9d4110a026c09706 [id=c42af70e380a46198db242c45f3dc0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.059741 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7fbe1e590c4b10b90c4d5eba1904b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.059775 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 (DEFAULT_TABLE table=default.Table_8e39f8abe6304e5e820a8c3550ac7f39 [id=8d13f1f3cc5f4acba74f4765dd63be9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.060247 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 137ef0978ed540f88fddfa70eb9c2ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.062575 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 (DEFAULT_TABLE table=default.Table_01f1354d2ff6487a90ac060ac64c8723 [id=30be1aec485b4f58b9152a61e41b9347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.063051 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0596f6b57ca24a0e888e559cdcad6b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.071061 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 (DEFAULT_TABLE table=default.Table_8e39f8abe6304e5e820a8c3550ac7f39 [id=8d13f1f3cc5f4acba74f4765dd63be9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.071570 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 137ef0978ed540f88fddfa70eb9c2ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.086983 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0596f6b57ca24a0e888e559cdcad6b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.091485 6275 tablet_bootstrap.cc:492] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.091651 6275 ts_tablet_manager.cc:1397] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.159s user 0.006s sys 0.031s
I20260928 10:44:06.091629 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 (DEFAULT_TABLE table=default.Table_01f1354d2ff6487a90ac060ac64c8723 [id=30be1aec485b4f58b9152a61e41b9347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.092042 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0596f6b57ca24a0e888e559cdcad6b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.094684 6275 raft_consensus.cc:348] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.094972 6275 raft_consensus.cc:374] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.095095 6275 raft_consensus.cc:729] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.095377 6275 consensus_queue.cc:260] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.096025 6275 ts_tablet_manager.cc:1428] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:06.099925 6272 ts_tablet_manager.cc:1918] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.100297 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 546) took 2331 ms. Trace:
I20260928 10:44:06.101466 6269 rpcz_store.cc:276] 0928 10:44:03.768511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.768619 (+ 108us) service_pool.cc:227] Handling call
0928 10:44:06.037430 (+2268811us) ts_tablet_manager.cc:1145] Deleting tablet 527e00f713214484bfc19ab96044a1be
0928 10:44:06.037466 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.100217 (+ 62751us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263809}
W20260928 10:44:06.102325 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 527e00f713214484bfc19ab96044a1be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 527e00f713214484bfc19ab96044a1be already in progress: creating tablet
I20260928 10:44:06.102928 6269 tablet_replica.cc:330] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.103231 6269 raft_consensus.cc:2229] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.103533 6269 raft_consensus.cc:2258] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.103860 6271 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.104103 6271 ts_tablet_manager.cc:1397] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.114s user 0.016s sys 0.017s
I20260928 10:44:06.104300 6269 ts_tablet_manager.cc:1905] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.105425 6271 raft_consensus.cc:348] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.105764 6271 raft_consensus.cc:374] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.105913 6271 raft_consensus.cc:729] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.105907 6272 log.cc:1196] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/28eb4bef35cc413ebbdc177de1d7b057
I20260928 10:44:06.106225 6271 consensus_queue.cc:260] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.106673 6275 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.108421 6275 tablet_bootstrap.cc:654] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.109166 6272 ts_tablet_manager.cc:1939] T 28eb4bef35cc413ebbdc177de1d7b057 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:06.110407 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 28eb4bef35cc413ebbdc177de1d7b057 (table default.Table_31cadc2943274de99ca4c78618ea19fd [id=387c96b6b1cd436381e2b8011d66aa74]) successfully deleted
I20260928 10:44:06.116744 6271 ts_tablet_manager.cc:1428] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260928 10:44:06.118247 6269 ts_tablet_manager.cc:1918] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.118567 6269 log.cc:1196] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:06.118988 6269 ts_tablet_manager.cc:1939] T 98bd99e7bdb647ceb9357f88affc45d9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.119613 6270 ts_tablet_manager.cc:1939] T 1e32961679ee47379dab4c62efc53d99 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:06.119998 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 547) took 2342 ms. Trace:
I20260928 10:44:06.120158 6269 rpcz_store.cc:276] 0928 10:44:03.777444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.777548 (+ 104us) service_pool.cc:227] Handling call
0928 10:44:06.102838 (+2325290us) ts_tablet_manager.cc:1145] Deleting tablet 98bd99e7bdb647ceb9357f88affc45d9
0928 10:44:06.102854 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.113633 (+ 10779us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.118119 (+ 4486us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.119941 (+ 1822us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320120}
I20260928 10:44:06.121311 5702 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_79deab792b4344e281995d6a3cf65486 [id=688359adeeea4de79516ab81770bb710] alter complete (version 2)
I20260928 10:44:06.121858 6269 tablet_replica.cc:330] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.122102 6269 raft_consensus.cc:2229] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.122318 6269 raft_consensus.cc:2258] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.123121 6269 ts_tablet_manager.cc:1905] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.124517 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.125981 6275 tablet_bootstrap.cc:492] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.126309 6275 ts_tablet_manager.cc:1397] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.000s
I20260928 10:44:06.127214 6275 raft_consensus.cc:348] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.127548 6275 raft_consensus.cc:374] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.127662 6275 raft_consensus.cc:729] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.127978 6275 consensus_queue.cc:260] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.128746 6275 ts_tablet_manager.cc:1428] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:06.129132 6275 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.130522 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e32961679ee47379dab4c62efc53d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.122120 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6f18ad86c85b4f70b1d01f04b67f1b30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.130970 6272 tablet_replica.cc:330] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:06.131160 6272 raft_consensus.cc:2229] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.131320 6272 raft_consensus.cc:2258] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:06.131331 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f18ad86c85b4f70b1d01f04b67f1b30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.132007 6272 ts_tablet_manager.cc:1905] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.123466 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d5a63d9baed7423480f46bd6010a919e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.133904 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5a63d9baed7423480f46bd6010a919e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.134095 6269 ts_tablet_manager.cc:1918] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.134215 6269 log.cc:1196] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:06.130983 6275 tablet_bootstrap.cc:654] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.135668 6269 ts_tablet_manager.cc:1939] T dfd9b4092b1242b8a60974c445a2789a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.136621 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 548) took 2354 ms. Trace:
I20260928 10:44:06.136818 6269 rpcz_store.cc:276] 0928 10:44:03.782374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.782433 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:06.121762 (+2339329us) ts_tablet_manager.cc:1145] Deleting tablet dfd9b4092b1242b8a60974c445a2789a
0928 10:44:06.121776 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.127948 (+ 6172us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.133955 (+ 6007us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.136577 (+ 2622us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2338875}
I20260928 10:44:06.137383 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet dfd9b4092b1242b8a60974c445a2789a (table default.Table_e690f55d690b46358de9c97d59e9644b [id=1fc32d0deb66442db0f46fe989de0d55]) successfully deleted
I20260928 10:44:06.137552 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 550) took 2335 ms. Trace:
I20260928 10:44:06.137729 6269 rpcz_store.cc:276] 0928 10:44:03.802221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.802310 (+ 89us) service_pool.cc:227] Handling call
0928 10:44:06.137386 (+2335076us) ts_tablet_manager.cc:1145] Deleting tablet 402378e09a1d43ea92f694fe24f9c544
0928 10:44:06.137399 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.137516 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2333866}
W20260928 10:44:06.138253 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 402378e09a1d43ea92f694fe24f9c544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 402378e09a1d43ea92f694fe24f9c544 already in progress: creating tablet
I20260928 10:44:06.138397 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 557) took 2293 ms. Trace:
I20260928 10:44:06.138592 6269 rpcz_store.cc:276] 0928 10:44:03.844780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.845019 (+ 239us) service_pool.cc:227] Handling call
0928 10:44:06.138206 (+2293187us) ts_tablet_manager.cc:1145] Deleting tablet e9e0bac650904b8f81474ba2dac9c04f
0928 10:44:06.138218 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.138363 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2288996}
W20260928 10:44:06.139364 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e9e0bac650904b8f81474ba2dac9c04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9e0bac650904b8f81474ba2dac9c04f already in progress: creating tablet
I20260928 10:44:06.139963 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 556) took 2296 ms. Trace:
I20260928 10:44:06.140391 6272 ts_tablet_manager.cc:1918] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.140617 6272 log.cc:1196] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1e32961679ee47379dab4c62efc53d99
I20260928 10:44:06.141062 6272 ts_tablet_manager.cc:1939] T 1e32961679ee47379dab4c62efc53d99 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:06.141000 6269 rpcz_store.cc:276] 0928 10:44:03.843915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.844446 (+ 531us) service_pool.cc:227] Handling call
0928 10:44:06.139789 (+2295343us) ts_tablet_manager.cc:1145] Deleting tablet cc2990e37a9648669eb39a865392c9e7
0928 10:44:06.139803 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.139920 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2289440}
W20260928 10:44:06.141419 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet cc2990e37a9648669eb39a865392c9e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc2990e37a9648669eb39a865392c9e7 already in progress: creating tablet
I20260928 10:44:06.141804 6269 tablet_replica.cc:330] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.141948 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:06.142417 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1e32961679ee47379dab4c62efc53d99 (table default.Table_89caef5f6e1943cd824b68ae13547e1d [id=f2e30412da7045c0b0bd9bbea0976fa6]) successfully deleted
I20260928 10:44:06.142552 6275 tablet_bootstrap.cc:492] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.142686 6275 ts_tablet_manager.cc:1397] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260928 10:44:06.143069 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_81611dc2ea444355bfc90e472d8088d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.143419 6275 raft_consensus.cc:348] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:06.143611 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81611dc2ea444355bfc90e472d8088d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.143637 6275 raft_consensus.cc:374] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.143715 6275 raft_consensus.cc:729] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.143946 6275 consensus_queue.cc:260] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.144943 6275 ts_tablet_manager.cc:1428] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:06.145409 6275 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.146220 6269 raft_consensus.cc:2229] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.147321 6269 raft_consensus.cc:2258] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.149721 6269 ts_tablet_manager.cc:1905] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.151296 6275 tablet_bootstrap.cc:654] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.121013 6271 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.158579 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 383eb18f1c0c46209ff5b47e468b9950
I20260928 10:44:06.159041 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 383eb18f1c0c46209ff5b47e468b9950 deleted and replaced by tablet 7834a54e59114a77b4e54e9190049a47
I20260928 10:44:06.160431 6271 tablet_bootstrap.cc:654] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.160730 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 with delete_type TABLET_DATA_DELETED (replaced by tablet 7834a54e59114a77b4e54e9190049a47) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.160960 6269 ts_tablet_manager.cc:1918] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.161417 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 with delete_type TABLET_DATA_DELETED (replaced by tablet 7834a54e59114a77b4e54e9190049a47) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.153380 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.162356 6269 log.cc:1196] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:44:06.162950 6269 ts_tablet_manager.cc:1939] T ecb1d807c9f04fe4b02e3343f0c6511c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.164173 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 558) took 2319 ms. Trace:
I20260928 10:44:06.165184 6269 rpcz_store.cc:276] 0928 10:44:03.844881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.845105 (+ 224us) service_pool.cc:227] Handling call
0928 10:44:06.141745 (+2296640us) ts_tablet_manager.cc:1145] Deleting tablet ecb1d807c9f04fe4b02e3343f0c6511c
0928 10:44:06.141755 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.156371 (+ 14616us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.160842 (+ 4471us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.164122 (+ 3280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2290958}
I20260928 10:44:06.165649 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 with delete_type TABLET_DATA_DELETED (replaced by tablet 7834a54e59114a77b4e54e9190049a47) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.165953 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet ecb1d807c9f04fe4b02e3343f0c6511c (table default.Table_2599faf42aa64d3e85b31db48c5b2644 [id=61ff49fcb43c4d0e94532e49a70e21b2]) successfully deleted
I20260928 10:44:06.166492 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 560) took 2312 ms. Trace:
I20260928 10:44:06.166980 6269 rpcz_store.cc:276] 0928 10:44:03.853843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.854003 (+ 160us) service_pool.cc:227] Handling call
0928 10:44:06.166309 (+2312306us) ts_tablet_manager.cc:1145] Deleting tablet 60b55bf4bd3f45a99429c0a6e97f63f6
0928 10:44:06.166321 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.166427 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2308218}
I20260928 10:44:06.167320 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 608) took 1522 ms. Trace:
I20260928 10:44:06.167497 6270 rpcz_store.cc:276] 0928 10:44:04.644417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.644455 (+ 38us) service_pool.cc:227] Handling call
0928 10:44:06.005051 (+1360596us) ts_tablet_manager.cc:1145] Deleting tablet 1e32961679ee47379dab4c62efc53d99
0928 10:44:06.005061 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.018634 (+ 13573us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.021651 (+ 3017us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.167278 (+145627us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1360385}
W20260928 10:44:06.167791 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 60b55bf4bd3f45a99429c0a6e97f63f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60b55bf4bd3f45a99429c0a6e97f63f6 already in progress: creating tablet
I20260928 10:44:06.167961 6270 tablet_replica.cc:330] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.168213 6270 raft_consensus.cc:2229] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:06.168213 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 383eb18f1c0c46209ff5b47e468b9950 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 383eb18f1c0c46209ff5b47e468b9950 already in progress: creating tablet
I20260928 10:44:06.168265 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 561) took 2282 ms. Trace:
I20260928 10:44:06.168465 6270 raft_consensus.cc:2258] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.168485 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1e32961679ee47379dab4c62efc53d99 (table default.Table_89caef5f6e1943cd824b68ae13547e1d [id=f2e30412da7045c0b0bd9bbea0976fa6]) successfully deleted
I20260928 10:44:06.168704 6269 rpcz_store.cc:276] 0928 10:44:03.886014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.886427 (+ 413us) service_pool.cc:227] Handling call
0928 10:44:06.168122 (+2281695us) ts_tablet_manager.cc:1145] Deleting tablet 3abfedf425b84f679b22d6ca9bef718a
0928 10:44:06.168132 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.168220 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258605}
W20260928 10:44:06.169111 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 3abfedf425b84f679b22d6ca9bef718a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3abfedf425b84f679b22d6ca9bef718a already in progress: creating tablet
I20260928 10:44:06.170248 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 563) took 2196 ms. Trace:
I20260928 10:44:06.170714 6269 rpcz_store.cc:276] 0928 10:44:03.973469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.973530 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:06.170105 (+2196575us) ts_tablet_manager.cc:1145] Deleting tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d
0928 10:44:06.170115 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.170203 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2196320}
W20260928 10:44:06.171448 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d already in progress: creating tablet
I20260928 10:44:06.171861 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 565) took 2192 ms. Trace:
I20260928 10:44:06.172247 6269 rpcz_store.cc:276] 0928 10:44:03.979199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:03.979248 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:06.171723 (+2192475us) ts_tablet_manager.cc:1145] Deleting tablet e6bd816447ad4a58b679f83b8acbb4b5
0928 10:44:06.171734 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.171815 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2192249}
W20260928 10:44:06.172832 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e6bd816447ad4a58b679f83b8acbb4b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bd816447ad4a58b679f83b8acbb4b5 already in progress: creating tablet
I20260928 10:44:06.173276 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 579) took 2040 ms. Trace:
I20260928 10:44:06.173720 6269 rpcz_store.cc:276] 0928 10:44:04.133280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.133404 (+ 124us) service_pool.cc:227] Handling call
0928 10:44:06.173140 (+2039736us) ts_tablet_manager.cc:1145] Deleting tablet 45a8098440fb4e919bc5e3f4dd3241a7
0928 10:44:06.173150 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.173229 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002856}
W20260928 10:44:06.174360 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 45a8098440fb4e919bc5e3f4dd3241a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a8098440fb4e919bc5e3f4dd3241a7 already in progress: creating tablet
I20260928 10:44:06.174644 6270 ts_tablet_manager.cc:1905] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.174875 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 581) took 1999 ms. Trace:
I20260928 10:44:06.175359 6269 rpcz_store.cc:276] 0928 10:44:04.175039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.176758 (+ 1719us) service_pool.cc:227] Handling call
0928 10:44:06.174700 (+1997942us) ts_tablet_manager.cc:1145] Deleting tablet 2c683445c12e43cc9379bf465f7e252c
0928 10:44:06.174710 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.174821 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1987699}
I20260928 10:44:06.178407 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 58c0af95fa58451490947176ec9301e3
I20260928 10:44:06.178906 5701 catalog_manager.cc:6565] ReplaceTablet: tablet 58c0af95fa58451490947176ec9301e3 deleted and replaced by tablet b5be4edbfc11495b972a8ca68be46d38
I20260928 10:44:06.179459 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7db49404752e4501a594608fc325ebe9
I20260928 10:44:06.180173 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_107bf14a134c47eb829f32f9e31ca23b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.180673 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_107bf14a134c47eb829f32f9e31ca23b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.181856 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 86b16eb36c034591ac1603ab84fd9342
I20260928 10:44:06.182443 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5e0cc66b896a4eac89ac1b70cc98142c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.183048 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e0cc66b896a4eac89ac1b70cc98142c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.184270 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 34e41838d44e400f9934ea40a198e606
I20260928 10:44:06.184700 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:06.185796 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db49404752e4501a594608fc325ebe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.185971 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e41838d44e400f9934ea40a198e606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.186036 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 86b16eb36c034591ac1603ab84fd9342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.185976 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c0af95fa58451490947176ec9301e3 with delete_type TABLET_DATA_DELETED (replaced by tablet b5be4edbfc11495b972a8ca68be46d38) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.186223 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_939fb34bc15b40d481d475412cf8513c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.188164 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_939fb34bc15b40d481d475412cf8513c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.190266 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4a57721f3cd145538940531d9b55ac4c" } new_table_name: "default.Table_f62e7365d93d467fb2c5802cf34b47e8" modify_external_catalogs: true
I20260928 10:44:06.191421 6273 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.191557 6273 ts_tablet_manager.cc:1397] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.168s user 0.033s sys 0.060s
I20260928 10:44:06.192255 6273 raft_consensus.cc:348] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.192468 6273 raft_consensus.cc:374] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.192518 6273 raft_consensus.cc:729] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.192764 6273 consensus_queue.cc:260] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.195901 6273 ts_tablet_manager.cc:1428] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:06.196225 6273 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.197705 6275 tablet_bootstrap.cc:492] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.197950 6275 ts_tablet_manager.cc:1397] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.010s
I20260928 10:44:06.198885 6275 raft_consensus.cc:348] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.199230 6275 raft_consensus.cc:374] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.199366 6275 raft_consensus.cc:729] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.199756 6275 consensus_queue.cc:260] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.202543 6273 tablet_bootstrap.cc:654] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.202525 6275 ts_tablet_manager.cc:1428] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:06.203017 6275 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.203188 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 317446124e354bbeaaef608d9e8852fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.203711 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c0af95fa58451490947176ec9301e3 with delete_type TABLET_DATA_DELETED (replaced by tablet b5be4edbfc11495b972a8ca68be46d38) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.204214 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db49404752e4501a594608fc325ebe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.204639 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 86b16eb36c034591ac1603ab84fd9342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.204871 6275 tablet_bootstrap.cc:654] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.205050 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e41838d44e400f9934ea40a198e606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.215095 6270 ts_tablet_manager.cc:1918] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.215879 6270 log.cc:1196] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/118ae3f8af264a31b7c22403c4951bdf
I20260928 10:44:06.216660 6272 tablet_replica.cc:330] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:06.216544 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c0af95fa58451490947176ec9301e3 with delete_type TABLET_DATA_DELETED (replaced by tablet b5be4edbfc11495b972a8ca68be46d38) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.217365 6270 ts_tablet_manager.cc:1939] T 118ae3f8af264a31b7c22403c4951bdf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:06.217665 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db49404752e4501a594608fc325ebe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.218642 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 86b16eb36c034591ac1603ab84fd9342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.217823 6272 raft_consensus.cc:2229] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.219295 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e41838d44e400f9934ea40a198e606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.219177 6275 tablet_bootstrap.cc:492] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.219543 6272 raft_consensus.cc:2258] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:06.220132 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2c683445c12e43cc9379bf465f7e252c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c683445c12e43cc9379bf465f7e252c already in progress: creating tablet
I20260928 10:44:06.219589 6275 ts_tablet_manager.cc:1397] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260928 10:44:06.220981 6273 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.221128 6273 ts_tablet_manager.cc:1397] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260928 10:44:06.221158 6272 ts_tablet_manager.cc:1905] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.221385 6275 raft_consensus.cc:348] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.221802 6273 raft_consensus.cc:348] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.222054 6273 raft_consensus.cc:374] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.221990 6275 raft_consensus.cc:374] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.222107 6273 raft_consensus.cc:729] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.222303 6275 raft_consensus.cc:729] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.222306 6273 consensus_queue.cc:260] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.223136 6273 ts_tablet_manager.cc:1428] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:06.223404 6273 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.222748 6275 consensus_queue.cc:260] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.221802 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 580) took 2051 ms. Trace:
I20260928 10:44:06.225066 6269 rpcz_store.cc:276] 0928 10:44:04.173194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.173270 (+ 76us) service_pool.cc:227] Handling call
0928 10:44:06.221657 (+2048387us) ts_tablet_manager.cc:1145] Deleting tablet 493b1d0e0b884fdfbaa3eb6d55874f2e
0928 10:44:06.221667 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.221779 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2031500}
W20260928 10:44:06.225651 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 493b1d0e0b884fdfbaa3eb6d55874f2e already in progress: creating tablet
I20260928 10:44:06.226138 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 590) took 1938 ms. Trace:
I20260928 10:44:06.226259 6269 rpcz_store.cc:276] 0928 10:44:04.287710 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.288858 (+ 1148us) service_pool.cc:227] Handling call
0928 10:44:06.226004 (+1937146us) ts_tablet_manager.cc:1145] Deleting tablet 79d1021f0b844a348e3fbed913758650
0928 10:44:06.226017 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.226121 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1930854}
W20260928 10:44:06.226778 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 79d1021f0b844a348e3fbed913758650 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d1021f0b844a348e3fbed913758650 already in progress: creating tablet
I20260928 10:44:06.227491 6273 tablet_bootstrap.cc:654] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.228559 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 591) took 1940 ms. Trace:
I20260928 10:44:06.228652 6269 rpcz_store.cc:276] 0928 10:44:04.287796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.288879 (+ 1083us) service_pool.cc:227] Handling call
0928 10:44:06.228426 (+1939547us) ts_tablet_manager.cc:1145] Deleting tablet c1a659100a124506a411c929ddc31f10
0928 10:44:06.228436 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.228540 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1914650}
I20260928 10:44:06.229082 6269 tablet_replica.cc:330] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:06.229089 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c1a659100a124506a411c929ddc31f10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1a659100a124506a411c929ddc31f10 already in progress: creating tablet
I20260928 10:44:06.229316 6269 raft_consensus.cc:2229] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.229511 6269 raft_consensus.cc:2258] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.230093 6269 ts_tablet_manager.cc:1905] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.231779 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 609) took 1587 ms. Trace:
I20260928 10:44:06.231913 6270 rpcz_store.cc:276] 0928 10:44:04.644596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.644648 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:06.167901 (+1523253us) ts_tablet_manager.cc:1145] Deleting tablet 118ae3f8af264a31b7c22403c4951bdf
0928 10:44:06.167911 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.185059 (+ 17148us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.214941 (+ 29882us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.231711 (+ 16770us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1523007}
I20260928 10:44:06.232470 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 118ae3f8af264a31b7c22403c4951bdf (table default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9 [id=c8d4a6587af14ea39b7ace0ce005588b]) successfully deleted
I20260928 10:44:06.232873 6270 tablet_replica.cc:330] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.233418 6270 raft_consensus.cc:2229] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.233644 6270 raft_consensus.cc:2258] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.234234 6270 ts_tablet_manager.cc:1905] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.235962 6273 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.236150 6273 ts_tablet_manager.cc:1397] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260928 10:44:06.236950 6273 raft_consensus.cc:348] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.237236 6273 raft_consensus.cc:374] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.237323 6273 raft_consensus.cc:729] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.237565 6273 consensus_queue.cc:260] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.238404 6273 ts_tablet_manager.cc:1428] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:06.238736 6273 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.243325 6271 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.245728 6275 ts_tablet_manager.cc:1428] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260928 10:44:06.247195 6275 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.248893 6275 tablet_bootstrap.cc:654] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.251206 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.253334 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ba28bafb8dea49f6a477927aea223e1d
I20260928 10:44:06.257735 6273 tablet_bootstrap.cc:654] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.259526 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet ba28bafb8dea49f6a477927aea223e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.260394 6269 ts_tablet_manager.cc:1918] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:06.260324 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c280f2cddea249448f42d09bbbdba884"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.260695 6269 log.cc:1196] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/780707959e0e48d6a83b22e6479a5884
I20260928 10:44:06.261026 6269 ts_tablet_manager.cc:1939] T 780707959e0e48d6a83b22e6479a5884 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.261180 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet bae5a2038947413f95f134602081c889 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:06.262452 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 602) took 1753 ms. Trace:
I20260928 10:44:06.263253 6269 rpcz_store.cc:276] 0928 10:44:04.509271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.509970 (+ 699us) service_pool.cc:227] Handling call
0928 10:44:06.229037 (+1719067us) ts_tablet_manager.cc:1145] Deleting tablet 780707959e0e48d6a83b22e6479a5884
0928 10:44:06.229048 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.240300 (+ 11252us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.260291 (+ 19991us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.262431 (+ 2140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655216}
I20260928 10:44:06.263698 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 601) took 1754 ms. Trace:
I20260928 10:44:06.264041 6269 rpcz_store.cc:276] 0928 10:44:04.509121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.510405 (+ 1284us) service_pool.cc:227] Handling call
0928 10:44:06.263563 (+1753158us) ts_tablet_manager.cc:1145] Deleting tablet f5a00b74133a406996820adcb71194df
0928 10:44:06.263574 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.263683 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689667}
I20260928 10:44:06.264544 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 603) took 1754 ms. Trace:
I20260928 10:44:06.264647 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5a102bf3fe3b4bc8ad60ca76e48928e7
I20260928 10:44:06.265362 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_14bedf63b9574b6da31a6f0b67270e19" } new_table_name: "default.Table_dadadc27cb47481fac861cc24bd236c0" modify_external_catalogs: true
I20260928 10:44:06.264954 6269 rpcz_store.cc:276] 0928 10:44:04.509825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.512333 (+ 2508us) service_pool.cc:227] Handling call
0928 10:44:06.264439 (+1752106us) ts_tablet_manager.cc:1145] Deleting tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
0928 10:44:06.264448 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.264530 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1690503}
I20260928 10:44:06.266299 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 604) took 1703 ms. Trace:
I20260928 10:44:06.266692 6269 rpcz_store.cc:276] 0928 10:44:04.563029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.563133 (+ 104us) service_pool.cc:227] Handling call
0928 10:44:06.266193 (+1703060us) ts_tablet_manager.cc:1145] Deleting tablet 32560e881a1d4444a706bb8b60dda499
0928 10:44:06.266204 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.266284 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1692223}
I20260928 10:44:06.266815 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fd6798c7a514425c9c9f3e15748748e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.267311 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 607) took 1633 ms. Trace:
I20260928 10:44:06.267656 6269 rpcz_store.cc:276] 0928 10:44:04.633675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.633746 (+ 71us) service_pool.cc:227] Handling call
0928 10:44:06.267214 (+1633468us) ts_tablet_manager.cc:1145] Deleting tablet 1b6c19618aa84f24be0f9b1e4224f47f
0928 10:44:06.267223 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.267297 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616540}
I20260928 10:44:06.268096 6269 tablet_replica.cc:330] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.268489 6269 raft_consensus.cc:2229] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.268573 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.269061 6269 raft_consensus.cc:2258] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:06.269279 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd6798c7a514425c9c9f3e15748748e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.269872 6269 ts_tablet_manager.cc:1905] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.265611 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.262949 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet ba28bafb8dea49f6a477927aea223e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.271703 6271 ts_tablet_manager.cc:1397] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.151s user 0.001s sys 0.013s
I20260928 10:44:06.273100 6271 raft_consensus.cc:348] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.274001 6273 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.274150 6273 ts_tablet_manager.cc:1397] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260928 10:44:06.274461 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.274523 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet ba28bafb8dea49f6a477927aea223e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.274585 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ca22794da4015bbe09ed6c374ad05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.274633 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 66f13643dbb64dcf97c4d6d94c22d8b1 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:06.275087 6273 raft_consensus.cc:348] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.275295 6273 raft_consensus.cc:374] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.275386 6273 raft_consensus.cc:729] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.275605 6273 consensus_queue.cc:260] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.275920 6271 raft_consensus.cc:374] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.276342 6271 raft_consensus.cc:729] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.276999 6271 consensus_queue.cc:260] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.276940 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1bbdb0db659d4027b6dc40bfb96dd123"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.278081 6273 ts_tablet_manager.cc:1428] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 10:44:06.278515 6273 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.280032 6273 tablet_bootstrap.cc:654] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:06.277693 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c280f2cddea249448f42d09bbbdba884 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.280647 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96b7a476f067469c92fc7fb319db23cd" } new_table_name: "default.Table_6cf5abf0ce2d41ee996b121d077c5fda" modify_external_catalogs: true
W20260928 10:44:06.282219 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49c40696fe8645de9b639d2293f41403 consensus state has no leader
I20260928 10:44:06.283041 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 780707959e0e48d6a83b22e6479a5884 (table default.Table_5bf4b815e871428f8f85595af83573b5 [id=7af448c554a042ab877113eb284d68c7]) successfully deleted
W20260928 10:44:06.283327 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f5a00b74133a406996820adcb71194df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5a00b74133a406996820adcb71194df already in progress: creating tablet
W20260928 10:44:06.283748 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 already in progress: creating tablet
W20260928 10:44:06.283960 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 32560e881a1d4444a706bb8b60dda499 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32560e881a1d4444a706bb8b60dda499 already in progress: creating tablet
W20260928 10:44:06.284423 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1b6c19618aa84f24be0f9b1e4224f47f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b6c19618aa84f24be0f9b1e4224f47f already in progress: creating tablet
I20260928 10:44:06.285029 6270 ts_tablet_manager.cc:1918] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.285194 6270 log.cc:1196] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/317446124e354bbeaaef608d9e8852fd
I20260928 10:44:06.285598 6270 ts_tablet_manager.cc:1939] T 317446124e354bbeaaef608d9e8852fd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:06.286412 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 607) took 1642 ms. Trace:
I20260928 10:44:06.286511 6269 ts_tablet_manager.cc:1918] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.286621 6269 log.cc:1196] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:06.286648 6270 rpcz_store.cc:276] 0928 10:44:04.644306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.644717 (+ 411us) service_pool.cc:227] Handling call
0928 10:44:06.232784 (+1588067us) ts_tablet_manager.cc:1145] Deleting tablet 317446124e354bbeaaef608d9e8852fd
0928 10:44:06.232797 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.243860 (+ 11063us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.281928 (+ 38068us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.286372 (+ 4444us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1587867}
I20260928 10:44:06.286885 6269 ts_tablet_manager.cc:1939] T 23d4da5ccb214a4bbc543c67529b59cf P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.287330 6270 tablet_replica.cc:330] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.287549 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 608) took 1638 ms. Trace:
I20260928 10:44:06.287773 6270 raft_consensus.cc:2229] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.287985 6270 raft_consensus.cc:2258] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.288538 6270 ts_tablet_manager.cc:1905] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.288826 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7bf5036ca6bc40bd90328811c948501d" } new_table_name: "default.Table_34437f380f6e451baa642895afcea0d9" modify_external_catalogs: true
W20260928 10:44:06.290630 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bbdb0db659d4027b6dc40bfb96dd123 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.290788 6271 ts_tablet_manager.cc:1428] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260928 10:44:06.291800 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 317446124e354bbeaaef608d9e8852fd (table default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]) successfully deleted
I20260928 10:44:06.292387 6271 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.295126 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.296028 6269 rpcz_store.cc:276] 0928 10:44:04.649442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.649501 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:06.268058 (+1618557us) ts_tablet_manager.cc:1145] Deleting tablet 23d4da5ccb214a4bbc543c67529b59cf
0928 10:44:06.268067 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.283653 (+ 15586us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.286397 (+ 2744us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.287528 (+ 1131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617164}
I20260928 10:44:06.295266 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.296468 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 612) took 1276 ms. Trace:
I20260928 10:44:06.296550 6269 rpcz_store.cc:276] 0928 10:44:05.020397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.023341 (+ 2944us) service_pool.cc:227] Handling call
0928 10:44:06.296329 (+1272988us) ts_tablet_manager.cc:1145] Deleting tablet 20ea1325da4e460da08377f5d6d6a055
0928 10:44:06.296341 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.296449 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1272741}
I20260928 10:44:06.296661 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 23d4da5ccb214a4bbc543c67529b59cf (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]) successfully deleted
I20260928 10:44:06.296830 6269 tablet_replica.cc:330] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.297015 6269 raft_consensus.cc:2229] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:06.297060 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 20ea1325da4e460da08377f5d6d6a055 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20ea1325da4e460da08377f5d6d6a055 already in progress: creating tablet
I20260928 10:44:06.297165 6269 raft_consensus.cc:2258] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.299129 6269 ts_tablet_manager.cc:1905] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.302124 6273 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.302274 6273 ts_tablet_manager.cc:1397] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260928 10:44:06.303128 6273 raft_consensus.cc:348] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.303792 6273 raft_consensus.cc:374] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.303853 6273 raft_consensus.cc:729] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.304059 6273 consensus_queue.cc:260] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.304134 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f9cdfa55dd3842baa9953832efc2313d" } new_table_name: "default.Table_868c82ae2401426fae6d2aea18ca318b" modify_external_catalogs: true
I20260928 10:44:06.304744 6271 tablet_bootstrap.cc:654] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.304917 6273 ts_tablet_manager.cc:1428] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:44:06.305181 6273 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.307964 6273 tablet_bootstrap.cc:654] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.308179 6275 tablet_bootstrap.cc:492] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.314891 6275 ts_tablet_manager.cc:1397] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.068s user 0.007s sys 0.003s
I20260928 10:44:06.315864 6275 raft_consensus.cc:348] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.316264 6275 raft_consensus.cc:374] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.316380 6275 raft_consensus.cc:729] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.316674 6275 consensus_queue.cc:260] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.317387 6275 ts_tablet_manager.cc:1428] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:06.318926 6269 ts_tablet_manager.cc:1918] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.322840 6273 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.324260 6273 ts_tablet_manager.cc:1397] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260928 10:44:06.324441 6269 log.cc:1196] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:06.331944 6275 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.333830 6275 tablet_bootstrap.cc:654] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.325043 6273 raft_consensus.cc:348] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.334606 6273 raft_consensus.cc:374] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.334699 6273 raft_consensus.cc:729] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.334872 6269 ts_tablet_manager.cc:1939] T fbac466fe364472391a1fc2d75a46b9b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.307518 6272 ts_tablet_manager.cc:1918] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.334936 6273 consensus_queue.cc:260] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.335263 6272 log.cc:1196] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/317446124e354bbeaaef608d9e8852fd
I20260928 10:44:06.335481 6273 ts_tablet_manager.cc:1428] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260928 10:44:06.335680 6272 ts_tablet_manager.cc:1939] T 317446124e354bbeaaef608d9e8852fd P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:06.336858 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 317446124e354bbeaaef608d9e8852fd (table default.Table_ffb3c8206e614404828699d3794028a2 [id=4d3bbd5c78c64319885dfefea122e3ba]) successfully deleted
W20260928 10:44:06.337692 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 58c0af95fa58451490947176ec9301e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c0af95fa58451490947176ec9301e3 already in progress: creating tablet
I20260928 10:44:06.337788 6273 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.338048 6792 raft_consensus.cc:482] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.338212 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 620) took 1254 ms. Trace:
I20260928 10:44:06.338200 6792 raft_consensus.cc:504] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.338292 6269 rpcz_store.cc:276] 0928 10:44:05.084059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.084665 (+ 606us) service_pool.cc:227] Handling call
0928 10:44:06.296776 (+1212111us) ts_tablet_manager.cc:1145] Deleting tablet fbac466fe364472391a1fc2d75a46b9b
0928 10:44:06.296798 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.315590 (+ 18792us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.318822 (+ 3232us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.338192 (+ 19370us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":1211878}
I20260928 10:44:06.338800 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet fbac466fe364472391a1fc2d75a46b9b (table default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]) successfully deleted
I20260928 10:44:06.339088 6792 leader_election.cc:288] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.339133 6269 tablet_replica.cc:330] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.339306 6269 raft_consensus.cc:2229] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.339434 6273 tablet_bootstrap.cc:654] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.339447 6269 raft_consensus.cc:2258] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.340010 6269 ts_tablet_manager.cc:1905] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.340370 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbd5d1ccd2e54f3884af3af327bb892e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.341085 5957 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dbd5d1ccd2e54f3884af3af327bb892e
W20260928 10:44:06.341313 5955 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.341418 5955 leader_election.cc:302] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.342031 6792 raft_consensus.cc:2726] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:06.342857 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7db49404752e4501a594608fc325ebe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7db49404752e4501a594608fc325ebe9 already in progress: creating tablet
W20260928 10:44:06.343706 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 86b16eb36c034591ac1603ab84fd9342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86b16eb36c034591ac1603ab84fd9342 already in progress: creating tablet
W20260928 10:44:06.344380 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 34e41838d44e400f9934ea40a198e606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34e41838d44e400f9934ea40a198e606 already in progress: creating tablet
W20260928 10:44:06.345192 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 already in progress: creating tablet
W20260928 10:44:06.345803 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ba28bafb8dea49f6a477927aea223e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba28bafb8dea49f6a477927aea223e1d already in progress: creating tablet
I20260928 10:44:06.346195 6792 raft_consensus.cc:482] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.346344 6792 raft_consensus.cc:504] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.346766 6269 ts_tablet_manager.cc:1918] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.346896 6269 log.cc:1196] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/21b4deb353974c8aae4bb8148869758d
I20260928 10:44:06.347095 6792 leader_election.cc:288] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.347191 6269 ts_tablet_manager.cc:1939] T 21b4deb353974c8aae4bb8148869758d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.348109 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 621) took 1263 ms. Trace:
W20260928 10:44:06.348248 5957 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:06.348222 6269 rpcz_store.cc:276] 0928 10:44:05.084183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.084925 (+ 742us) service_pool.cc:227] Handling call
0928 10:44:06.339087 (+1254162us) ts_tablet_manager.cc:1145] Deleting tablet 21b4deb353974c8aae4bb8148869758d
0928 10:44:06.339099 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.343309 (+ 4210us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.346651 (+ 3342us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.348082 (+ 1431us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1254018}
I20260928 10:44:06.348688 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 21b4deb353974c8aae4bb8148869758d (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]) successfully deleted
I20260928 10:44:06.349009 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48ccd7551f6a4fc8b41e70e94749e6f1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.349792 5955 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.349942 5955 leader_election.cc:302] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.350183 6269 tablet_replica.cc:330] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.350359 6269 raft_consensus.cc:2229] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.350565 6269 raft_consensus.cc:2258] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.350589 6792 raft_consensus.cc:2726] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.350976 6272 tablet_replica.cc:330] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:06.351230 6272 raft_consensus.cc:2229] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.354629 6269 ts_tablet_manager.cc:1905] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.355796 6271 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.356021 6271 ts_tablet_manager.cc:1397] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.001s
I20260928 10:44:06.356949 6271 raft_consensus.cc:348] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.357272 6271 raft_consensus.cc:374] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.357439 6271 raft_consensus.cc:729] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.357761 6271 consensus_queue.cc:260] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.363328 6273 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.363493 6273 ts_tablet_manager.cc:1397] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.003s
I20260928 10:44:06.364179 6273 raft_consensus.cc:348] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.364420 6273 raft_consensus.cc:374] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.364480 6273 raft_consensus.cc:729] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.364547 6269 ts_tablet_manager.cc:1918] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.364629 6269 log.cc:1196] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/bd225da0b4b445c6ac03634d975e8396
I20260928 10:44:06.364683 6273 consensus_queue.cc:260] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.365163 6273 ts_tablet_manager.cc:1428] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:06.365424 6273 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.366284 6270 ts_tablet_manager.cc:1918] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.366539 6270 log.cc:1196] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a4ed61f43d5d4a6fa21eb854dae895d8
I20260928 10:44:06.367093 6270 ts_tablet_manager.cc:1939] T a4ed61f43d5d4a6fa21eb854dae895d8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:06.367455 6269 ts_tablet_manager.cc:1939] T bd225da0b4b445c6ac03634d975e8396 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.368062 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 606) took 1723 ms. Trace:
I20260928 10:44:06.368289 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 622) took 1284 ms. Trace:
I20260928 10:44:06.368427 6273 tablet_bootstrap.cc:654] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.376392 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bae5a2038947413f95f134602081c889
I20260928 10:44:06.376803 5697 catalog_manager.cc:6565] ReplaceTablet: tablet bae5a2038947413f95f134602081c889 deleted and replaced by tablet b820ef6381c44b44a4d4e3ebb9f99802
I20260928 10:44:06.378490 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b912bd21046b46f7b5c6adedb0933598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.379079 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e4594eae7b840ff980f67da8ed82e01 consensus state has no leader
W20260928 10:44:06.379297 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a229207ce7cc475c8f4492e62d122721 consensus state has no leader
W20260928 10:44:06.379701 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e89d3b5d65454b2982e625dd4f909bfb consensus state has no leader
W20260928 10:44:06.380398 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b912bd21046b46f7b5c6adedb0933598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.368372 6269 rpcz_store.cc:276] 0928 10:44:05.084287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.085088 (+ 801us) service_pool.cc:227] Handling call
0928 10:44:06.350133 (+1265045us) ts_tablet_manager.cc:1145] Deleting tablet bd225da0b4b445c6ac03634d975e8396
0928 10:44:06.350146 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.357727 (+ 7581us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.364451 (+ 6724us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.368271 (+ 3820us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1264881}
I20260928 10:44:06.382678 6272 raft_consensus.cc:2258] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.382947 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 623) took 1298 ms. Trace:
I20260928 10:44:06.383037 6269 rpcz_store.cc:276] 0928 10:44:05.084362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.085277 (+ 915us) service_pool.cc:227] Handling call
0928 10:44:06.382796 (+1297519us) ts_tablet_manager.cc:1145] Deleting tablet 263b9844bdf6465fa7894ddcf2809f24
0928 10:44:06.382810 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.382929 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297359}
I20260928 10:44:06.383299 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet bae5a2038947413f95f134602081c889 with delete_type TABLET_DATA_DELETED (replaced by tablet b820ef6381c44b44a4d4e3ebb9f99802) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.383483 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.384392 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet bd225da0b4b445c6ac03634d975e8396 (table default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]) successfully deleted
I20260928 10:44:06.383590 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 624) took 1299 ms. Trace:
W20260928 10:44:06.384620 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 263b9844bdf6465fa7894ddcf2809f24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263b9844bdf6465fa7894ddcf2809f24 already in progress: creating tablet
I20260928 10:44:06.384552 6269 rpcz_store.cc:276] 0928 10:44:05.084502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.085443 (+ 941us) service_pool.cc:227] Handling call
0928 10:44:06.383484 (+1298041us) ts_tablet_manager.cc:1145] Deleting tablet 57b7976063024775b9dde91b32010754
0928 10:44:06.383495 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.383576 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297849}
W20260928 10:44:06.384938 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 57b7976063024775b9dde91b32010754 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57b7976063024775b9dde91b32010754 already in progress: creating tablet
I20260928 10:44:06.385233 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 625) took 1300 ms. Trace:
I20260928 10:44:06.385329 6273 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.385298 6269 rpcz_store.cc:276] 0928 10:44:05.084619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.085592 (+ 973us) service_pool.cc:227] Handling call
0928 10:44:06.385140 (+1299548us) ts_tablet_manager.cc:1145] Deleting tablet b217b6d4ad9a495795fe2b923144e8d3
0928 10:44:06.385149 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.385220 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1299384}
I20260928 10:44:06.387492 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 92912af8cba4453a8e3422896d586855 with delete_type TABLET_DATA_DELETED (replaced by tablet 6037e24ee6ba4399b6100ab27c4ed621) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.387560 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet bae5a2038947413f95f134602081c889 with delete_type TABLET_DATA_DELETED (replaced by tablet b820ef6381c44b44a4d4e3ebb9f99802) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.387714 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 01433ce37b2c49cd858ea88877ca56da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:06.389304 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b217b6d4ad9a495795fe2b923144e8d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b217b6d4ad9a495795fe2b923144e8d3 already in progress: creating tablet
I20260928 10:44:06.389714 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 627) took 1233 ms. Trace:
I20260928 10:44:06.390067 6269 rpcz_store.cc:276] 0928 10:44:05.156494 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.170028 (+ 13534us) service_pool.cc:227] Handling call
0928 10:44:06.389612 (+1219584us) ts_tablet_manager.cc:1145] Deleting tablet e03f686afffc4d47b5e27fdbc8eb8f75
0928 10:44:06.389622 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.389700 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219279}
I20260928 10:44:06.390462 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db9a81dcfa8f454d839c829673b77b9e" } modify_external_catalogs: true
W20260928 10:44:06.390744 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e03f686afffc4d47b5e27fdbc8eb8f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03f686afffc4d47b5e27fdbc8eb8f75 already in progress: creating tablet
I20260928 10:44:06.390954 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f71db539df0449a1bde6ce7863dbdff2" } modify_external_catalogs: true
I20260928 10:44:06.391120 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 626) took 1234 ms. Trace:
I20260928 10:44:06.385448 6273 ts_tablet_manager.cc:1397] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.005s
I20260928 10:44:06.391127 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f71db539df0449a1bde6ce7863dbdff2" } modify_external_catalogs: true
I20260928 10:44:06.391191 6269 rpcz_store.cc:276] 0928 10:44:05.156328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.171917 (+ 15589us) service_pool.cc:227] Handling call
0928 10:44:06.391027 (+1219110us) ts_tablet_manager.cc:1145] Deleting tablet 4bb1214f8880463fb2bb36c8f922174f
0928 10:44:06.391036 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.391105 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218894}
W20260928 10:44:06.391566 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4bb1214f8880463fb2bb36c8f922174f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bb1214f8880463fb2bb36c8f922174f already in progress: creating tablet
I20260928 10:44:06.391656 6886 raft_consensus.cc:482] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.391803 6886 raft_consensus.cc:504] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.391970 6273 raft_consensus.cc:348] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.392163 6273 raft_consensus.cc:374] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.392212 6273 raft_consensus.cc:729] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:06.392477 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 03ebfc156361479c909ff263c3be4601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ebfc156361479c909ff263c3be4601 already in progress: creating tablet
I20260928 10:44:06.392470 6886 leader_election.cc:288] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:06.392983 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6089745a618d42d496cff786eba718fa" } modify_external_catalogs: true
I20260928 10:44:06.393174 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6089745a618d42d496cff786eba718fa" } modify_external_catalogs: true
I20260928 10:44:06.393151 6273 consensus_queue.cc:260] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.394174 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:06.394418 6273 ts_tablet_manager.cc:1428] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:06.390760 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db9a81dcfa8f454d839c829673b77b9e" } modify_external_catalogs: true
I20260928 10:44:06.395236 6273 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:06.395730 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7c3bf7a6b83344c886362cc216c9e26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3bf7a6b83344c886362cc216c9e26e already in progress: creating tablet
W20260928 10:44:06.401837 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2eded874aa094054b0c2e7c2e592dba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2eded874aa094054b0c2e7c2e592dba1 already in progress: creating tablet
W20260928 10:44:06.402663 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1d0584d6b80e43eb913c3932256cd89e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0584d6b80e43eb913c3932256cd89e already in progress: creating tablet
I20260928 10:44:06.403297 6269 tablet_replica.cc:330] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.403759 6269 raft_consensus.cc:2229] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.404276 6269 raft_consensus.cc:2258] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.404867 6275 tablet_bootstrap.cc:492] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.405031 6275 ts_tablet_manager.cc:1397] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.001s
I20260928 10:44:06.405566 6269 ts_tablet_manager.cc:1905] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.405821 6275 raft_consensus.cc:348] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.406050 6275 raft_consensus.cc:374] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.406136 6275 raft_consensus.cc:729] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.407575 6275 consensus_queue.cc:260] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.413838 6273 tablet_bootstrap.cc:654] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.414270 6275 ts_tablet_manager.cc:1428] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:44:06.414381 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet e25db69b15eb445792e6168f99304bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.413740 6272 ts_tablet_manager.cc:1905] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.426846 6888 tablet.cc:1722] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:06.434307 6270 rpcz_store.cc:276] 0928 10:44:04.644152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:04.644252 (+ 100us) service_pool.cc:227] Handling call
0928 10:44:06.287264 (+1643012us) ts_tablet_manager.cc:1145] Deleting tablet a4ed61f43d5d4a6fa21eb854dae895d8
0928 10:44:06.287276 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.309357 (+ 22081us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.366166 (+ 56809us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.368007 (+ 1841us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":181,"tablet-delete.queue_time_us":1642226}
I20260928 10:44:06.376248 6271 ts_tablet_manager.cc:1428] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260928 10:44:06.385561 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet bae5a2038947413f95f134602081c889 with delete_type TABLET_DATA_DELETED (replaced by tablet b820ef6381c44b44a4d4e3ebb9f99802) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.395363 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362ef9f9aa8641cca11c0a154882e1d4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:06.421443 6890 tablet.cc:1722] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:06.436550 6090 leader_election.cc:302] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.436990 6886 raft_consensus.cc:2726] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:06.440680 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0e4594eae7b840ff980f67da8ed82e01 (table default.Table_868c82ae2401426fae6d2aea18ca318b [id=7d91230c80fd4951adc2206362b423ec], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0e4594eae7b840ff980f67da8ed82e01 consensus state has no leader
I20260928 10:44:06.441028 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a4ed61f43d5d4a6fa21eb854dae895d8 (table default.Table_1f1c12917895471e83d800259d4e5e19 [id=e801580ddab142968da46685ccfc2258]) successfully deleted
I20260928 10:44:06.441560 6271 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.450148 6271 tablet_bootstrap.cc:654] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.454515 6269 ts_tablet_manager.cc:1918] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.454655 6269 log.cc:1196] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:06.454934 6269 ts_tablet_manager.cc:1939] T b77c90bc2ecc4fc29a4786152cb977bd P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.457590 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_70a5507af48d4a689baa7a6e5d1c39b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.458285 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70a5507af48d4a689baa7a6e5d1c39b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.456300 6793 raft_consensus.cc:482] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.461069 6793 raft_consensus.cc:504] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.461735 6793 leader_election.cc:288] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:06.462961 5957 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e
I20260928 10:44:06.462941 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "734c3196929d4814b77bce7938bf598e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.463492 5955 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.463662 5955 leader_election.cc:302] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.463653 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_51b44c6d9a684eabbcde0c5855980627"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.464257 6793 raft_consensus.cc:2726] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:06.464529 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51b44c6d9a684eabbcde0c5855980627 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.460661 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 621) took 1378 ms. Trace:
I20260928 10:44:06.465638 6270 rpcz_store.cc:276] 0928 10:44:05.082560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.082871 (+ 311us) service_pool.cc:227] Handling call
0928 10:44:06.459407 (+1376536us) ts_tablet_manager.cc:1145] Deleting tablet 263b9844bdf6465fa7894ddcf2809f24
0928 10:44:06.460454 (+ 1047us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.460602 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376309}
W20260928 10:44:06.466202 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 263b9844bdf6465fa7894ddcf2809f24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263b9844bdf6465fa7894ddcf2809f24 already in progress: creating tablet
I20260928 10:44:06.467031 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 622) took 1384 ms. Trace:
I20260928 10:44:06.467142 6270 rpcz_store.cc:276] 0928 10:44:05.082687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.083129 (+ 442us) service_pool.cc:227] Handling call
0928 10:44:06.466816 (+1383687us) ts_tablet_manager.cc:1145] Deleting tablet 57b7976063024775b9dde91b32010754
0928 10:44:06.466830 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.466973 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383501}
W20260928 10:44:06.467620 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 57b7976063024775b9dde91b32010754 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57b7976063024775b9dde91b32010754 already in progress: creating tablet
I20260928 10:44:06.466228 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_04da22a497e64c02ba05e303e848a626"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.469403 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04da22a497e64c02ba05e303e848a626 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.470546 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 623) took 1387 ms. Trace:
I20260928 10:44:06.470650 6270 rpcz_store.cc:276] 0928 10:44:05.082818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.086883 (+ 4065us) service_pool.cc:227] Handling call
0928 10:44:06.470327 (+1383444us) ts_tablet_manager.cc:1145] Deleting tablet b217b6d4ad9a495795fe2b923144e8d3
0928 10:44:06.470339 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.470469 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383218}
W20260928 10:44:06.471099 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b217b6d4ad9a495795fe2b923144e8d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b217b6d4ad9a495795fe2b923144e8d3 already in progress: creating tablet
I20260928 10:44:06.471098 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5ec435e9be9b4e05a290cce679ce9b50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.471678 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ec435e9be9b4e05a290cce679ce9b50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.472987 6889 tablet.cc:1722] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:06.473152 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 613) took 1457 ms. Trace:
I20260928 10:44:06.473243 6270 rpcz_store.cc:276] 0928 10:44:05.015528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.015588 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:06.472985 (+1457397us) ts_tablet_manager.cc:1145] Deleting tablet 20ea1325da4e460da08377f5d6d6a055
0928 10:44:06.472997 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.473102 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1367530}
W20260928 10:44:06.473709 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 20ea1325da4e460da08377f5d6d6a055 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20ea1325da4e460da08377f5d6d6a055 already in progress: creating tablet
I20260928 10:44:06.474390 6886 raft_consensus.cc:482] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.474594 6886 raft_consensus.cc:504] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.475224 6886 leader_election.cc:288] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.476042 6270 tablet_replica.cc:330] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.476122 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:06.476243 6270 raft_consensus.cc:2229] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.476444 6270 raft_consensus.cc:2258] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.477066 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15931372e469401ab22422677bd90d1f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:06.477691 6090 leader_election.cc:302] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.478168 6886 raft_consensus.cc:2726] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.482081 6275 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.485174 6275 tablet_bootstrap.cc:654] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.486509 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 04b947da50894cdba0f49d0738f60187 (table default.Table_30de79cdae684abc96a9f7a080d00f02 [id=4a75e89669ef4e509eb3d9b832262916]). Expected version 1 got 0
I20260928 10:44:06.489753 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.490056 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.491199 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:06.492365 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c482d492c6f147919876101634e2f217"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.493016 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c482d492c6f147919876101634e2f217 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.495690 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 518c4112b4c54996815486b205646925 (DEFAULT_TABLE table=default.Table_eca95ad570e74db0860997757b1e15df [id=25af67aee43d4cfd95d249858f143987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.496232 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c4112b4c54996815486b205646925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.500069 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1 (DEFAULT_TABLE table=default.Table_aa89702c7876438ba5eba7feb8e98dad [id=5558f749bfa74ea886b06f81426ad98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.500420 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f (DEFAULT_TABLE table=default.Table_6d4a32d90f93464e8962fdc09b63dd1d [id=15e668bb54eb47088526df0173495dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.500564 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.500902 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a78458ef1bd44c5acb9ae98f123089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.501065 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f (DEFAULT_TABLE table=default.Table_f71db539df0449a1bde6ce7863dbdff2 [id=4edee3e8e2dc4032b5e8e495b1f315b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.501473 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 474e9ca2deb1478a87c978d1e119fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.502815 5984 tablet_service.cc:1467] Processing CreateTablet for tablet e9c596f9cd28453883d0299e698fba31 (DEFAULT_TABLE table=default.Table_94ac43322633474fba62c1a5be97085b [id=99d43f78eec04d67b326dddb5640bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.503269 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9c596f9cd28453883d0299e698fba31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.506916 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 6f317439c55e4575a0d72ef282c467d5 (DEFAULT_TABLE table=default.Table_1312101176de4669988b8e0090027832 [id=b0ad8f30a29a47bba153b3adbc441128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.508566 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 518c4112b4c54996815486b205646925 (DEFAULT_TABLE table=default.Table_eca95ad570e74db0860997757b1e15df [id=25af67aee43d4cfd95d249858f143987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.510723 6002 tablet_service.cc:1467] Processing CreateTablet for tablet b907eb6a33af4e45a3f94f08176f8130 (DEFAULT_TABLE table=default.Table_fa9c7d7c4ca44bfda746f4060a8177df [id=642594b2acb2422ca65eec7f5c88d075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.511214 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 6f317439c55e4575a0d72ef282c467d5 (DEFAULT_TABLE table=default.Table_1312101176de4669988b8e0090027832 [id=b0ad8f30a29a47bba153b3adbc441128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.511345 6270 ts_tablet_manager.cc:1905] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.511368 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1 (DEFAULT_TABLE table=default.Table_aa89702c7876438ba5eba7feb8e98dad [id=5558f749bfa74ea886b06f81426ad98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.511687 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f (DEFAULT_TABLE table=default.Table_f71db539df0449a1bde6ce7863dbdff2 [id=4edee3e8e2dc4032b5e8e495b1f315b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.511787 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f (DEFAULT_TABLE table=default.Table_6d4a32d90f93464e8962fdc09b63dd1d [id=15e668bb54eb47088526df0173495dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.511214 5847 tablet_service.cc:1467] Processing CreateTablet for tablet e9c596f9cd28453883d0299e698fba31 (DEFAULT_TABLE table=default.Table_94ac43322633474fba62c1a5be97085b [id=99d43f78eec04d67b326dddb5640bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.512840 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 2922360e7a1b4545a085beeadcd2b946 (DEFAULT_TABLE table=default.Table_0795c9d84aac4678b774d26253e5791b [id=b3bc0873652e468c9cbc4c189fee9244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.514688 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 638) took 1089 ms. Trace:
I20260928 10:44:06.514776 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 (DEFAULT_TABLE table=default.Table_5e1e3ea1a661416086c4d032a3722b2c [id=828ca1c9e50c4f708cd2fc420096e96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.514819 6269 rpcz_store.cc:276] 0928 10:44:05.425576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.425752 (+ 176us) service_pool.cc:227] Handling call
0928 10:44:06.403244 (+977492us) ts_tablet_manager.cc:1145] Deleting tablet b77c90bc2ecc4fc29a4786152cb977bd
0928 10:44:06.403255 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.451378 (+ 48123us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.454378 (+ 3000us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.514666 (+ 60288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":904449}
I20260928 10:44:06.515218 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 639) took 1070 ms. Trace:
I20260928 10:44:06.515291 6269 rpcz_store.cc:276] 0928 10:44:05.444914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.444970 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:06.515099 (+1070129us) ts_tablet_manager.cc:1145] Deleting tablet 37a685d70ec44acb9f9ffadec2105307
0928 10:44:06.515108 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.515204 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016268}
I20260928 10:44:06.515579 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 640) took 1033 ms. Trace:
I20260928 10:44:06.515645 6269 rpcz_store.cc:276] 0928 10:44:05.481766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.481822 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:06.515482 (+1033660us) ts_tablet_manager.cc:1145] Deleting tablet 975fffba16ba46a295df724d65cf319a
0928 10:44:06.515490 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.515566 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016591}
I20260928 10:44:06.515800 6271 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.515774 5848 tablet_service.cc:1467] Processing CreateTablet for tablet b907eb6a33af4e45a3f94f08176f8130 (DEFAULT_TABLE table=default.Table_fa9c7d7c4ca44bfda746f4060a8177df [id=642594b2acb2422ca65eec7f5c88d075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.515870 6269 tablet_replica.cc:330] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.515969 6271 ts_tablet_manager.cc:1397] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.000s
I20260928 10:44:06.516026 6269 raft_consensus.cc:2229] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.516160 6269 raft_consensus.cc:2258] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.516234 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 3116c1aa4f7e410f826d9ef49e53c32b (DEFAULT_TABLE table=default.Table_ece70b41d4eb46518b578adcd84e586d [id=c15fdef86b9b443994f935786cf30388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.516364 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 2922360e7a1b4545a085beeadcd2b946 (DEFAULT_TABLE table=default.Table_0795c9d84aac4678b774d26253e5791b [id=b3bc0873652e468c9cbc4c189fee9244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.516510 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 518c4112b4c54996815486b205646925 (DEFAULT_TABLE table=default.Table_eca95ad570e74db0860997757b1e15df [id=25af67aee43d4cfd95d249858f143987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.516664 6269 ts_tablet_manager.cc:1905] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.516913 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1 (DEFAULT_TABLE table=default.Table_aa89702c7876438ba5eba7feb8e98dad [id=5558f749bfa74ea886b06f81426ad98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.517362 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f (DEFAULT_TABLE table=default.Table_6d4a32d90f93464e8962fdc09b63dd1d [id=15e668bb54eb47088526df0173495dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.517320 6271 raft_consensus.cc:348] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.517594 6271 raft_consensus.cc:374] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.517679 6271 raft_consensus.cc:729] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.517840 6129 tablet_service.cc:1467] Processing CreateTablet for tablet e9c596f9cd28453883d0299e698fba31 (DEFAULT_TABLE table=default.Table_94ac43322633474fba62c1a5be97085b [id=99d43f78eec04d67b326dddb5640bc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.517951 6271 consensus_queue.cc:260] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.518339 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 6f317439c55e4575a0d72ef282c467d5 (DEFAULT_TABLE table=default.Table_1312101176de4669988b8e0090027832 [id=b0ad8f30a29a47bba153b3adbc441128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.518815 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f (DEFAULT_TABLE table=default.Table_f71db539df0449a1bde6ce7863dbdff2 [id=4edee3e8e2dc4032b5e8e495b1f315b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.519297 6122 tablet_service.cc:1467] Processing CreateTablet for tablet b907eb6a33af4e45a3f94f08176f8130 (DEFAULT_TABLE table=default.Table_fa9c7d7c4ca44bfda746f4060a8177df [id=642594b2acb2422ca65eec7f5c88d075]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.519722 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 (DEFAULT_TABLE table=default.Table_5e1e3ea1a661416086c4d032a3722b2c [id=828ca1c9e50c4f708cd2fc420096e96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.520160 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 3116c1aa4f7e410f826d9ef49e53c32b (DEFAULT_TABLE table=default.Table_ece70b41d4eb46518b578adcd84e586d [id=c15fdef86b9b443994f935786cf30388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.521654 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet b77c90bc2ecc4fc29a4786152cb977bd (table default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]) successfully deleted
W20260928 10:44:06.522019 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 37a685d70ec44acb9f9ffadec2105307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37a685d70ec44acb9f9ffadec2105307 already in progress: creating tablet
I20260928 10:44:06.522068 6271 ts_tablet_manager.cc:1428] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
W20260928 10:44:06.522258 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 975fffba16ba46a295df724d65cf319a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 975fffba16ba46a295df724d65cf319a already in progress: creating tablet
I20260928 10:44:06.526885 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 2922360e7a1b4545a085beeadcd2b946 (DEFAULT_TABLE table=default.Table_0795c9d84aac4678b774d26253e5791b [id=b3bc0873652e468c9cbc4c189fee9244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.527534 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 (DEFAULT_TABLE table=default.Table_5e1e3ea1a661416086c4d032a3722b2c [id=828ca1c9e50c4f708cd2fc420096e96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.527621 6271 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.529719 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 735e4f4e5b38447d8f705879796c3dd8 (DEFAULT_TABLE table=default.Table_513b29114e86449fbb9605c07529bc8a [id=4ca0ecdc61be47a8a7ee4833ce6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.530422 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 735e4f4e5b38447d8f705879796c3dd8 (DEFAULT_TABLE table=default.Table_513b29114e86449fbb9605c07529bc8a [id=4ca0ecdc61be47a8a7ee4833ce6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.530821 6271 tablet_bootstrap.cc:654] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.532833 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 3116c1aa4f7e410f826d9ef49e53c32b (DEFAULT_TABLE table=default.Table_ece70b41d4eb46518b578adcd84e586d [id=c15fdef86b9b443994f935786cf30388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.533375 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 735e4f4e5b38447d8f705879796c3dd8 (DEFAULT_TABLE table=default.Table_513b29114e86449fbb9605c07529bc8a [id=4ca0ecdc61be47a8a7ee4833ce6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:06.535979 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2922360e7a1b4545a085beeadcd2b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.536206 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f317439c55e4575a0d72ef282c467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.536453 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735e4f4e5b38447d8f705879796c3dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.536696 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.537066 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3116c1aa4f7e410f826d9ef49e53c32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.537187 6271 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.537335 6271 ts_tablet_manager.cc:1397] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260928 10:44:06.538174 6271 raft_consensus.cc:348] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.538450 6271 raft_consensus.cc:374] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.538589 6271 raft_consensus.cc:729] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.538899 6271 consensus_queue.cc:260] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.540447 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b907eb6a33af4e45a3f94f08176f8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.544566 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 474e9ca2deb1478a87c978d1e119fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.544799 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b907eb6a33af4e45a3f94f08176f8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.545120 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c4112b4c54996815486b205646925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.545594 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f317439c55e4575a0d72ef282c467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.545977 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9c596f9cd28453883d0299e698fba31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.546339 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2922360e7a1b4545a085beeadcd2b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.546720 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.547147 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a78458ef1bd44c5acb9ae98f123089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.547550 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735e4f4e5b38447d8f705879796c3dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.547932 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.548434 6793 raft_consensus.cc:482] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.548583 6793 raft_consensus.cc:504] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.549192 6793 leader_election.cc:288] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:06.550264 5957 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:06.550617 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3116c1aa4f7e410f826d9ef49e53c32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.554445 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2922360e7a1b4545a085beeadcd2b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.554909 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d5dd4e5b544262938b1822510d8b9f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.555245 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c4112b4c54996815486b205646925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.555758 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3116c1aa4f7e410f826d9ef49e53c32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.556265 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b907eb6a33af4e45a3f94f08176f8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.555027 6153 raft_consensus.cc:3037] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.559624 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 474e9ca2deb1478a87c978d1e119fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.559808 6271 ts_tablet_manager.cc:1428] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260928 10:44:06.560309 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.560765 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a78458ef1bd44c5acb9ae98f123089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.561216 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44ccc7e67b7b4d1ea7e1f331bf9151d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.561656 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9c596f9cd28453883d0299e698fba31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.561901 6271 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.562124 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f317439c55e4575a0d72ef282c467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.562995 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 735e4f4e5b38447d8f705879796c3dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:06.563972 6271 tablet_bootstrap.cc:654] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.564558 6866 raft_consensus.cc:482] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.564713 6866 raft_consensus.cc:504] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.565328 6866 leader_election.cc:288] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.566000 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a973a1d20e3437c87ad889c723e7ebc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.569749 5818 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:06.570343 5955 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.570533 5955 leader_election.cc:302] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.570415 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a973a1d20e3437c87ad889c723e7ebc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.571286 6793 raft_consensus.cc:482] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.571472 6793 raft_consensus.cc:504] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.572105 6793 leader_election.cc:288] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.572295 6793 raft_consensus.cc:2726] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.573020 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:06.573217 5884 raft_consensus.cc:2454] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:06.573580 5817 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.573637 5957 leader_election.cc:302] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:06.573717 5817 leader_election.cc:302] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.574041 6866 raft_consensus.cc:2726] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.574259 6885 raft_consensus.cc:2781] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:06.574339 6885 raft_consensus.cc:482] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:06.574460 6885 raft_consensus.cc:3037] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.575343 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.576911 5955 leader_election.cc:341] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.583223 6271 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:06.583468 6271 ts_tablet_manager.cc:1397] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.001s
I20260928 10:44:06.584210 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:06.584306 6271 raft_consensus.cc:348] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.584759 6271 raft_consensus.cc:374] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.584880 6271 raft_consensus.cc:729] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.585743 6271 consensus_queue.cc:260] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.587150 6271 ts_tablet_manager.cc:1428] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:06.587520 6271 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:06.588760 6886 raft_consensus.cc:482] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.588919 6886 raft_consensus.cc:504] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.589162 6271 tablet_bootstrap.cc:654] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.589532 6886 leader_election.cc:288] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:06.590811 6091 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e25db69b15eb445792e6168f99304bf2
I20260928 10:44:06.592367 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25db69b15eb445792e6168f99304bf2" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:06.592638 6018 raft_consensus.cc:2454] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:06.593091 6090 leader_election.cc:302] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.593597 6886 raft_consensus.cc:2781] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:06.593729 6886 raft_consensus.cc:482] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:06.593830 6886 raft_consensus.cc:3037] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.596011 6866 raft_consensus.cc:482] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.596163 6866 raft_consensus.cc:504] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.596755 6866 leader_election.cc:288] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.596765 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_badf08dfe1b94607a829bed69d42c735"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.597397 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_badf08dfe1b94607a829bed69d42c735 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.597707 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847b18c212474456ac9b40eee055dbd0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.598286 5818 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.600553 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1a86ef60e78644ebb3a6b912b67ca670" } modify_external_catalogs: true
I20260928 10:44:06.600831 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1a86ef60e78644ebb3a6b912b67ca670" } modify_external_catalogs: true
I20260928 10:44:06.604967 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847b18c212474456ac9b40eee055dbd0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.606196 5817 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.606397 5817 leader_election.cc:302] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.606664 6866 raft_consensus.cc:2726] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.615705 5695 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_34437f380f6e451baa642895afcea0d9 [id=489e2ce035cb42c3ad1ed5ced42dcdc8] alter complete (version 1)
I20260928 10:44:06.616355 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5e1e3ea1a661416086c4d032a3722b2c" } modify_external_catalogs: true
I20260928 10:44:06.616617 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5e1e3ea1a661416086c4d032a3722b2c" } modify_external_catalogs: true
I20260928 10:44:06.618269 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 474e9ca2deb1478a87c978d1e119fa5f
I20260928 10:44:06.619125 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2d2f6d17577e40a38a8af4624ead8bd1" } new_table_name: "default.Table_a000edb49a80410497d61b1ac00bc9f0" modify_external_catalogs: true
I20260928 10:44:06.620761 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 946188e312c6424f81926465667b5e11
I20260928 10:44:06.621413 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:06.621867 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bc7aa301bfbb4097b386a0d23cfa91e1
I20260928 10:44:06.622642 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_84e9d3f88eec46678082f982b74ca6bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.623330 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84e9d3f88eec46678082f982b74ca6bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.627094 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 946188e312c6424f81926465667b5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.627419 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.627526 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_45302aea8a9b42e493bf551696752984"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:06.628348 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45302aea8a9b42e493bf551696752984 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.629776 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4
I20260928 10:44:06.631316 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 with delete_type TABLET_DATA_DELETED (replaced by tablet a3b0ec0cf3bc4a09b0aaa15d18873f70) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.631712 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 deleted and replaced by tablet a3b0ec0cf3bc4a09b0aaa15d18873f70
I20260928 10:44:06.632139 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_82450110c71748558bf2346d11abac19" } new_table_name: "default.Table_e82fc545ded548edbd67df9c7b88e916" modify_external_catalogs: true
I20260928 10:44:06.637089 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_be18240efd154023873afce4c90875f7" } new_table_name: "default.Table_54215b2fe6184beaba657eca6c992e0a" modify_external_catalogs: true
I20260928 10:44:06.639365 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.639807 6866 raft_consensus.cc:482] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.640007 6866 raft_consensus.cc:504] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.640774 6866 leader_election.cc:288] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.641607 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.641744 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.642031 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.642177 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 946188e312c6424f81926465667b5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.642536 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.642756 5817 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.642843 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f4ec87e39b70409fa42c35946fa4269e" } new_table_name: "default.Table_953f97aea2a646c58e4604ffbe233e1e" modify_external_catalogs: true
W20260928 10:44:06.643230 5818 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.643347 5818 leader_election.cc:302] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.642141 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 with delete_type TABLET_DATA_DELETED (replaced by tablet a3b0ec0cf3bc4a09b0aaa15d18873f70) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.644011 6866 raft_consensus.cc:2726] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.651011 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.651357 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.651407 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 946188e312c6424f81926465667b5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.654771 6885 raft_consensus.cc:504] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.655534 6885 leader_election.cc:288] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.656422 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:06.656630 5884 raft_consensus.cc:3037] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.659417 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 with delete_type TABLET_DATA_DELETED (replaced by tablet a3b0ec0cf3bc4a09b0aaa15d18873f70) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.659808 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.660825 6272 ts_tablet_manager.cc:1918] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.672484 6866 raft_consensus.cc:482] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.672633 6866 raft_consensus.cc:504] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.673255 6866 leader_election.cc:288] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.691119 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.691816 5818 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.674002 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.719821 6272 log.cc:1196] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/733ca22794da4015bbe09ed6c374ad05
I20260928 10:44:06.708791 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:06.720340 5817 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.720538 5817 leader_election.cc:302] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.720882 6272 ts_tablet_manager.cc:1939] T 733ca22794da4015bbe09ed6c374ad05 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:06.720846 6866 raft_consensus.cc:2726] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.708410 6919 raft_consensus.cc:482] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.721174 6919 raft_consensus.cc:504] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.722067 6919 leader_election.cc:288] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:06.723587 6091 leader_election.cc:341] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 92912af8cba4453a8e3422896d586855
I20260928 10:44:06.724649 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92912af8cba4453a8e3422896d586855" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:06.724920 6018 raft_consensus.cc:2454] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:06.725440 6090 leader_election.cc:302] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.725888 6919 raft_consensus.cc:2781] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:06.725996 6919 raft_consensus.cc:482] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:06.726068 6919 raft_consensus.cc:3037] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:06.726126 5955 leader_election.cc:341] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.731899 6866 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.732106 6866 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.732851 6866 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.733654 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.733844 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.734541 5817 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:06.734690 5818 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.734833 5818 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.735244 6866 raft_consensus.cc:2726] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.739629 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 474e9ca2deb1478a87c978d1e119fa5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.746049 6866 raft_consensus.cc:482] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.746229 6866 raft_consensus.cc:504] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.746970 6866 leader_election.cc:288] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.748559 6269 ts_tablet_manager.cc:1918] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.748679 6269 log.cc:1196] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8b21a965426145c9b678ae80869be833
I20260928 10:44:06.748996 6269 ts_tablet_manager.cc:1939] T 8b21a965426145c9b678ae80869be833 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.748055 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25c7f3b94e94cafb3275a2e190be0ed" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.756505 5817 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.757823 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25c7f3b94e94cafb3275a2e190be0ed" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.758607 5818 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.758751 5818 leader_election.cc:302] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.759358 6866 raft_consensus.cc:2726] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.759810 5884 raft_consensus.cc:2454] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:06.760299 5957 leader_election.cc:302] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.760710 6885 raft_consensus.cc:2781] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:06.760861 6885 raft_consensus.cc:686] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:06.761094 6885 consensus_queue.cc:237] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.762742 6886 raft_consensus.cc:504] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.763372 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 644) took 1191 ms. Trace:
I20260928 10:44:06.763458 6269 rpcz_store.cc:276] 0928 10:44:05.571850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.574426 (+ 2576us) service_pool.cc:227] Handling call
0928 10:44:06.515837 (+941411us) ts_tablet_manager.cc:1145] Deleting tablet 8b21a965426145c9b678ae80869be833
0928 10:44:06.515845 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.651876 (+136031us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.748435 (+ 96559us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.763350 (+ 14915us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":941188}
I20260928 10:44:06.763792 6269 tablet_replica.cc:330] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.763976 6269 raft_consensus.cc:2229] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.764114 6269 raft_consensus.cc:2258] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:06.764204 6091 leader_election.cc:341] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e25db69b15eb445792e6168f99304bf2
I20260928 10:44:06.764628 6269 ts_tablet_manager.cc:1905] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.770725 6886 leader_election.cc:288] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:06.771266 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25db69b15eb445792e6168f99304bf2" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:06.771515 6018 raft_consensus.cc:3037] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.773876 6272 tablet_replica.cc:330] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:06.776897 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 733ca22794da4015bbe09ed6c374ad05 (table default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]) successfully deleted
I20260928 10:44:06.789656 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8b21a965426145c9b678ae80869be833 (table default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]) successfully deleted
I20260928 10:44:06.796922 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7ef1b939f9aa4f988180d5ea0a4a8a15
W20260928 10:44:06.799825 5803 kernel_stack_watchdog.cc:198] Thread 6273 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 277ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f1e4cef4980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f1e49c0ebfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f1e49c2efd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f1e49c2abeb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f1e49c2fcef kudu::ThreadPool::Submit() at ??:0
@ 0x7f1e54ad006d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f1e54acf0bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f1e54aceca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f1e54ad6a02 kudu::log::Log::Init() at ??:0
@ 0x7f1e54ad5dbf kudu::log::Log::Open() at ??:0
@ 0x7f1e563672ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f1e563637dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f1e56361fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 10:44:06.800438 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.803659 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ab5abdd2484f41d7bd244db14d2b1916
I20260928 10:44:06.809636 6273 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.809820 6273 ts_tablet_manager.cc:1397] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.415s user 0.126s sys 0.142s
I20260928 10:44:06.813138 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.813973 6273 raft_consensus.cc:348] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.813974 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6041d6982c9a4e86a6ca799b1de4ab48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:06.814213 6273 raft_consensus.cc:374] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.814265 6273 raft_consensus.cc:729] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.814536 6273 consensus_queue.cc:260] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:06.815093 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6041d6982c9a4e86a6ca799b1de4ab48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:06.815171 6273 ts_tablet_manager.cc:1428] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:44:06.818125 6273 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.822033 6273 tablet_bootstrap.cc:654] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.833325 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.835359 6273 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.835328 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.835531 6273 ts_tablet_manager.cc:1397] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260928 10:44:06.835630 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:06.836301 6273 raft_consensus.cc:348] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.836515 6273 raft_consensus.cc:374] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.836562 6273 raft_consensus.cc:729] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.836773 6273 consensus_queue.cc:260] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.837307 6273 ts_tablet_manager.cc:1428] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260928 10:44:06.836992 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet ab5abdd2484f41d7bd244db14d2b1916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.838171 6273 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.841323 6273 tablet_bootstrap.cc:654] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.847884 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.849933 6919 raft_consensus.cc:504] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.850636 6919 leader_election.cc:288] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:06.853037 6269 ts_tablet_manager.cc:1918] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.853157 6269 log.cc:1196] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:06.853426 6269 ts_tablet_manager.cc:1939] T 104a223ec6ef47988d0aa3335a1f81de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:06.854446 6272 raft_consensus.cc:2229] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.854710 6018 raft_consensus.cc:2454] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:06.855472 6272 raft_consensus.cc:2258] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.856142 6272 ts_tablet_manager.cc:1905] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.856318 6090 leader_election.cc:302] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.856928 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92912af8cba4453a8e3422896d586855" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:06.857193 6018 raft_consensus.cc:3037] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:06.858520 6273 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.858680 6273 ts_tablet_manager.cc:1397] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.003s
I20260928 10:44:06.858650 6919 raft_consensus.cc:2781] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:06.858808 6919 raft_consensus.cc:686] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:06.859112 6919 consensus_queue.cc:237] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.859604 6273 raft_consensus.cc:348] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.859845 6273 raft_consensus.cc:374] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.859925 6273 raft_consensus.cc:729] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.860239 6273 consensus_queue.cc:260] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.860777 6273 ts_tablet_manager.cc:1428] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:06.861268 6273 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:06.862946 6091 leader_election.cc:341] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 92912af8cba4453a8e3422896d586855
I20260928 10:44:06.863207 6273 tablet_bootstrap.cc:654] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.874464 6273 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.874634 6273 ts_tablet_manager.cc:1397] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260928 10:44:06.875403 6273 raft_consensus.cc:348] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.875626 6273 raft_consensus.cc:374] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.875677 6273 raft_consensus.cc:729] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.875891 6273 consensus_queue.cc:260] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.876430 6273 ts_tablet_manager.cc:1428] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:06.876681 6273 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.878813 6273 tablet_bootstrap.cc:654] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.896581 6273 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.896754 6273 ts_tablet_manager.cc:1397] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20260928 10:44:06.897421 6270 ts_tablet_manager.cc:1918] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:06.897583 6270 log.cc:1196] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/01433ce37b2c49cd858ea88877ca56da
I20260928 10:44:06.897572 6273 raft_consensus.cc:348] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.897806 6273 raft_consensus.cc:374] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.897857 6273 raft_consensus.cc:729] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.897991 6270 ts_tablet_manager.cc:1939] T 01433ce37b2c49cd858ea88877ca56da P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:06.898096 6273 consensus_queue.cc:260] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.898239 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.898917 6273 ts_tablet_manager.cc:1428] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:06.899327 6273 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.901336 6273 tablet_bootstrap.cc:654] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.904361 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 651) took 1294 ms. Trace:
I20260928 10:44:06.904459 6269 rpcz_store.cc:276] 0928 10:44:05.609894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.623346 (+ 13452us) service_pool.cc:227] Handling call
0928 10:44:06.763749 (+1140403us) ts_tablet_manager.cc:1145] Deleting tablet 104a223ec6ef47988d0aa3335a1f81de
0928 10:44:06.763760 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.849881 (+ 86121us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.852922 (+ 3041us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.904335 (+ 51413us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1140148}
I20260928 10:44:06.904899 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 664) took 1161 ms. Trace:
I20260928 10:44:06.904969 6269 rpcz_store.cc:276] 0928 10:44:05.744407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.744984 (+ 577us) service_pool.cc:227] Handling call
0928 10:44:06.904736 (+1159752us) ts_tablet_manager.cc:1145] Deleting tablet 30fb3f88e66b4f8582fb348e035af290
0928 10:44:06.904749 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.904880 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159541}
I20260928 10:44:06.905273 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 665) took 1160 ms. Trace:
I20260928 10:44:06.905337 6269 rpcz_store.cc:276] 0928 10:44:05.744568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.745226 (+ 658us) service_pool.cc:227] Handling call
0928 10:44:06.905173 (+1159947us) ts_tablet_manager.cc:1145] Deleting tablet 734c09c7645c4dd3a05f6508297ee48b
0928 10:44:06.905183 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.905259 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159772}
I20260928 10:44:06.905634 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 666) took 1160 ms. Trace:
I20260928 10:44:06.905700 6269 rpcz_store.cc:276] 0928 10:44:05.744692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.745429 (+ 737us) service_pool.cc:227] Handling call
0928 10:44:06.905522 (+1160093us) ts_tablet_manager.cc:1145] Deleting tablet 9cc439f216a04f2e861c2d87364eb3dd
0928 10:44:06.905531 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.905621 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1157905}
I20260928 10:44:06.905982 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 668) took 1161 ms. Trace:
I20260928 10:44:06.906045 6269 rpcz_store.cc:276] 0928 10:44:05.744926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.745528 (+ 602us) service_pool.cc:227] Handling call
0928 10:44:06.905882 (+1160354us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:06.905891 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.905967 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158077}
I20260928 10:44:06.906314 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 667) took 1161 ms. Trace:
I20260928 10:44:06.907016 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 104a223ec6ef47988d0aa3335a1f81de (table default.Table_a98c668a7dea48138cdba63f65364fe8 [id=87c3591cdbf34ccc8c10269033b20843]) successfully deleted
W20260928 10:44:06.907366 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 30fb3f88e66b4f8582fb348e035af290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fb3f88e66b4f8582fb348e035af290 already in progress: creating tablet
W20260928 10:44:06.907573 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 734c09c7645c4dd3a05f6508297ee48b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c09c7645c4dd3a05f6508297ee48b already in progress: creating tablet
I20260928 10:44:06.908039 6885 raft_consensus.cc:482] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:06.907783 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9cc439f216a04f2e861c2d87364eb3dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cc439f216a04f2e861c2d87364eb3dd already in progress: creating tablet
I20260928 10:44:06.908210 6885 raft_consensus.cc:504] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:06.908345 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b6d5121db2d34ea99c851595c395f3be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6d5121db2d34ea99c851595c395f3be already in progress: creating tablet
I20260928 10:44:06.906378 6269 rpcz_store.cc:276] 0928 10:44:05.744800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.745506 (+ 706us) service_pool.cc:227] Handling call
0928 10:44:06.906230 (+1160724us) ts_tablet_manager.cc:1145] Deleting tablet 66f13643dbb64dcf97c4d6d94c22d8b1
0928 10:44:06.906238 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.906301 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158296}
I20260928 10:44:06.908686 6269 tablet_replica.cc:330] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:06.908885 6269 raft_consensus.cc:2229] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.909044 6269 raft_consensus.cc:2258] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.909509 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd13e6a9d8f04fa3abb8d22a80932dae" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:06.909606 6269 ts_tablet_manager.cc:1905] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:06.910748 6885 leader_election.cc:288] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:06.910941 5955 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:06.911576 5957 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:06.911710 5957 leader_election.cc:302] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.912139 6885 raft_consensus.cc:2726] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:06.913218 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f13643dbb64dcf97c4d6d94c22d8b1 already in progress: creating tablet
I20260928 10:44:06.914654 6866 raft_consensus.cc:482] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.914803 6866 raft_consensus.cc:504] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.915591 6866 leader_election.cc:288] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.916363 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:06.917021 5818 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.918597 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.919234 5817 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.919361 5817 leader_election.cc:302] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:06.919741 6866 raft_consensus.cc:2726] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.921868 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.923887 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_409bf812ca684359b4bf9c0e9858ba1b" } new_table_name: "default.Table_edb18f5358d7424c80dfc183b20822a3" modify_external_catalogs: true
I20260928 10:44:06.924695 6273 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.924896 6273 ts_tablet_manager.cc:1397] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.006s
I20260928 10:44:06.925704 6273 raft_consensus.cc:348] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.925961 6273 raft_consensus.cc:374] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.926038 6273 raft_consensus.cc:729] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.926318 6273 consensus_queue.cc:260] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.927161 6273 ts_tablet_manager.cc:1428] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:06.927487 6273 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.927692 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:06.929487 6273 tablet_bootstrap.cc:654] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.932289 6885 raft_consensus.cc:482] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.932490 6885 raft_consensus.cc:504] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.933256 6885 leader_election.cc:288] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:06.933779 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:06.934019 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97401498df144cc689066ea3033d68ef" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.934669 5955 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:06.935989 5957 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 97401498df144cc689066ea3033d68ef
I20260928 10:44:06.936116 5957 leader_election.cc:302] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.936479 6885 raft_consensus.cc:2726] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.937794 6885 raft_consensus.cc:482] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:06.937948 6885 raft_consensus.cc:504] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.938628 6885 leader_election.cc:288] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.939442 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9583b5637a428db383320d98a7a280" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:06.940193 5955 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:06.940610 6275 tablet_bootstrap.cc:492] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:06.941274 5957 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0e9583b5637a428db383320d98a7a280
I20260928 10:44:06.941406 5957 leader_election.cc:302] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:06.941788 6885 raft_consensus.cc:2726] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:06.945160 6273 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.945312 6273 ts_tablet_manager.cc:1397] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20260928 10:44:06.946182 6273 raft_consensus.cc:348] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.946460 6273 raft_consensus.cc:374] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.946597 6273 raft_consensus.cc:729] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.946882 6273 consensus_queue.cc:260] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:06.947640 6275 ts_tablet_manager.cc:1397] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.461s user 0.002s sys 0.002s
I20260928 10:44:06.947842 6273 ts_tablet_manager.cc:1428] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 10:44:06.948130 6273 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:06.949301 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f799021aca384269bfcd67829f3a7db5 consensus state has no leader
I20260928 10:44:06.949676 6273 tablet_bootstrap.cc:654] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.955274 6275 raft_consensus.cc:348] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.955578 6275 raft_consensus.cc:374] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.955667 6275 raft_consensus.cc:729] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.956537 6273 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.956727 6273 ts_tablet_manager.cc:1397] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260928 10:44:06.957531 6273 raft_consensus.cc:348] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.957798 6273 raft_consensus.cc:374] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.957877 6273 raft_consensus.cc:729] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.958134 6273 consensus_queue.cc:260] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:06.958755 6273 ts_tablet_manager.cc:1428] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260928 10:44:06.959120 6273 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.959779 6275 consensus_queue.cc:260] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.960417 6275 ts_tablet_manager.cc:1428] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 10:44:06.960738 6273 tablet_bootstrap.cc:654] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.962503 6275 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:06.962646 6018 raft_consensus.cc:2454] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:06.963181 6090 leader_election.cc:302] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:06.963395 6090 raft_consensus.cc:2670] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:06.963490 6273 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.963611 6273 ts_tablet_manager.cc:1397] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:44:06.964368 6273 raft_consensus.cc:348] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.964581 6273 raft_consensus.cc:374] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.964663 6273 raft_consensus.cc:729] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.964923 6275 tablet_bootstrap.cc:654] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.964937 6273 consensus_queue.cc:260] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.965473 6273 ts_tablet_manager.cc:1428] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:06.965751 6273 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.967250 6273 tablet_bootstrap.cc:654] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.972795 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 625) took 1826 ms. Trace:
I20260928 10:44:06.972951 6270 rpcz_store.cc:276] 0928 10:44:05.146361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.146794 (+ 433us) service_pool.cc:227] Handling call
0928 10:44:06.475956 (+1329162us) ts_tablet_manager.cc:1145] Deleting tablet 01433ce37b2c49cd858ea88877ca56da
0928 10:44:06.475969 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.651902 (+175933us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.897245 (+245343us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:06.972739 (+ 75494us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1328834}
I20260928 10:44:06.973613 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 01433ce37b2c49cd858ea88877ca56da (table default.Table_c54e444afb3043c0adbaeafa7e6edb1c [id=ba1f625ad33143bca567a8788d0d95b2]) successfully deleted
I20260928 10:44:06.981289 6273 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:06.981460 6273 ts_tablet_manager.cc:1397] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260928 10:44:06.982187 6273 raft_consensus.cc:348] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.982412 6273 raft_consensus.cc:374] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:06.982502 6273 raft_consensus.cc:729] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:06.982755 6273 consensus_queue.cc:260] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:06.983286 6273 ts_tablet_manager.cc:1428] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:06.983572 6273 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:06.985008 6270 tablet_replica.cc:330] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:06.985098 6273 tablet_bootstrap.cc:654] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:06.985255 6270 raft_consensus.cc:2229] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:06.985430 6270 raft_consensus.cc:2258] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:06.996790 6275 tablet_bootstrap.cc:492] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:06.996968 6275 ts_tablet_manager.cc:1397] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260928 10:44:07.001989 6866 raft_consensus.cc:482] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:07.048058 6892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260928 10:44:07.054752 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_43a5208eab5b4b7abb0fa84d3bfecf55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.106518 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43a5208eab5b4b7abb0fa84d3bfecf55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.070832 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b5a72ab188b64c3da03c015ca7a7006e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.107540 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5a72ab188b64c3da03c015ca7a7006e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.074290 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3d4024e567a4b978bb13dd4b201f440 consensus state has no leader
I20260928 10:44:07.002214 6866 raft_consensus.cc:504] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:07.082515 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 consensus state has no leader
I20260928 10:44:07.005681 6273 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:07.108850 6273 ts_tablet_manager.cc:1397] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.004s
W20260928 10:44:07.082813 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a47129ab5444dcab0a3f92a16046db consensus state has no leader
I20260928 10:44:07.109182 6866 leader_election.cc:288] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:06.997839 6275 raft_consensus.cc:348] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.109386 6275 raft_consensus.cc:374] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.109503 6275 raft_consensus.cc:729] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.109728 6275 consensus_queue.cc:260] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.109752 6273 raft_consensus.cc:348] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.110002 6273 raft_consensus.cc:374] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.110105 6273 raft_consensus.cc:729] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.110325 6275 ts_tablet_manager.cc:1428] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.113s user 0.001s sys 0.002s
I20260928 10:44:07.110325 6273 consensus_queue.cc:260] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.110670 6275 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:07.110965 6273 ts_tablet_manager.cc:1428] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:07.111291 6273 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:07.112409 6275 tablet_bootstrap.cc:654] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.112861 6273 tablet_bootstrap.cc:654] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.035243 6270 ts_tablet_manager.cc:1905] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:07.074102 6271 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:07.113500 6271 ts_tablet_manager.cc:1397] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.526s user 0.083s sys 0.087s
I20260928 10:44:07.066955 6269 ts_tablet_manager.cc:1918] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:07.113775 6269 log.cc:1196] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/54b78fbf508f4e47bd31661e05dcaa16
I20260928 10:44:07.114167 6269 ts_tablet_manager.cc:1939] T 54b78fbf508f4e47bd31661e05dcaa16 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:07.114305 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 0f2a010ebf004152bda4b2c27e23bc6b (DEFAULT_TABLE table=default.Table_d5a63d9baed7423480f46bd6010a919e [id=ab32829a173f4458a1924e4fbbfd0a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.002751 6155 raft_consensus.cc:3037] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:07.114728 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f2a010ebf004152bda4b2c27e23bc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.114907 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 4a5564088c5e45788794f130134b5ba5 (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.115247 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a5564088c5e45788794f130134b5ba5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.051287 6892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 10:44:07.116590 6892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 10:44:07.062167 6272 ts_tablet_manager.cc:1918] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:07.118023 6272 log.cc:1196] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/92912af8cba4453a8e3422896d586855
I20260928 10:44:07.118237 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 65818f9decf840b1b63f3e52236128b6 (DEFAULT_TABLE table=default.Table_6f18ad86c85b4f70b1d01f04b67f1b30 [id=42d1e54107994c9e8e472befcb1cfc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.118453 6272 ts_tablet_manager.cc:1939] T 92912af8cba4453a8e3422896d586855 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:07.118706 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65818f9decf840b1b63f3e52236128b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.118901 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e05cdd590894adcb987ef3ac78bf416" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.121109 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 57c4f7edb76a4710bd5abe2999451a97 (DEFAULT_TABLE table=default.Table_5e0cc66b896a4eac89ac1b70cc98142c [id=70d5afb1e44544b993ef6721e8ad7f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.121543 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c4f7edb76a4710bd5abe2999451a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.099334 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 (DEFAULT_TABLE table=default.Table_b912bd21046b46f7b5c6adedb0933598 [id=a95c4cc197b1441882aa60f0be70d5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.099792 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 10c23684385749e98359126cfd04b6f7 (DEFAULT_TABLE table=default.Table_1bbdb0db659d4027b6dc40bfb96dd123 [id=f16fc5e29fd1420fbbba5bfe7a2c57db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.100159 5984 tablet_service.cc:1467] Processing CreateTablet for tablet cea632558fd546a0a7ef17c050973ebc (DEFAULT_TABLE table=default.Table_fd6798c7a514425c9c9f3e15748748e2 [id=61a04877a20e4d5681e2ade9c727e611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.100541 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 0f2a010ebf004152bda4b2c27e23bc6b (DEFAULT_TABLE table=default.Table_d5a63d9baed7423480f46bd6010a919e [id=ab32829a173f4458a1924e4fbbfd0a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.100880 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 65818f9decf840b1b63f3e52236128b6 (DEFAULT_TABLE table=default.Table_6f18ad86c85b4f70b1d01f04b67f1b30 [id=42d1e54107994c9e8e472befcb1cfc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.101228 5991 tablet_service.cc:1467] Processing CreateTablet for tablet a51503bd3800461d87b7dabcd8dcdad8 (DEFAULT_TABLE table=default.Table_939fb34bc15b40d481d475412cf8513c [id=7dddc9f3b64f40d2ba8e7210025b165c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.101577 5992 tablet_service.cc:1467] Processing CreateTablet for tablet b820ef6381c44b44a4d4e3ebb9f99802 (DEFAULT_TABLE table=default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.101890 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 4a5564088c5e45788794f130134b5ba5 (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.102213 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 57c4f7edb76a4710bd5abe2999451a97 (DEFAULT_TABLE table=default.Table_5e0cc66b896a4eac89ac1b70cc98142c [id=70d5afb1e44544b993ef6721e8ad7f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.102757 5995 tablet_service.cc:1467] Processing CreateTablet for tablet b5be4edbfc11495b972a8ca68be46d38 (DEFAULT_TABLE table=default.Table_7e9af122dd484e7b93ea68f097022ac8 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.103076 5985 tablet_service.cc:1467] Processing CreateTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 (DEFAULT_TABLE table=default.Table_81611dc2ea444355bfc90e472d8088d7 [id=7d839170a31941c99df23baac40e8711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.103255 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.114389 6271 raft_consensus.cc:348] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.123971 6271 raft_consensus.cc:374] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.124104 6271 raft_consensus.cc:729] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.124372 6271 consensus_queue.cc:260] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.124997 6271 ts_tablet_manager.cc:1428] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260928 10:44:07.124956 5855 tablet_service.cc:1467] Processing CreateTablet for tablet b820ef6381c44b44a4d4e3ebb9f99802 (DEFAULT_TABLE table=default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.125334 6271 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:07.125396 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b820ef6381c44b44a4d4e3ebb9f99802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.127120 6271 tablet_bootstrap.cc:654] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.130880 5847 tablet_service.cc:1467] Processing CreateTablet for tablet a51503bd3800461d87b7dabcd8dcdad8 (DEFAULT_TABLE table=default.Table_939fb34bc15b40d481d475412cf8513c [id=7dddc9f3b64f40d2ba8e7210025b165c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.131312 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51503bd3800461d87b7dabcd8dcdad8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.133735 6892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 10:44:07.133855 6892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 10:44:07.133908 6892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 10:44:07.133975 6892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 10:44:07.071838 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet d40123712b17464e87023f69a6235640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.102571 6128 tablet_service.cc:1467] Processing CreateTablet for tablet b820ef6381c44b44a4d4e3ebb9f99802 (DEFAULT_TABLE table=default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.135246 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b820ef6381c44b44a4d4e3ebb9f99802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.103266 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 (DEFAULT_TABLE table=default.Table_b912bd21046b46f7b5c6adedb0933598 [id=a95c4cc197b1441882aa60f0be70d5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.138861 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47cd73e527d04194a7ca8c24a7134e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.140301 6271 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:07.140489 6271 ts_tablet_manager.cc:1397] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260928 10:44:07.141356 6271 raft_consensus.cc:348] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.141707 6271 raft_consensus.cc:374] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.141790 6271 raft_consensus.cc:729] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.142099 6271 consensus_queue.cc:260] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.103648 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 10c23684385749e98359126cfd04b6f7 (DEFAULT_TABLE table=default.Table_1bbdb0db659d4027b6dc40bfb96dd123 [id=f16fc5e29fd1420fbbba5bfe7a2c57db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.142763 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c23684385749e98359126cfd04b6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.104054 6129 tablet_service.cc:1467] Processing CreateTablet for tablet cea632558fd546a0a7ef17c050973ebc (DEFAULT_TABLE table=default.Table_fd6798c7a514425c9c9f3e15748748e2 [id=61a04877a20e4d5681e2ade9c727e611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.104427 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 0f2a010ebf004152bda4b2c27e23bc6b (DEFAULT_TABLE table=default.Table_d5a63d9baed7423480f46bd6010a919e [id=ab32829a173f4458a1924e4fbbfd0a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.144797 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f2a010ebf004152bda4b2c27e23bc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.147660 6271 ts_tablet_manager.cc:1428] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 10:44:07.104803 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 65818f9decf840b1b63f3e52236128b6 (DEFAULT_TABLE table=default.Table_6f18ad86c85b4f70b1d01f04b67f1b30 [id=42d1e54107994c9e8e472befcb1cfc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.105141 6120 tablet_service.cc:1467] Processing CreateTablet for tablet a51503bd3800461d87b7dabcd8dcdad8 (DEFAULT_TABLE table=default.Table_939fb34bc15b40d481d475412cf8513c [id=7dddc9f3b64f40d2ba8e7210025b165c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.105472 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 4a5564088c5e45788794f130134b5ba5 (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.105875 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 57c4f7edb76a4710bd5abe2999451a97 (DEFAULT_TABLE table=default.Table_5e0cc66b896a4eac89ac1b70cc98142c [id=70d5afb1e44544b993ef6721e8ad7f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.106241 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.106649 6134 tablet_service.cc:1467] Processing CreateTablet for tablet b5be4edbfc11495b972a8ca68be46d38 (DEFAULT_TABLE table=default.Table_7e9af122dd484e7b93ea68f097022ac8 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.107013 6135 tablet_service.cc:1467] Processing CreateTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 (DEFAULT_TABLE table=default.Table_81611dc2ea444355bfc90e472d8088d7 [id=7d839170a31941c99df23baac40e8711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.107417 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 7834a54e59114a77b4e54e9190049a47 (DEFAULT_TABLE table=default.Table_f049c872214e4df18f99f9fb5a53066e [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.148396 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65818f9decf840b1b63f3e52236128b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.148669 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a5564088c5e45788794f130134b5ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.150849 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c4f7edb76a4710bd5abe2999451a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.151206 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea632558fd546a0a7ef17c050973ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.151647 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bd3593f7ac421cbed8ac5797e068fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.154851 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5be4edbfc11495b972a8ca68be46d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.155233 6866 raft_consensus.cc:482] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:07.155351 5818 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.155453 6866 raft_consensus.cc:504] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.096485 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 (DEFAULT_TABLE table=default.Table_b912bd21046b46f7b5c6adedb0933598 [id=a95c4cc197b1441882aa60f0be70d5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.156090 6866 leader_election.cc:288] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.156558 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47cd73e527d04194a7ca8c24a7134e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.083436 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bbb6a08018174f08998a7eab84a49785"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.096916 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 10c23684385749e98359126cfd04b6f7 (DEFAULT_TABLE table=default.Table_1bbdb0db659d4027b6dc40bfb96dd123 [id=f16fc5e29fd1420fbbba5bfe7a2c57db]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.158938 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbb6a08018174f08998a7eab84a49785 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.158931 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 7834a54e59114a77b4e54e9190049a47 (DEFAULT_TABLE table=default.Table_f049c872214e4df18f99f9fb5a53066e [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.084600 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d6f388d56f04696940caef30b213ca6 consensus state has no leader
I20260928 10:44:07.097276 5851 tablet_service.cc:1467] Processing CreateTablet for tablet cea632558fd546a0a7ef17c050973ebc (DEFAULT_TABLE table=default.Table_fd6798c7a514425c9c9f3e15748748e2 [id=61a04877a20e4d5681e2ade9c727e611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.161306 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c08de4d3d9ce4f20bed63a830c987c35" } modify_external_catalogs: true
I20260928 10:44:07.161429 6866 raft_consensus.cc:482] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.161562 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c08de4d3d9ce4f20bed63a830c987c35" } modify_external_catalogs: true
I20260928 10:44:07.161576 6866 raft_consensus.cc:504] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.162220 6866 leader_election.cc:288] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.162627 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.093297 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_da001657320f4ce8828ab3628a0dda5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.163419 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da001657320f4ce8828ab3628a0dda5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.163503 5817 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.163726 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "122fbbe54c174c4ea9cf38698debcb27" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.164183 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.164170 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "122fbbe54c174c4ea9cf38698debcb27" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:07.164744 5817 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.164841 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47cd73e527d04194a7ca8c24a7134e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.165283 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e05cdd590894adcb987ef3ac78bf416" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.165380 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c23684385749e98359126cfd04b6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.165834 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea632558fd546a0a7ef17c050973ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.093911 5699 catalog_manager.cc:5495] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:07.166237 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f2a010ebf004152bda4b2c27e23bc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.166209 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:07.095039 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:07.166683 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65818f9decf840b1b63f3e52236128b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.166811 5693 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:07.167085 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51503bd3800461d87b7dabcd8dcdad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.167480 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b820ef6381c44b44a4d4e3ebb9f99802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.167886 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a5564088c5e45788794f130134b5ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.168292 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c4f7edb76a4710bd5abe2999451a97. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.168381 5818 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.168542 5818 leader_election.cc:302] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.168710 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5be4edbfc11495b972a8ca68be46d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.168979 6866 raft_consensus.cc:2726] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.169119 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c52b6b88a44a4e925dcf1c3f9232e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.169075 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_faa74a90a095409ea38ab67215ce9599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.169384 5817 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.169512 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bd3593f7ac421cbed8ac5797e068fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.169502 5817 leader_election.cc:302] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:07.169605 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faa74a90a095409ea38ab67215ce9599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.169867 6866 raft_consensus.cc:2726] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.171052 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c52b6b88a44a4e925dcf1c3f9232e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.172117 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 7834a54e59114a77b4e54e9190049a47 (DEFAULT_TABLE table=default.Table_f049c872214e4df18f99f9fb5a53066e [id=71404aed630447bd8818fbfa887ce197]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.168984 5818 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.174515 5818 leader_election.cc:302] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.174883 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7834a54e59114a77b4e54e9190049a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.177023 6866 raft_consensus.cc:2726] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.179270 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 8d03d764256a4a8d9d8bb17b82fe8bda from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:07.183935 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51503bd3800461d87b7dabcd8dcdad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.187163 6275 tablet_bootstrap.cc:492] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:07.187338 6275 ts_tablet_manager.cc:1397] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.077s user 0.008s sys 0.010s
I20260928 10:44:07.187994 6866 raft_consensus.cc:482] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.188097 6275 raft_consensus.cc:348] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.188145 6866 raft_consensus.cc:504] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.188306 6275 raft_consensus.cc:374] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.188370 6275 raft_consensus.cc:729] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.188623 6275 consensus_queue.cc:260] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.188796 6866 leader_election.cc:288] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.188792 6273 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:07.188998 6273 ts_tablet_manager.cc:1397] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.003s
I20260928 10:44:07.183488 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 9e05cdd590894adcb987ef3ac78bf416 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:07.189657 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.189934 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed33c2546a3642f6a2a41c9bb2a66d92" } modify_external_catalogs: true
I20260928 10:44:07.190131 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed33c2546a3642f6a2a41c9bb2a66d92" } modify_external_catalogs: true
W20260928 10:44:07.190237 5817 leader_election.cc:341] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.190287 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.190521 6275 ts_tablet_manager.cc:1428] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:44:07.190549 6018 raft_consensus.cc:2454] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:07.191222 6275 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:07.191558 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3b1deda1bd154d1eb664ab35409fc281"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.191782 5818 leader_election.cc:302] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:07.192114 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b1deda1bd154d1eb664ab35409fc281 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.183378 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3a1e1ce29c64491bab1b15a6e7a0590b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.192523 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a1e1ce29c64491bab1b15a6e7a0590b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.192742 6275 tablet_bootstrap.cc:654] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.196931 6866 raft_consensus.cc:482] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.197223 6960 raft_consensus.cc:482] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.197155 6866 raft_consensus.cc:504] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.197336 6960 raft_consensus.cc:504] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.197721 6919 raft_consensus.cc:482] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.197844 6866 leader_election.cc:288] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.198024 6866 raft_consensus.cc:2781] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:07.197892 6919 raft_consensus.cc:504] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.198117 6866 raft_consensus.cc:482] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:07.198211 6866 raft_consensus.cc:3037] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:07.198128 5862 tablet_service.cc:1467] Processing CreateTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 (DEFAULT_TABLE table=default.Table_81611dc2ea444355bfc90e472d8088d7 [id=7d839170a31941c99df23baac40e8711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.198582 6919 leader_election.cc:288] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.199173 6272 tablet_replica.cc:330] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:07.199390 6272 raft_consensus.cc:2229] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:07.199568 6272 raft_consensus.cc:2258] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:07.199450 6273 raft_consensus.cc:348] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.199699 6273 raft_consensus.cc:374] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.199775 6273 raft_consensus.cc:729] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:07.199882 6090 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 01433ce37b2c49cd858ea88877ca56da
I20260928 10:44:07.200182 6272 ts_tablet_manager.cc:1905] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:07.200562 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5590c0fd47fdbf44e5217b8d0be6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:07.201121 5817 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.186848 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_34437f380f6e451baa642895afcea0d9" } modify_external_catalogs: true
I20260928 10:44:07.201426 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_34437f380f6e451baa642895afcea0d9" } modify_external_catalogs: true
I20260928 10:44:07.187191 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f9ce53bc5bf4d87ae8e51adc7d25447" } modify_external_catalogs: true
I20260928 10:44:07.202004 6273 consensus_queue.cc:260] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.202219 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f9ce53bc5bf4d87ae8e51adc7d25447" } modify_external_catalogs: true
I20260928 10:44:07.187335 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:07.202652 6273 ts_tablet_manager.cc:1428] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260928 10:44:07.203366 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 59bfe1f8050f47429ef80a19fdcd8198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.203737 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:07.204700 5817 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.203576 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 9aeb55c2547e417090fd36664cbe69f6 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:07.205279 6960 leader_election.cc:288] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.205482 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.205847 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.188514 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5199c77c44b746dba7428ddc716b0da3" } modify_external_catalogs: true
I20260928 10:44:07.205963 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.206034 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5199c77c44b746dba7428ddc716b0da3" } modify_external_catalogs: true
I20260928 10:44:07.206120 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.206298 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.206933 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.207881 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.207895 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.208757 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 92912af8cba4453a8e3422896d586855 (table default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]) successfully deleted
W20260928 10:44:07.209038 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bae5a2038947413f95f134602081c889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bae5a2038947413f95f134602081c889 already in progress: creating tablet
I20260928 10:44:07.209245 6275 tablet_bootstrap.cc:492] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:07.209565 6275 ts_tablet_manager.cc:1397] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260928 10:44:07.210399 6275 raft_consensus.cc:348] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.210708 6275 raft_consensus.cc:374] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.210860 6275 raft_consensus.cc:729] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.211166 6275 consensus_queue.cc:260] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.211881 6275 ts_tablet_manager.cc:1428] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:07.212194 6275 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:07.215420 6275 tablet_bootstrap.cc:654] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.215438 5856 tablet_service.cc:1467] Processing CreateTablet for tablet b5be4edbfc11495b972a8ca68be46d38 (DEFAULT_TABLE table=default.Table_7e9af122dd484e7b93ea68f097022ac8 [id=e3733a9fe17f44ba846823d669e7d99b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.217135 6960 raft_consensus.cc:482] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.217248 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5590c0fd47fdbf44e5217b8d0be6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.217468 6960 raft_consensus.cc:504] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.218102 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.218639 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db824b43256640e9bfef44da1ccf8e1a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:07.218909 5818 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.219030 5818 leader_election.cc:302] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.219275 6885 raft_consensus.cc:482] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:07.219415 5818 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.219521 5818 leader_election.cc:302] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.219414 6885 raft_consensus.cc:504] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:07.220027 6091 leader_election.cc:341] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 01433ce37b2c49cd858ea88877ca56da
I20260928 10:44:07.220053 6885 leader_election.cc:288] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.220149 6091 leader_election.cc:302] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:07.220341 6091 raft_consensus.cc:2670] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:44:07.220657 5817 leader_election.cc:341] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.221009 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.221035 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1631d396362a4cffa1dec06d00894c63" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.221151 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db824b43256640e9bfef44da1ccf8e1a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.221603 5955 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.221619 6961 raft_consensus.cc:2726] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.221817 6961 raft_consensus.cc:2726] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.223256 6960 leader_election.cc:288] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.228639 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f63312cb046844dc8eddbb76f614029b
I20260928 10:44:07.229727 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet f63312cb046844dc8eddbb76f614029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.230207 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet f63312cb046844dc8eddbb76f614029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.232326 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c3abf9908c8a4f1d92a406a8eef2dcc9" } new_table_name: "default.Table_fcc0c6d5167346e8a8cc3737da784c57" modify_external_catalogs: true
I20260928 10:44:07.233749 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
W20260928 10:44:07.235739 5818 leader_election.cc:341] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.236037 5818 leader_election.cc:302] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.236294 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:07.236624 5957 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1631d396362a4cffa1dec06d00894c63
I20260928 10:44:07.236763 5957 leader_election.cc:302] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:07.237214 6885 raft_consensus.cc:2726] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.238384 6965 raft_consensus.cc:2726] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.244930 6885 raft_consensus.cc:482] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.245111 6885 raft_consensus.cc:504] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.245257 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9aeb55c2547e417090fd36664cbe69f6
I20260928 10:44:07.245354 6275 tablet_bootstrap.cc:492] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:07.245801 6885 leader_election.cc:288] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:07.247243 5957 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:07.247951 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 48af35fb4a8e482fb0ff45eecf4e2a42) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.247381 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 9aeb55c2547e417090fd36664cbe69f6 deleted and replaced by tablet 48af35fb4a8e482fb0ff45eecf4e2a42
I20260928 10:44:07.248083 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.248317 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 48af35fb4a8e482fb0ff45eecf4e2a42) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:07.248662 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.249455 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 75539c390965493eaa69a0d1215fa922
I20260928 10:44:07.250233 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 75539c390965493eaa69a0d1215fa922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.250624 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 75539c390965493eaa69a0d1215fa922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.250875 6275 ts_tablet_manager.cc:1397] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.002s
I20260928 10:44:07.252072 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a0d63c6cbc4eebaf42dc7f969f243c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:07.252646 5955 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.252794 5955 leader_election.cc:302] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:07.252674 6275 raft_consensus.cc:348] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.253175 6885 raft_consensus.cc:2726] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.253726 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8d03d764256a4a8d9d8bb17b82fe8bda
I20260928 10:44:07.254026 6275 raft_consensus.cc:374] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:07.254120 6275 raft_consensus.cc:729] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:07.254895 6275 consensus_queue.cc:260] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.255900 6275 ts_tablet_manager.cc:1428] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:07.257730 6271 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:07.258278 6965 raft_consensus.cc:482] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.259251 6270 ts_tablet_manager.cc:1918] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:07.259138 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda with delete_type TABLET_DATA_DELETED (replaced by tablet 8b167fd6cdbd4b829d962ebafeee0272) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.259414 6270 log.cc:1196] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:07.259791 6270 ts_tablet_manager.cc:1939] T 59bfe1f8050f47429ef80a19fdcd8198 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:07.260022 6965 raft_consensus.cc:504] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.260366 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 8d03d764256a4a8d9d8bb17b82fe8bda deleted and replaced by tablet 8b167fd6cdbd4b829d962ebafeee0272
I20260928 10:44:07.263170 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.263811 5818 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.263185 6866 raft_consensus.cc:504] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.265432 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_75c707b2a65f40339161004ffec1adf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.266373 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75c707b2a65f40339161004ffec1adf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.264478 6965 leader_election.cc:288] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.268405 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c23684385749e98359126cfd04b6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.268508 6866 leader_election.cc:288] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.273775 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7834a54e59114a77b4e54e9190049a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.276351 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.279419 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 672) took 1155 ms. Trace:
I20260928 10:44:07.279516 6269 rpcz_store.cc:276] 0928 10:44:06.124373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.124436 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:06.908635 (+784199us) ts_tablet_manager.cc:1145] Deleting tablet 54b78fbf508f4e47bd31661e05dcaa16
0928 10:44:06.908648 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:06.966839 (+ 58191us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.066785 (+ 99946us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.279379 (+212594us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":783953}
I20260928 10:44:07.279928 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 673) took 1119 ms. Trace:
I20260928 10:44:07.280009 6269 rpcz_store.cc:276] 0928 10:44:06.160543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.160611 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:07.279802 (+1119191us) ts_tablet_manager.cc:1145] Deleting tablet 383eb18f1c0c46209ff5b47e468b9950
0928 10:44:07.279812 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.279914 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118929}
I20260928 10:44:07.280320 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 675) took 1094 ms. Trace:
W20260928 10:44:07.280400 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 383eb18f1c0c46209ff5b47e468b9950 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 383eb18f1c0c46209ff5b47e468b9950 already in progress: creating tablet
I20260928 10:44:07.280386 6269 rpcz_store.cc:276] 0928 10:44:06.185627 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.185699 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:07.280213 (+1094514us) ts_tablet_manager.cc:1145] Deleting tablet 7db49404752e4501a594608fc325ebe9
0928 10:44:07.280223 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.280306 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094276}
I20260928 10:44:07.280679 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 677) took 1094 ms. Trace:
W20260928 10:44:07.280781 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7db49404752e4501a594608fc325ebe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7db49404752e4501a594608fc325ebe9 already in progress: creating tablet
I20260928 10:44:07.280743 6269 rpcz_store.cc:276] 0928 10:44:06.185836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.185888 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:07.280569 (+1094681us) ts_tablet_manager.cc:1145] Deleting tablet 34e41838d44e400f9934ea40a198e606
0928 10:44:07.280578 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.280666 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094493}
I20260928 10:44:07.280979 6269 tablet_replica.cc:330] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:07.281118 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 34e41838d44e400f9934ea40a198e606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34e41838d44e400f9934ea40a198e606 already in progress: creating tablet
I20260928 10:44:07.281139 6269 raft_consensus.cc:2229] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:07.281136 6892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.100.84:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.125:37939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.100.125
--webserver_port=45673
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 09:56:20 UTC on ccycloud.quasar-pbuesr.root.comops.site
build id 4676955
ASAN enabled
I20260928 10:44:07.281270 6269 raft_consensus.cc:2258] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:07.281774 6269 ts_tablet_manager.cc:1905] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:07.282152 6273 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:07.283818 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 72a0adec506e4ca9b10989f18d6c0c22
W20260928 10:44:07.285298 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c957158dbd949e88554e70fe6146089 consensus state has no leader
I20260928 10:44:07.285305 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.288875 6892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 10:44:07.294353 6271 tablet_bootstrap.cc:654] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.294775 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7834a54e59114a77b4e54e9190049a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.298702 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:07.299085 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda with delete_type TABLET_DATA_DELETED (replaced by tablet 8b167fd6cdbd4b829d962ebafeee0272) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.299988 6021 raft_consensus.cc:3037] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:07.300743 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.307089 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_13d789c0fc444386b903db86421ebf12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.307796 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13d789c0fc444386b903db86421ebf12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.311461 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.315475 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_88d07a9bf5e545e1a6b1bf8b19669858" } new_table_name: "default.Table_7f5a671a2bc9426e970e4e3543fe5eb5" modify_external_catalogs: true
I20260928 10:44:07.317015 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4b775dafa08f42cc9c34848213b744ba" } new_table_name: "default.Table_52772ab5e18a4c5aac56813b955f0f5f" modify_external_catalogs: true
I20260928 10:44:07.318507 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fcc0c6d5167346e8a8cc3737da784c57" } new_table_name: "default.Table_e93cadb12e6c4f88b9d44f1c0d43d522" modify_external_catalogs: true
I20260928 10:44:07.323411 6892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 10:44:07.332067 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dddbd630c6d9446b9ff317c963cd00d3 consensus state has no leader
I20260928 10:44:07.338972 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.340718 5999 tablet_service.cc:1467] Processing CreateTablet for tablet ba5fb83b301e487f993ca6fd8f5dd515 (DEFAULT_TABLE table=default.Table_84e9d3f88eec46678082f982b74ca6bf [id=b1e9e969208e4105b57eff0223add0b8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.343205 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e5bec611c95429ab309957f74b70eea consensus state has no leader
I20260928 10:44:07.343854 5859 tablet_service.cc:1467] Processing CreateTablet for tablet ba5fb83b301e487f993ca6fd8f5dd515 (DEFAULT_TABLE table=default.Table_84e9d3f88eec46678082f982b74ca6bf [id=b1e9e969208e4105b57eff0223add0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.345726 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0471473cce114d3985f9a8de2de77d39
I20260928 10:44:07.346868 6866 raft_consensus.cc:482] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.346930 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 0471473cce114d3985f9a8de2de77d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:07.347011 6866 raft_consensus.cc:504] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.347635 6866 leader_election.cc:288] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.348368 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.348894 5818 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:07.349076 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c957158dbd949e88554e70fe6146089 consensus state has no leader
I20260928 10:44:07.351109 5847 tablet_service.cc:1467] Processing CreateTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca (DEFAULT_TABLE table=default.Table_badf08dfe1b94607a829bed69d42c735 [id=65cb0f7036b046d1947fe76484975c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.353801 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 56146954215e4129813dc550d2ac1e3f (DEFAULT_TABLE table=default.Table_5ec435e9be9b4e05a290cce679ce9b50 [id=56d9d4c1ec6e4b25b84c0dc0f0d546eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.355377 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 6bed74e76d514654b024880f46a1525c (DEFAULT_TABLE table=default.Table_04da22a497e64c02ba05e303e848a626 [id=d0e070f45f564ec88430a1a687a944b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.360999 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 56146954215e4129813dc550d2ac1e3f (DEFAULT_TABLE table=default.Table_5ec435e9be9b4e05a290cce679ce9b50 [id=56d9d4c1ec6e4b25b84c0dc0f0d546eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.363823 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 850693fd00274d98ab347eb40ae76b85 (DEFAULT_TABLE table=default.Table_6041d6982c9a4e86a6ca799b1de4ab48 [id=984046bde23c47cea92f917ab0a61e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.364032 5861 tablet_service.cc:1467] Processing CreateTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.363883 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbd9fe7116a429f8faf1b38184b2f4a (DEFAULT_TABLE table=default.Table_70a5507af48d4a689baa7a6e5d1c39b3 [id=f4f9c92875fa4930ac489954289857cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.364202 5860 tablet_service.cc:1467] Processing CreateTablet for tablet d1b89a8edd5645afa41693f5bca42f8d (DEFAULT_TABLE table=default.Table_51b44c6d9a684eabbcde0c5855980627 [id=2b41eb68ef6149a6abff5aad16fc7521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.363838 5846 tablet_service.cc:1467] Processing CreateTablet for tablet c7f4ce1792fd494687863136583be109 (DEFAULT_TABLE table=default.Table_c482d492c6f147919876101634e2f217 [id=d7975e20b3f44534a0e96607e7c7b428]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.375969 6969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:44:07.383134 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 624) took 2157 ms. Trace:
I20260928 10:44:07.390038 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2791ed0f44e341b6bf437f3eaa4b97a9" } new_table_name: "default.Table_476d854135964e5b8282613d5baa7c96" modify_external_catalogs: true
I20260928 10:44:07.391273 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba5fb83b301e487f993ca6fd8f5dd515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.391978 6866 raft_consensus.cc:482] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.392122 6866 raft_consensus.cc:504] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.392692 6866 leader_election.cc:288] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.393080 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5a1bc9dc67d74038a5408f85eb8836c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.393575 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_21e16de584264e87b52eb815094c2d0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.394119 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21e16de584264e87b52eb815094c2d0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.394029 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_027e045946fe474dbafb252ca0ec9ef0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.394510 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_027e045946fe474dbafb252ca0ec9ef0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.401150 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2ce585cc60d4001b12cb335929b9efb consensus state has no leader
I20260928 10:44:07.404940 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet f63312cb046844dc8eddbb76f614029b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.407951 6275 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:07.393743 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a1bc9dc67d74038a5408f85eb8836c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.417138 6866 raft_consensus.cc:482] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.417342 6866 raft_consensus.cc:504] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:07.418032 6866 leader_election.cc:288] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.418798 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet cd13e6a9d8f04fa3abb8d22a80932dae with delete_type TABLET_DATA_DELETED (replaced by tablet 04b947da50894cdba0f49d0738f60187) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.419100 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeb55c2547e417090fd36664cbe69f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 48af35fb4a8e482fb0ff45eecf4e2a42) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.419965 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 75539c390965493eaa69a0d1215fa922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.420573 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a0adec506e4ca9b10989f18d6c0c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.420855 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda with delete_type TABLET_DATA_DELETED (replaced by tablet 8b167fd6cdbd4b829d962ebafeee0272) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.423115 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1bbdb0db659d4027b6dc40bfb96dd123" } modify_external_catalogs: true
I20260928 10:44:07.423406 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1bbdb0db659d4027b6dc40bfb96dd123" } modify_external_catalogs: true
I20260928 10:44:07.427204 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d26c74de94724ee2b24a0473731ab348"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.427888 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d26c74de94724ee2b24a0473731ab348 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.431345 6275 tablet_bootstrap.cc:654] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:07.440550 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.441248 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.442960 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 85f90d3cbc724e289f525c2a89296ce4 (table default.Table_a2df4c84bb2e4b3095ad3099ac5093bf [id=66014dc8377e450f82d79b62a481c58f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 85f90d3cbc724e289f525c2a89296ce4 consensus state has no leader
I20260928 10:44:07.443081 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_781804886015445ca7413cdb7e25e9cd" } modify_external_catalogs: true
I20260928 10:44:07.443292 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_781804886015445ca7413cdb7e25e9cd" } modify_external_catalogs: true
I20260928 10:44:07.443919 5863 tablet_service.cc:1467] Processing CreateTablet for tablet e964ef4fddfd4e369b92b3f491154e6b (DEFAULT_TABLE table=default.Table_faa74a90a095409ea38ab67215ce9599 [id=181a47aaca834b11bd4dab1b0c9d1cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.445191 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dd9ab8b729544b908fe750000e5b528d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.445819 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd9ab8b729544b908fe750000e5b528d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.447098 5864 tablet_service.cc:1467] Processing CreateTablet for tablet d837b4e19de9467082a1578b292792e6 (DEFAULT_TABLE table=default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1 [id=84a5c7a939424f5fb572c4f173b8adca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.447718 5852 tablet_service.cc:1467] Processing CreateTablet for tablet b36a7574ab1d4038a21b6831340fe626 (DEFAULT_TABLE table=default.Table_3a1e1ce29c64491bab1b15a6e7a0590b [id=ac54e6859b0b4194b7432bb5e1698bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.450737 5845 tablet_service.cc:1467] Processing CreateTablet for tablet bb1bcd4d4b6d4257a443e18fe1a7881f (DEFAULT_TABLE table=default.Table_da001657320f4ce8828ab3628a0dda5c [id=8553a16de863444295193a9674e0a6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.452159 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 10c23684385749e98359126cfd04b6f7
I20260928 10:44:07.453836 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1312101176de4669988b8e0090027832" } modify_external_catalogs: true
I20260928 10:44:07.454066 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1312101176de4669988b8e0090027832" } modify_external_catalogs: true
I20260928 10:44:07.466280 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d42e218538814686a6c8308b1bc43949
I20260928 10:44:07.470595 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 0471473cce114d3985f9a8de2de77d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.458278 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.472792 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6f317439c55e4575a0d72ef282c467d5
I20260928 10:44:07.477277 5987 tablet_service.cc:1467] Processing CreateTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca (DEFAULT_TABLE table=default.Table_badf08dfe1b94607a829bed69d42c735 [id=65cb0f7036b046d1947fe76484975c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.477730 6270 rpcz_store.cc:276] 0928 10:44:05.146222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.147164 (+ 942us) service_pool.cc:227] Handling call
0928 10:44:06.982909 (+1835745us) ts_tablet_manager.cc:1145] Deleting tablet 59bfe1f8050f47429ef80a19fdcd8198
0928 10:44:06.982923 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.164748 (+181825us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.259112 (+ 94364us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.303646 (+ 44534us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1835473}
I20260928 10:44:07.482172 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbd9fe7116a429f8faf1b38184b2f4a (DEFAULT_TABLE table=default.Table_70a5507af48d4a689baa7a6e5d1c39b3 [id=f4f9c92875fa4930ac489954289857cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.485617 5998 tablet_service.cc:1467] Processing CreateTablet for tablet d1b89a8edd5645afa41693f5bca42f8d (DEFAULT_TABLE table=default.Table_51b44c6d9a684eabbcde0c5855980627 [id=2b41eb68ef6149a6abff5aad16fc7521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.485908 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6cf5abf0ce2d41ee996b121d077c5fda" } modify_external_catalogs: true
I20260928 10:44:07.486162 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6cf5abf0ce2d41ee996b121d077c5fda" } modify_external_catalogs: true
I20260928 10:44:07.487069 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8c0911722bcd44c482d7070d941798f0" } new_table_name: "default.Table_3a223846547e4541b652fe1662cd3647" modify_external_catalogs: true
I20260928 10:44:07.487990 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 6bed74e76d514654b024880f46a1525c (DEFAULT_TABLE table=default.Table_04da22a497e64c02ba05e303e848a626 [id=d0e070f45f564ec88430a1a687a944b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.488371 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 850693fd00274d98ab347eb40ae76b85 (DEFAULT_TABLE table=default.Table_6041d6982c9a4e86a6ca799b1de4ab48 [id=984046bde23c47cea92f917ab0a61e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.489799 6866 raft_consensus.cc:482] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.489964 6866 raft_consensus.cc:504] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:07.490602 6866 leader_election.cc:288] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.492479 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39cbecd1c19541f28bd32b7c46f2df61" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.494380 5818 leader_election.cc:341] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.500986 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 59bfe1f8050f47429ef80a19fdcd8198 (table default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]) successfully deleted
I20260928 10:44:07.503732 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e89d3b5d65454b2982e625dd4f909bfb
W20260928 10:44:07.509474 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 593015cc3f8547b5a08043d2c016ec91 consensus state has no leader
I20260928 10:44:07.511580 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56146954215e4129813dc550d2ac1e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.511955 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a36ae00e0f664d4da444a6a4a17bcbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.512377 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850693fd00274d98ab347eb40ae76b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.515931 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b89a8edd5645afa41693f5bca42f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.520584 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbd9fe7116a429f8faf1b38184b2f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.521113 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6ecb8e4169d14e90a7409639bc795f36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.521792 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ecb8e4169d14e90a7409639bc795f36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.523134 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bed74e76d514654b024880f46a1525c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.527026 6270 tablet_replica.cc:330] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:07.527275 6270 raft_consensus.cc:2229] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:07.527458 6270 raft_consensus.cc:2258] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:07.527341 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6456c36640e446fda654b2aeee90b200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.527937 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6456c36640e446fda654b2aeee90b200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.527993 6270 ts_tablet_manager.cc:1905] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:07.529999 6000 tablet_service.cc:1467] Processing CreateTablet for tablet c7f4ce1792fd494687863136583be109 (DEFAULT_TABLE table=default.Table_c482d492c6f147919876101634e2f217 [id=d7975e20b3f44534a0e96607e7c7b428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.530541 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.530943 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e1f8a63fed4c82ac95c2fbb7bc633d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.531520 5818 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:07.531723 5818 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.532078 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f4ce1792fd494687863136583be109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.535362 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c23cc31a216a4b848be3124e27ac3758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.535961 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c23cc31a216a4b848be3124e27ac3758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.539922 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2f828f5ec19e4fe48fcc0313452241cf" } new_table_name: "default.Table_988aa420fecd47ddb39944580036195a" modify_external_catalogs: true
I20260928 10:44:07.543463 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6661e71ec33a42e6b191196785162b9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.544303 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6661e71ec33a42e6b191196785162b9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.546911 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_257888168c6742c6b8e8cee352d1f468" } new_table_name: "default.Table_08fb425defb24a40a3203b8de718af55" modify_external_catalogs: true
W20260928 10:44:07.548417 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6bf7ae81883467095a04ff22fe0c7f8 consensus state has no leader
I20260928 10:44:07.551404 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6fb701fbad2b4bbb8767a204ac5595f5" } modify_external_catalogs: true
I20260928 10:44:07.551664 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6fb701fbad2b4bbb8767a204ac5595f5" } modify_external_catalogs: true
I20260928 10:44:07.552314 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ebcbdae68e524eca87a2587129902f3d" } new_table_name: "default.Table_cc3ed363602c40ac9aaaba04d960f861" modify_external_catalogs: true
I20260928 10:44:07.552301 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.552815 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bc65ca1ba01481a9efed520c2ea471c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.556257 6793 consensus_queue.cc:1035] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:07.557814 5686 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939): Couldn't send request to peer 7a1529a7b0d7479db7dabebf471795b5. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 10:44:07.554826 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.565943 6021 raft_consensus.cc:2454] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:07.565943 6127 tablet_service.cc:1467] Processing CreateTablet for tablet ba5fb83b301e487f993ca6fd8f5dd515 (DEFAULT_TABLE table=default.Table_84e9d3f88eec46678082f982b74ca6bf [id=b1e9e969208e4105b57eff0223add0b8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.566330 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4082931c332f40fc9c6530190fb61017 consensus state has no leader
I20260928 10:44:07.566375 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba5fb83b301e487f993ca6fd8f5dd515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.566443 5818 leader_election.cc:302] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:07.566723 6866 raft_consensus.cc:2781] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:07.566855 6866 raft_consensus.cc:686] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:07.567230 6919 raft_consensus.cc:482] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.567219 6866 consensus_queue.cc:237] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.567368 6919 raft_consensus.cc:504] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.567953 6919 leader_election.cc:288] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.569595 5993 tablet_service.cc:1467] Processing CreateTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.570004 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.570719 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:07.571256 5984 tablet_service.cc:1467] Processing CreateTablet for tablet b7806c41e8424bad929bd2682d0e8129 (DEFAULT_TABLE table=default.Table_75c707b2a65f40339161004ffec1adf1 [id=27dc61c64ea34b459149ed482a4032a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.571600 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7806c41e8424bad929bd2682d0e8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.572011 6001 tablet_service.cc:1467] Processing CreateTablet for tablet e964ef4fddfd4e369b92b3f491154e6b (DEFAULT_TABLE table=default.Table_faa74a90a095409ea38ab67215ce9599 [id=181a47aaca834b11bd4dab1b0c9d1cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.572685 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e964ef4fddfd4e369b92b3f491154e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.575696 6119 tablet_service.cc:1467] Processing CreateTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca (DEFAULT_TABLE table=default.Table_badf08dfe1b94607a829bed69d42c735 [id=65cb0f7036b046d1947fe76484975c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.576074 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a36ae00e0f664d4da444a6a4a17bcbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.578604 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.584198 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40123712b17464e87023f69a6235640" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:07.584431 6021 raft_consensus.cc:2454] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:07.584533 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7d762e03b384d85b4e04be8331474a4 consensus state has no leader
W20260928 10:44:07.586692 5817 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.586819 5817 leader_election.cc:302] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.587162 6965 raft_consensus.cc:2726] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:07.588450 5817 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.588551 5817 leader_election.cc:302] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:07.588832 5817 leader_election.cc:341] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:07.589025 5817 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.589087 5817 leader_election.cc:302] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.589274 6960 raft_consensus.cc:2726] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.589391 6960 raft_consensus.cc:2726] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.590859 6122 tablet_service.cc:1467] Processing CreateTablet for tablet c7f4ce1792fd494687863136583be109 (DEFAULT_TABLE table=default.Table_c482d492c6f147919876101634e2f217 [id=d7975e20b3f44534a0e96607e7c7b428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.591292 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f4ce1792fd494687863136583be109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.591390 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 850693fd00274d98ab347eb40ae76b85 (DEFAULT_TABLE table=default.Table_6041d6982c9a4e86a6ca799b1de4ab48 [id=984046bde23c47cea92f917ab0a61e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.591744 6129 tablet_service.cc:1467] Processing CreateTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 (DEFAULT_TABLE table=default.Table_1ae67fee604d4932ae0e0ade17ccb28a [id=613bbe90d61e405599e0d4813171ba06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.592145 6128 tablet_service.cc:1467] Processing CreateTablet for tablet b7806c41e8424bad929bd2682d0e8129 (DEFAULT_TABLE table=default.Table_75c707b2a65f40339161004ffec1adf1 [id=27dc61c64ea34b459149ed482a4032a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.592384 6118 tablet_service.cc:1467] Processing CreateTablet for tablet e964ef4fddfd4e369b92b3f491154e6b (DEFAULT_TABLE table=default.Table_faa74a90a095409ea38ab67215ce9599 [id=181a47aaca834b11bd4dab1b0c9d1cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.592717 6126 tablet_service.cc:1467] Processing CreateTablet for tablet d837b4e19de9467082a1578b292792e6 (DEFAULT_TABLE table=default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1 [id=84a5c7a939424f5fb572c4f173b8adca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.592862 6121 tablet_service.cc:1467] Processing CreateTablet for tablet b36a7574ab1d4038a21b6831340fe626 (DEFAULT_TABLE table=default.Table_3a1e1ce29c64491bab1b15a6e7a0590b [id=ac54e6859b0b4194b7432bb5e1698bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.593355 6125 tablet_service.cc:1467] Processing CreateTablet for tablet bb1bcd4d4b6d4257a443e18fe1a7881f (DEFAULT_TABLE table=default.Table_da001657320f4ce8828ab3628a0dda5c [id=8553a16de863444295193a9674e0a6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.593864 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c23684385749e98359126cfd04b6f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.592144 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.594723 6135 tablet_service.cc:1467] Processing CreateTablet for tablet d1b89a8edd5645afa41693f5bca42f8d (DEFAULT_TABLE table=default.Table_51b44c6d9a684eabbcde0c5855980627 [id=2b41eb68ef6149a6abff5aad16fc7521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.594816 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7806c41e8424bad929bd2682d0e8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.595072 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b89a8edd5645afa41693f5bca42f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.595654 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e964ef4fddfd4e369b92b3f491154e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.596181 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1bcd4d4b6d4257a443e18fe1a7881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.597044 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b36a7574ab1d4038a21b6831340fe626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.594394 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7131f9259a404382e86ad06c52b584 (DEFAULT_TABLE table=default.Table_bbb6a08018174f08998a7eab84a49785 [id=5e5b21a2a82f4575abd99f78fcca4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.597612 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7131f9259a404382e86ad06c52b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.602694 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 58b58d0c904a423f9801a883a2a2dfc1
I20260928 10:44:07.602801 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 0471473cce114d3985f9a8de2de77d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.603320 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 6bed74e76d514654b024880f46a1525c (DEFAULT_TABLE table=default.Table_04da22a497e64c02ba05e303e848a626 [id=d0e070f45f564ec88430a1a687a944b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.604519 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet d42e218538814686a6c8308b1bc43949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.604780 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f317439c55e4575a0d72ef282c467d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.605191 6131 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 (DEFAULT_TABLE table=default.Table_3b1deda1bd154d1eb664ab35409fc281 [id=c2a102baa4c244cabded7656153f4cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.605441 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbd9fe7116a429f8faf1b38184b2f4a (DEFAULT_TABLE table=default.Table_70a5507af48d4a689baa7a6e5d1c39b3 [id=f4f9c92875fa4930ac489954289857cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.606645 6120 tablet_service.cc:1467] Processing CreateTablet for tablet d85cb2a30f8342ed946f7d773bf8227e (DEFAULT_TABLE table=default.Table_b5a72ab188b64c3da03c015ca7a7006e [id=07f036aa3d1d4510b8008431fcb58935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.607267 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_48c975dd6a964ba3872c1953b0008bf0" } new_table_name: "default.Table_be4d1ac72b4d4b6b800c5581b54a252f" modify_external_catalogs: true
I20260928 10:44:07.607978 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e1f8a63fed4c82ac95c2fbb7bc633d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.608364 6090 leader_election.cc:302] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:07.608685 6919 raft_consensus.cc:2781] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:07.609344 6919 raft_consensus.cc:482] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:07.609469 6919 raft_consensus.cc:3037] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:07.610955 6965 raft_consensus.cc:482] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.611104 6965 raft_consensus.cc:504] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:07.611675 6965 leader_election.cc:288] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:07.611893 5817 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.611984 5817 leader_election.cc:302] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.613065 6965 raft_consensus.cc:2726] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.613945 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.614591 5818 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:07.614796 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4ddf3ba4d594607b3fc3ae96797bd03 consensus state has no leader
I20260928 10:44:07.625824 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a19b71a335045819bf7d07c19b45929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.626726 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a19b71a335045819bf7d07c19b45929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.630537 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bf02637fcfba4e05ab5580423e5d0cfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.631392 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf02637fcfba4e05ab5580423e5d0cfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.634778 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.637089 5991 tablet_service.cc:1467] Processing CreateTablet for tablet d837b4e19de9467082a1578b292792e6 (DEFAULT_TABLE table=default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1 [id=84a5c7a939424f5fb572c4f173b8adca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.640954 5995 tablet_service.cc:1467] Processing CreateTablet for tablet b36a7574ab1d4038a21b6831340fe626 (DEFAULT_TABLE table=default.Table_3a1e1ce29c64491bab1b15a6e7a0590b [id=ac54e6859b0b4194b7432bb5e1698bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.642379 6002 tablet_service.cc:1467] Processing CreateTablet for tablet bb1bcd4d4b6d4257a443e18fe1a7881f (DEFAULT_TABLE table=default.Table_da001657320f4ce8828ab3628a0dda5c [id=8553a16de863444295193a9674e0a6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.643579 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c23684385749e98359126cfd04b6f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.644057 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7131f9259a404382e86ad06c52b584 (DEFAULT_TABLE table=default.Table_bbb6a08018174f08998a7eab84a49785 [id=5e5b21a2a82f4575abd99f78fcca4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.654803 5999 tablet_service.cc:1467] Processing CreateTablet for tablet d85cb2a30f8342ed946f7d773bf8227e (DEFAULT_TABLE table=default.Table_b5a72ab188b64c3da03c015ca7a7006e [id=07f036aa3d1d4510b8008431fcb58935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.656970 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_534373dcfd75430c9608190a3979421a" } modify_external_catalogs: true
I20260928 10:44:07.657261 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_534373dcfd75430c9608190a3979421a" } modify_external_catalogs: true
I20260928 10:44:07.658700 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_af2781b090d9458abcf37a9e763c6eac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.659358 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af2781b090d9458abcf37a9e763c6eac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.671770 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01263e8acd0e44a6a7603edccf3d0e17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.672142 5993 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 (DEFAULT_TABLE table=default.Table_3b1deda1bd154d1eb664ab35409fc281 [id=c2a102baa4c244cabded7656153f4cb0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.672358 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01263e8acd0e44a6a7603edccf3d0e17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.675675 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet d42e218538814686a6c8308b1bc43949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.675901 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f317439c55e4575a0d72ef282c467d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.676215 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.676643 5984 tablet_service.cc:1467] Processing CreateTablet for tablet d32fdb08e63d4d018d01fb99acf77b37 (DEFAULT_TABLE table=default.Table_43a5208eab5b4b7abb0fa84d3bfecf55 [id=0d6d53a882a347e8a6ad41cb85e459f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.676918 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_868c82ae2401426fae6d2aea18ca318b" } modify_external_catalogs: true
I20260928 10:44:07.677119 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_868c82ae2401426fae6d2aea18ca318b" } modify_external_catalogs: true
I20260928 10:44:07.677000 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_10db3860b70e4b5ba9d48103a5772cc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.678035 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10db3860b70e4b5ba9d48103a5772cc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.678094 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 48af35fb4a8e482fb0ff45eecf4e2a42 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.684547 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9" } modify_external_catalogs: true
I20260928 10:44:07.687930 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d6f05259d5b4443bd6a3f13bd6aabb9" } modify_external_catalogs: true
I20260928 10:44:07.695858 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0439f5f6d4323978bb5fe2d039f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.696535 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b36a7574ab1d4038a21b6831340fe626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.696566 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet fe768adf9a1b4631b63151f8cf3cc3ba
I20260928 10:44:07.697113 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1bcd4d4b6d4257a443e18fe1a7881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.697642 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7131f9259a404382e86ad06c52b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.698256 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48af35fb4a8e482fb0ff45eecf4e2a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.702855 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bc65ca1ba01481a9efed520c2ea471c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.703858 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85cb2a30f8342ed946f7d773bf8227e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.704545 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d837b4e19de9467082a1578b292792e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.706499 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4ce39ee8f68841bfacf9e7c5617ac41c" } modify_external_catalogs: true
I20260928 10:44:07.706777 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4ce39ee8f68841bfacf9e7c5617ac41c" } modify_external_catalogs: true
I20260928 10:44:07.709030 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32fdb08e63d4d018d01fb99acf77b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.711656 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3b1deda1bd154d1eb664ab35409fc281" } new_table_name: "default.Table_796649c7c07c4a35b70da51f042d468f" modify_external_catalogs: true
I20260928 10:44:07.711826 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 355c5b2e54cb4136b27eec3d65aeab55 (DEFAULT_TABLE table=default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb [id=2881af28dc914b29b5d9b8fc6f5e6fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.713589 6866 raft_consensus.cc:482] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.713553 5857 tablet_service.cc:1467] Processing CreateTablet for tablet b7806c41e8424bad929bd2682d0e8129 (DEFAULT_TABLE table=default.Table_75c707b2a65f40339161004ffec1adf1 [id=27dc61c64ea34b459149ed482a4032a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.713757 6866 raft_consensus.cc:504] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.714650 6866 leader_election.cc:288] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:07.718575 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ddd0439f5f6d4323978bb5fe2d039f75 consensus state has no leader
I20260928 10:44:07.718730 6866 raft_consensus.cc:482] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.718883 6866 raft_consensus.cc:504] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:07.719673 6866 leader_election.cc:288] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:07.723243 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f8904f2b3dd14bb8947c8a2bfa375a03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.728058 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 56146954215e4129813dc550d2ac1e3f (DEFAULT_TABLE table=default.Table_5ec435e9be9b4e05a290cce679ce9b50 [id=56d9d4c1ec6e4b25b84c0dc0f0d546eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.728385 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bed74e76d514654b024880f46a1525c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.728530 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8904f2b3dd14bb8947c8a2bfa375a03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.725963 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39cbecd1c19541f28bd32b7c46f2df61" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:07.733054 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850693fd00274d98ab347eb40ae76b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.741415 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_513b5850f38f4e1eb5e1aeefc9de4191"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:07.741557 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1e218c9efccb4286837019833cd28a8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.742091 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_513b5850f38f4e1eb5e1aeefc9de4191 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.742211 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e218c9efccb4286837019833cd28a8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.745203 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0439f5f6d4323978bb5fe2d039f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.748503 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_856b2cdcadd34cf9bbdcdbfb02ae6e5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.749203 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_856b2cdcadd34cf9bbdcdbfb02ae6e5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.751785 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_50ccb77506cf4484aa8e95d8ed6b216c" } new_table_name: "default.Table_846ca9a639fe42a886d986ddffd8f1a1" modify_external_catalogs: true
I20260928 10:44:07.752187 6133 tablet_service.cc:1467] Processing CreateTablet for tablet d32fdb08e63d4d018d01fb99acf77b37 (DEFAULT_TABLE table=default.Table_43a5208eab5b4b7abb0fa84d3bfecf55 [id=0d6d53a882a347e8a6ad41cb85e459f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.757925 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.754801 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d3b5d65454b2982e625dd4f909bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.763206 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd5dc5f9e3648398d3e766fa9974441 (DEFAULT_TABLE table=default.Table_13d789c0fc444386b903db86421ebf12 [id=6a18b9edf0c548dbaa40476360822b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.763808 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.764482 5818 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.765457 5988 tablet_service.cc:1467] Processing CreateTablet for tablet c683d17d41e243e798cf9837fa88a4c9 (DEFAULT_TABLE table=default.Table_21e16de584264e87b52eb815094c2d0c [id=7ebc3c17f1d443719f605d871882e4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.766666 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56146954215e4129813dc550d2ac1e3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.769655 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc5d744dbc904525858a39c27636443e consensus state has no leader
I20260928 10:44:07.776777 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_edb18f5358d7424c80dfc183b20822a3" } new_table_name: "default.Table_55bab94bf4ee420aa5635c934e28f9cf" modify_external_catalogs: true
I20260928 10:44:07.781862 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d837b4e19de9467082a1578b292792e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.784792 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d6f388d56f04696940caef30b213ca6 consensus state has no leader
I20260928 10:44:07.785495 6866 raft_consensus.cc:482] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.785640 6866 raft_consensus.cc:504] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.786239 6866 leader_election.cc:288] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.786203 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_badf08dfe1b94607a829bed69d42c735" } new_table_name: "default.Table_d1a47118727d4efdb0ceec0575bbeda8" modify_external_catalogs: true
I20260928 10:44:07.795975 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 48af35fb4a8e482fb0ff45eecf4e2a42 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.800304 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b167fd6cdbd4b829d962ebafeee0272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.804834 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f049c872214e4df18f99f9fb5a53066e" } modify_external_catalogs: true
I20260928 10:44:07.805065 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f049c872214e4df18f99f9fb5a53066e" } modify_external_catalogs: true
I20260928 10:44:07.812245 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:07.814134 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32fdb08e63d4d018d01fb99acf77b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.820133 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5cfed112dcdb41b1ba08631bf2b58f32" } new_table_name: "default.Table_2b0b8147f5e54e0db7fb4e035f692d37" modify_external_catalogs: true
I20260928 10:44:07.816814 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.821584 5955 consensus_peers.cc:487] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:07.821877 5818 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.822682 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.776252 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 51d3d85454204faca17e5de63d330330 (DEFAULT_TABLE table=default.Table_d26c74de94724ee2b24a0473731ab348 [id=1e6ed2879cb64cb2ba7927e45c17b248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.828621 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]). Expected version 3 got 0
I20260928 10:44:07.830279 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:07.831075 5818 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.834092 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbd9fe7116a429f8faf1b38184b2f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.835963 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1d245c3bafda41cd8fbcdfb061c2e13b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.836699 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d245c3bafda41cd8fbcdfb061c2e13b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.840059 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd5dc5f9e3648398d3e766fa9974441 (DEFAULT_TABLE table=default.Table_13d789c0fc444386b903db86421ebf12 [id=6a18b9edf0c548dbaa40476360822b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.841624 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b7108f795f52440c8f767d6dbec2d29f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.842211 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7108f795f52440c8f767d6dbec2d29f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.845096 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dfb6bcce5abf47849bae23aa3608d3d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.845690 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfb6bcce5abf47849bae23aa3608d3d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.848428 5997 tablet_service.cc:1467] Processing CreateTablet for tablet f16bcb500113427cb1536a643b70525d (DEFAULT_TABLE table=default.Table_dd9ab8b729544b908fe750000e5b528d [id=af68cbd1beb0487ca37537e9bfec5f5b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.852771 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a36ae00e0f664d4da444a6a4a17bcbca consensus state has no leader
I20260928 10:44:07.855356 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b167fd6cdbd4b829d962ebafeee0272. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:07.857225 5986 consensus_meta.cc:287] T 47cd73e527d04194a7ca8c24a7134e09 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent flushing consensus metadata: real 0.560s user 0.014s sys 0.008s
I20260928 10:44:07.859189 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd (DEFAULT_TABLE table=default.Table_027e045946fe474dbafb252ca0ec9ef0 [id=fd90b7de83a74a68a6112d9c0b4e8cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.860895 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:07.862814 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683d17d41e243e798cf9837fa88a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.863225 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d3d85454204faca17e5de63d330330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.863541 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85cb2a30f8342ed946f7d773bf8227e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.864810 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd5dc5f9e3648398d3e766fa9974441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.865170 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355c5b2e54cb4136b27eec3d65aeab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.866184 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76b4ceadef8b4a729ca4204259e64cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.868355 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3d7a0234aba14b10acc3793dc22b5a8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.869038 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d7a0234aba14b10acc3793dc22b5a8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:07.872329 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0807f08b697a408dae06f000f759e09a consensus state has no leader
I20260928 10:44:07.858495 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 (DEFAULT_TABLE table=default.Table_5a1bc9dc67d74038a5408f85eb8836c0 [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.884650 6272 ts_tablet_manager.cc:1918] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:07.884709 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f16bcb500113427cb1536a643b70525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.889094 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bfcdaa9d8bf45c98411cf0e6febd294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.889402 6919 raft_consensus.cc:504] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.890087 6919 leader_election.cc:288] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.890805 6919 raft_consensus.cc:482] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.892781 6272 log.cc:1196] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/01433ce37b2c49cd858ea88877ca56da
I20260928 10:44:07.893194 6272 ts_tablet_manager.cc:1939] T 01433ce37b2c49cd858ea88877ca56da P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:07.893571 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 676) took 1506 ms. Trace:
I20260928 10:44:07.893708 6272 rpcz_store.cc:276] 0928 10:44:06.387455 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.387661 (+ 206us) service_pool.cc:227] Handling call
0928 10:44:07.199111 (+811450us) ts_tablet_manager.cc:1145] Deleting tablet 01433ce37b2c49cd858ea88877ca56da
0928 10:44:07.199117 (+ 6us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.391566 (+192449us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.872209 (+480643us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.893511 (+ 21302us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":811303}
I20260928 10:44:07.894155 6272 tablet_replica.cc:330] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:07.894340 6272 raft_consensus.cc:2229] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:07.894606 6272 pending_rounds.cc:62] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:07.894662 6272 pending_rounds.cc:68] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265843137552384 op_type: NO_OP noop_request { }
I20260928 10:44:07.894825 6272 raft_consensus.cc:2866] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:07.894922 6272 raft_consensus.cc:2258] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:07.895519 6272 ts_tablet_manager.cc:1905] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:07.896824 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48af35fb4a8e482fb0ff45eecf4e2a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.905916 6919 raft_consensus.cc:504] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.909229 6919 leader_election.cc:288] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:07.909459 6919 raft_consensus.cc:482] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:07.910326 6919 raft_consensus.cc:504] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:07.915634 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d3b5d65454b2982e625dd4f909bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.917148 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_52772ab5e18a4c5aac56813b955f0f5f" } modify_external_catalogs: true
I20260928 10:44:07.917414 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_52772ab5e18a4c5aac56813b955f0f5f" } modify_external_catalogs: true
I20260928 10:44:07.918306 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3170713c54864f9e94e9b7280cbb8c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.919041 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3170713c54864f9e94e9b7280cbb8c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.920917 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 355c5b2e54cb4136b27eec3d65aeab55 (DEFAULT_TABLE table=default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb [id=2881af28dc914b29b5d9b8fc6f5e6fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.922216 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b7fb557e6f6e4d41af9ff15755b9d3b5" } new_table_name: "default.Table_3dcb8c957cf04531b6c32f9e7d079d32" modify_external_catalogs: true
I20260928 10:44:07.922119 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9184a4f90f1548aca39b16ae56efd5bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:07.922812 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9184a4f90f1548aca39b16ae56efd5bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:07.923822 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 51d3d85454204faca17e5de63d330330 (DEFAULT_TABLE table=default.Table_d26c74de94724ee2b24a0473731ab348 [id=1e6ed2879cb64cb2ba7927e45c17b248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.926576 6135 tablet_service.cc:1467] Processing CreateTablet for tablet c683d17d41e243e798cf9837fa88a4c9 (DEFAULT_TABLE table=default.Table_21e16de584264e87b52eb815094c2d0c [id=7ebc3c17f1d443719f605d871882e4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.928859 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:07.922111 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd5dc5f9e3648398d3e766fa9974441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.932509 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd (DEFAULT_TABLE table=default.Table_027e045946fe474dbafb252ca0ec9ef0 [id=fd90b7de83a74a68a6112d9c0b4e8cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.932888 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76b4ceadef8b4a729ca4204259e64cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.932020 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 (DEFAULT_TABLE table=default.Table_5a1bc9dc67d74038a5408f85eb8836c0 [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:07.936035 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d3d85454204faca17e5de63d330330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.936339 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355c5b2e54cb4136b27eec3d65aeab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.937381 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683d17d41e243e798cf9837fa88a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.938339 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bfcdaa9d8bf45c98411cf0e6febd294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:07.947635 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
W20260928 10:44:07.960243 6892 thread.cc:636] Azure (cloud detector) Time spent creating pthread: real 0.613s user 0.048s sys 0.074s
I20260928 10:44:07.966970 6919 leader_election.cc:288] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:07.975610 6091 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d40123712b17464e87023f69a6235640
I20260928 10:44:07.969441 6275 tablet_bootstrap.cc:492] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:07.991940 6119 tablet_service.cc:1467] Processing CreateTablet for tablet f16bcb500113427cb1536a643b70525d (DEFAULT_TABLE table=default.Table_dd9ab8b729544b908fe750000e5b528d [id=af68cbd1beb0487ca37537e9bfec5f5b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:07.998207 5817 leader_election.cc:341] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:07.998390 5817 leader_election.cc:302] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:07.999462 6866 raft_consensus.cc:2726] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:07.979813 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.014936 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbd5d1ccd2e54f3884af3af327bb892e" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.015044 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 01433ce37b2c49cd858ea88877ca56da (table default.Table_c54e444afb3043c0adbaeafa7e6edb1c [id=ba1f625ad33143bca567a8788d0d95b2]) successfully deleted
I20260928 10:44:08.015516 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40123712b17464e87023f69a6235640" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:08.019487 6275 ts_tablet_manager.cc:1397] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.737s user 0.004s sys 0.009s
I20260928 10:44:08.022042 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f16bcb500113427cb1536a643b70525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.023638 6270 ts_tablet_manager.cc:1918] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.023828 6270 log.cc:1196] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/92912af8cba4453a8e3422896d586855
I20260928 10:44:08.024216 6270 ts_tablet_manager.cc:1939] T 92912af8cba4453a8e3422896d586855 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:08.024484 6018 raft_consensus.cc:2454] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:08.024793 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd13e6a9d8f04fa3abb8d22a80932dae" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.025045 6021 raft_consensus.cc:2454] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:08.025393 6020 raft_consensus.cc:3037] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.025768 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56146954215e4129813dc550d2ac1e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.026603 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b89a8edd5645afa41693f5bca42f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.027825 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e964ef4fddfd4e369b92b3f491154e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.028978 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 850693fd00274d98ab347eb40ae76b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.029439 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbd9fe7116a429f8faf1b38184b2f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.029634 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f4ce1792fd494687863136583be109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.029840 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1bcd4d4b6d4257a443e18fe1a7881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.030059 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b36a7574ab1d4038a21b6831340fe626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.030607 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7806c41e8424bad929bd2682d0e8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.030833 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.031219 6892 thread.cc:602] Azure (cloud detector) Time spent starting thread: real 0.614s user 0.048s sys 0.074s
I20260928 10:44:08.031854 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.032313 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bd3593f7ac421cbed8ac5797e068fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.032702 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba5fb83b301e487f993ca6fd8f5dd515. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.032737 6271 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.634s user 0.001s sys 0.010s
W20260928 10:44:08.032838 6271 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.724s user 0.001s sys 0.010s
I20260928 10:44:08.033293 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bed74e76d514654b024880f46a1525c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.034237 6271 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.034395 6271 ts_tablet_manager.cc:1397] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.777s user 0.003s sys 0.011s
I20260928 10:44:08.035017 6273 tablet_bootstrap.cc:654] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.035811 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bc65ca1ba01481a9efed520c2ea471c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.036243 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a36ae00e0f664d4da444a6a4a17bcbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.036710 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea632558fd546a0a7ef17c050973ebc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.036214 5817 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.037770 5817 leader_election.cc:302] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.038142 6866 raft_consensus.cc:2726] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.039912 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5be4edbfc11495b972a8ca68be46d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.040383 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d837b4e19de9467082a1578b292792e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.040787 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c52b6b88a44a4e925dcf1c3f9232e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.040916 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.035630 6973 raft_consensus.cc:482] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.042905 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.045652 6970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:44:08.047106 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.047394 6090 leader_election.cc:302] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:08.049587 6273 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.049749 6273 ts_tablet_manager.cc:1397] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.768s user 0.025s sys 0.021s
I20260928 10:44:08.050663 6273 raft_consensus.cc:348] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.050964 6273 raft_consensus.cc:374] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.051023 6273 raft_consensus.cc:729] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.051214 6273 consensus_queue.cc:260] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.051728 6273 ts_tablet_manager.cc:1428] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:08.052068 6273 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.053417 6273 tablet_bootstrap.cc:654] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.054935 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1d94e32a417d4a5883cc717d1ba3cd95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.055531 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ecd8d56d7a945a0afbd9541048f232b consensus state has no leader
W20260928 10:44:08.055670 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d94e32a417d4a5883cc717d1ba3cd95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.056007 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_123771d82cfe40db95628f7b70fb4f4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.056388 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_20ef0fb161f54bdd9952ca56e6edfe22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.056551 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_123771d82cfe40db95628f7b70fb4f4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:08.056939 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20ef0fb161f54bdd9952ca56e6edfe22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.057610 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6041d6982c9a4e86a6ca799b1de4ab48" } new_table_name: "default.Table_22d5b7f76ea14a399cf45ec4f9a53a27" modify_external_catalogs: true
I20260928 10:44:08.066790 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b5a72ab188b64c3da03c015ca7a7006e" } new_table_name: "default.Table_72490291db794957ac8bb15acbf51562" modify_external_catalogs: true
I20260928 10:44:08.066995 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_21b652941323487eb33c10f586d9a2ca" } new_table_name: "default.Table_9e760012a7a44dc983c1531038042cac" modify_external_catalogs: true
I20260928 10:44:08.071265 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 628) took 2924 ms. Trace:
W20260928 10:44:08.072511 6091 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:08.073477 6976 raft_consensus.cc:2781] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:08.073598 6976 raft_consensus.cc:482] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:08.073767 6976 raft_consensus.cc:3037] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.074519 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_30de79cdae684abc96a9f7a080d00f02" } new_table_name: "default.Table_f320ef807d6b4746a02d578c8d662dc9" modify_external_catalogs: true
W20260928 10:44:08.080797 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 850693fd00274d98ab347eb40ae76b85 consensus state has no leader
W20260928 10:44:08.081792 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d85cb2a30f8342ed946f7d773bf8227e consensus state has no leader
I20260928 10:44:08.081610 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fac20278f3024dccac767807e51d0656"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.082190 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_775f9213815e44df87fd2479869dd76b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.082715 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_775f9213815e44df87fd2479869dd76b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.082785 6270 rpcz_store.cc:276] 0928 10:44:05.146696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.147467 (+ 771us) service_pool.cc:227] Handling call
0928 10:44:07.478078 (+2330611us) ts_tablet_manager.cc:1145] Deleting tablet 92912af8cba4453a8e3422896d586855
0928 10:44:07.478088 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.695336 (+217248us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:07.980918 (+285582us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.071212 (+ 90294us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330452}
I20260928 10:44:08.083214 6270 tablet_replica.cc:330] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:08.083684 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 92912af8cba4453a8e3422896d586855 (table default.Table_51fa355050b247adafc45bb9f179041c [id=1b8945bb5a134afda7e060bee5a2fec1]) successfully deleted
W20260928 10:44:08.083858 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fac20278f3024dccac767807e51d0656 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.084923 6270 raft_consensus.cc:2229] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.085120 6270 raft_consensus.cc:2258] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.085338 6020 raft_consensus.cc:2454] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
W20260928 10:44:08.086687 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 consensus state has no leader
I20260928 10:44:08.087088 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_937cd54d3af14ef59af0ead89b09fdcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.087580 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_937cd54d3af14ef59af0ead89b09fdcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:08.093348 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04b947da50894cdba0f49d0738f60187 consensus state has no leader
I20260928 10:44:08.102398 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c23684385749e98359126cfd04b6f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.105602 6270 ts_tablet_manager.cc:1905] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:08.078725 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.079260 6090 leader_election.cc:302] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:08.060889 6973 raft_consensus.cc:504] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.137253 6272 ts_tablet_manager.cc:1918] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 10:44:08.137395 6091 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:08.149314 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 88f81c47745142568f7a4dd30d468220 (DEFAULT_TABLE table=default.Table_6456c36640e446fda654b2aeee90b200 [id=c2fac1ef879d49b48d4e9ccfc87947c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.153142 5989 tablet_service.cc:1467] Processing CreateTablet for tablet c90c3e290377422385a15e23a0e7dd9a (DEFAULT_TABLE table=default.Table_c23cc31a216a4b848be3124e27ac3758 [id=88d6342a7ba84d8782e78dfc3ee14a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.149542 5695 catalog_manager.cc:5495] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b reported cstate change: term changed from 0 to 1, leader changed from <none> to ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65). New cstate: current_term: 1 leader_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:08.155447 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:08.161458 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_22c18a9c5f864f6ca0e6a2de9c51c2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.165853 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 48af35fb4a8e482fb0ff45eecf4e2a42 (DEFAULT_TABLE table=default.Table_6763237a614f41e6b67ca2917d034a8c [id=347049f20dc046adbe1844796a77bbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.166252 5858 tablet_service.cc:1467] Processing CreateTablet for tablet d85cb2a30f8342ed946f7d773bf8227e (DEFAULT_TABLE table=default.Table_b5a72ab188b64c3da03c015ca7a7006e [id=07f036aa3d1d4510b8008431fcb58935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.166612 6892 server_base.cc:1034] running on GCE node
I20260928 10:44:08.157505 6271 raft_consensus.cc:348] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.167747 6271 raft_consensus.cc:374] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.167908 6271 raft_consensus.cc:729] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:08.163371 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22c18a9c5f864f6ca0e6a2de9c51c2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.168239 6271 consensus_queue.cc:260] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.168529 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a6b418bbb3364006b097e3a78edf5f55
I20260928 10:44:08.168891 6271 ts_tablet_manager.cc:1428] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.134s user 0.002s sys 0.000s
I20260928 10:44:08.169291 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd5dc5f9e3648398d3e766fa9974441 (DEFAULT_TABLE table=default.Table_13d789c0fc444386b903db86421ebf12 [id=6a18b9edf0c548dbaa40476360822b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.170528 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 1daf1ef2778342f097125f3469e27967 (DEFAULT_TABLE table=default.Table_6ecb8e4169d14e90a7409639bc795f36 [id=bd7025799dbd45e4969b42370375a338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.170898 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet a6b418bbb3364006b097e3a78edf5f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.172626 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d3b5d65454b2982e625dd4f909bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.172988 5864 tablet_service.cc:1467] Processing CreateTablet for tablet f16bcb500113427cb1536a643b70525d (DEFAULT_TABLE table=default.Table_dd9ab8b729544b908fe750000e5b528d [id=af68cbd1beb0487ca37537e9bfec5f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.174247 6271 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:08.176227 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 355c5b2e54cb4136b27eec3d65aeab55 (DEFAULT_TABLE table=default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb [id=2881af28dc914b29b5d9b8fc6f5e6fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.176715 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f81c47745142568f7a4dd30d468220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.177191 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daf1ef2778342f097125f3469e27967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.177769 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48af35fb4a8e482fb0ff45eecf4e2a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.178282 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85cb2a30f8342ed946f7d773bf8227e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.178732 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd5dc5f9e3648398d3e766fa9974441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.179014 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 51d3d85454204faca17e5de63d330330 (DEFAULT_TABLE table=default.Table_d26c74de94724ee2b24a0473731ab348 [id=1e6ed2879cb64cb2ba7927e45c17b248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.179229 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355c5b2e54cb4136b27eec3d65aeab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.179744 6269 ts_tablet_manager.cc:1918] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.179908 6269 log.cc:1196] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/86b16eb36c034591ac1603ab84fd9342
I20260928 10:44:08.180276 6269 ts_tablet_manager.cc:1939] T 86b16eb36c034591ac1603ab84fd9342 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:08.181111 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90c3e290377422385a15e23a0e7dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.181113 5859 tablet_service.cc:1467] Processing CreateTablet for tablet c683d17d41e243e798cf9837fa88a4c9 (DEFAULT_TABLE table=default.Table_21e16de584264e87b52eb815094c2d0c [id=7ebc3c17f1d443719f605d871882e4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.183547 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.183979 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 (DEFAULT_TABLE table=default.Table_5a1bc9dc67d74038a5408f85eb8836c0 [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.185446 6919 raft_consensus.cc:482] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.185920 5851 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34882 (request call id 709) took 1089 ms. Trace:
I20260928 10:44:08.186003 5851 rpcz_store.cc:276] 0928 10:44:07.096057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.097053 (+ 996us) service_pool.cc:227] Handling call
0928 10:44:07.278535 (+181482us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:07.278580 (+ 45us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:08.137194 (+858614us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.185796 (+ 48602us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:08.185907 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:08.189898 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet fe768adf9a1b4631b63151f8cf3cc3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.190096 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd (DEFAULT_TABLE table=default.Table_027e045946fe474dbafb252ca0ec9ef0 [id=fd90b7de83a74a68a6112d9c0b4e8cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.190369 5857 tablet_service.cc:1467] Processing CreateTablet for tablet c90c3e290377422385a15e23a0e7dd9a (DEFAULT_TABLE table=default.Table_c23cc31a216a4b848be3124e27ac3758 [id=88d6342a7ba84d8782e78dfc3ee14a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.193365 6973 leader_election.cc:288] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.193884 6271 tablet_bootstrap.cc:654] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.193919 6973 raft_consensus.cc:2781] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:08.194015 6973 raft_consensus.cc:482] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:08.194087 6973 raft_consensus.cc:3037] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.194746 6272 log.cc:1196] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e25db69b15eb445792e6168f99304bf2
I20260928 10:44:08.195183 6272 ts_tablet_manager.cc:1939] T e25db69b15eb445792e6168f99304bf2 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:08.195765 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 113185us
W20260928 10:44:08.196012 6091 leader_election.cc:341] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d40123712b17464e87023f69a6235640
I20260928 10:44:08.196046 5856 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34882 (request call id 717) took 1037 ms. Trace:
I20260928 10:44:08.196148 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7e5bec611c95429ab309957f74b70eea
I20260928 10:44:08.196143 5856 rpcz_store.cc:276] 0928 10:44:07.158169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.215140 (+ 56971us) service_pool.cc:227] Handling call
0928 10:44:07.282386 (+ 67246us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:07.282410 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:08.141486 (+859076us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.195894 (+ 54408us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:08.196030 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:08.196619 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 88f81c47745142568f7a4dd30d468220 (DEFAULT_TABLE table=default.Table_6456c36640e446fda654b2aeee90b200 [id=c2fac1ef879d49b48d4e9ccfc87947c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.197021 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7834a54e59114a77b4e54e9190049a47
I20260928 10:44:08.196995 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 29f07262a710456ea0837dc5af3eaebb
W20260928 10:44:08.197016 5817 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.197141 5817 leader_election.cc:302] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.197474 6866 raft_consensus.cc:2726] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.197844 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0e4594eae7b840ff980f67da8ed82e01
I20260928 10:44:08.198381 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
W20260928 10:44:08.198524 6091 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:08.109050 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet d42e218538814686a6c8308b1bc43949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.199654 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet a6b418bbb3364006b097e3a78edf5f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.199851 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f07262a710456ea0837dc5af3eaebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.200048 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 1daf1ef2778342f097125f3469e27967 (DEFAULT_TABLE table=default.Table_6ecb8e4169d14e90a7409639bc795f36 [id=bd7025799dbd45e4969b42370375a338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.200099 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.200606 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5bec611c95429ab309957f74b70eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.202383 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 7834a54e59114a77b4e54e9190049a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.203208 6919 raft_consensus.cc:504] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.104702 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7131f9259a404382e86ad06c52b584 (DEFAULT_TABLE table=default.Table_bbb6a08018174f08998a7eab84a49785 [id=5e5b21a2a82f4575abd99f78fcca4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.116900 5861 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 (DEFAULT_TABLE table=default.Table_3b1deda1bd154d1eb664ab35409fc281 [id=c2a102baa4c244cabded7656153f4cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.205624 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f16bcb500113427cb1536a643b70525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.209685 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:08.211440 6919 leader_election.cc:288] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.159718 5862 tablet_service.cc:1467] Processing CreateTablet for tablet d32fdb08e63d4d018d01fb99acf77b37 (DEFAULT_TABLE table=default.Table_43a5208eab5b4b7abb0fa84d3bfecf55 [id=0d6d53a882a347e8a6ad41cb85e459f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.213150 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32fdb08e63d4d018d01fb99acf77b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.213985 6275 raft_consensus.cc:348] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.195530 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 677) took 1781 ms. Trace:
I20260928 10:44:08.218781 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0439f5f6d4323978bb5fe2d039f75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.219007 6091 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:08.219213 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daf1ef2778342f097125f3469e27967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.220095 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683d17d41e243e798cf9837fa88a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.223208 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7131f9259a404382e86ad06c52b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.223351 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5bec611c95429ab309957f74b70eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.223555 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7834a54e59114a77b4e54e9190049a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.223699 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f07262a710456ea0837dc5af3eaebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.223783 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bfcdaa9d8bf45c98411cf0e6febd294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.165380 5848 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34882 (request call id 716) took 1007 ms. Trace:
W20260928 10:44:08.197501 5817 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.224339 5817 leader_election.cc:302] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.224429 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76b4ceadef8b4a729ca4204259e64cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.224570 6866 raft_consensus.cc:2726] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:08.224745 5817 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.224826 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d3d85454204faca17e5de63d330330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.224840 5817 leader_election.cc:302] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.225203 6866 raft_consensus.cc:2726] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.224290 5848 rpcz_store.cc:276] 0928 10:44:07.157989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.206599 (+ 48610us) service_pool.cc:227] Handling call
0928 10:44:07.282236 (+ 75637us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:07.282277 (+ 41us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:08.109566 (+827289us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.165201 (+ 55635us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:08.165357 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:08.163092 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.229240 6275 raft_consensus.cc:374] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.230631 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90c3e290377422385a15e23a0e7dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.231112 6991 tablet.cc:1722] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:08.235244 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 676) took 2049 ms. Trace:
I20260928 10:44:08.235175 6272 rpcz_store.cc:276] 0928 10:44:06.414186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.414240 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:07.894077 (+1479837us) ts_tablet_manager.cc:1145] Deleting tablet e25db69b15eb445792e6168f99304bf2
0928 10:44:07.894087 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:07.987779 (+ 93692us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.121165 (+133386us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.195477 (+ 74312us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1479538}
I20260928 10:44:08.235478 6269 rpcz_store.cc:276] 0928 10:44:06.185724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.185981 (+ 257us) service_pool.cc:227] Handling call
0928 10:44:07.280945 (+1094964us) ts_tablet_manager.cc:1145] Deleting tablet 86b16eb36c034591ac1603ab84fd9342
0928 10:44:07.280953 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.093036 (+812083us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.179655 (+ 86619us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.235211 (+ 55556us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094832}
I20260928 10:44:08.235927 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 674) took 2050 ms. Trace:
I20260928 10:44:08.236023 6269 rpcz_store.cc:276] 0928 10:44:06.185469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.185895 (+ 426us) service_pool.cc:227] Handling call
0928 10:44:08.235789 (+2049894us) ts_tablet_manager.cc:1145] Deleting tablet 58c0af95fa58451490947176ec9301e3
0928 10:44:08.235801 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.235909 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049621}
I20260928 10:44:08.236280 6269 tablet_replica.cc:330] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:08.236464 6269 raft_consensus.cc:2229] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.236636 6269 raft_consensus.cc:2258] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.236817 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 86b16eb36c034591ac1603ab84fd9342 (table default.Table_6279d9ee60ce44759d7bc1ae62dd2073 [id=d006fbd87b934957b39ed53725c2eb78]) successfully deleted
I20260928 10:44:08.237206 6269 ts_tablet_manager.cc:1905] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:08.237232 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 58c0af95fa58451490947176ec9301e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c0af95fa58451490947176ec9301e3 already in progress: creating tablet
I20260928 10:44:08.238364 6275 raft_consensus.cc:729] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.240447 6273 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.240600 6273 ts_tablet_manager.cc:1397] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.189s user 0.017s sys 0.021s
I20260928 10:44:08.241438 6273 raft_consensus.cc:348] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.241700 6273 raft_consensus.cc:374] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.241757 6273 raft_consensus.cc:729] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.241969 6273 consensus_queue.cc:260] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.242651 6273 ts_tablet_manager.cc:1428] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:08.242929 6273 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.244539 6273 tablet_bootstrap.cc:654] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:08.245833 6994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 10:44:08.245584 6990 raft_consensus.cc:482] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.246047 6990 raft_consensus.cc:504] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.247061 6990 leader_election.cc:288] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:08.247311 6892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 10:44:08.250998 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:08.251236 5882 raft_consensus.cc:2454] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:08.251801 5957 leader_election.cc:302] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:08.252102 6990 raft_consensus.cc:2781] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:08.252240 6990 raft_consensus.cc:482] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:08.252377 6990 raft_consensus.cc:3037] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.259369 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2a81ff9471704a4ab5ddf72671322155"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.260301 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a81ff9471704a4ab5ddf72671322155 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.223834 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.262579 6275 consensus_queue.cc:260] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.265851 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_04b8310373fe46d29d461a489ceba2c0" } new_table_name: "default.Table_8944b80f4d5541e190437e9bc4dcd89b" modify_external_catalogs: true
I20260928 10:44:08.266214 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_94fba3a7181d44e7a0f5fb7e3931745a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.267135 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94fba3a7181d44e7a0f5fb7e3931745a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.267436 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5c0099194a374aebbb86c678423e2ae7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.267970 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c0099194a374aebbb86c678423e2ae7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.269544 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b0a6794e144e406db22950387a851f85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.269516 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_33fce32326fa4e4d8c37f174f6b55b8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.270063 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0a6794e144e406db22950387a851f85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:08.270069 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33fce32326fa4e4d8c37f174f6b55b8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.272006 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8ca6e9f8325340a98cbba1bd1df669d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.272470 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ca6e9f8325340a98cbba1bd1df669d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.274202 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b167fd6cdbd4b829d962ebafeee0272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.274704 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f81c47745142568f7a4dd30d468220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.110179 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f317439c55e4575a0d72ef282c467d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.277441 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:08.280332 6270 ts_tablet_manager.cc:1918] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.280521 6270 log.cc:1196] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e25db69b15eb445792e6168f99304bf2
I20260928 10:44:08.280857 6270 ts_tablet_manager.cc:1939] T e25db69b15eb445792e6168f99304bf2 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:08.284372 6275 ts_tablet_manager.cc:1428] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.262s user 0.003s sys 0.000s
I20260928 10:44:08.284703 6275 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:08.287016 6275 tablet_bootstrap.cc:654] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.282557 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 689) took 1602 ms. Trace:
I20260928 10:44:08.288662 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5a1bc9dc67d74038a5408f85eb8836c0" } new_table_name: "default.Table_1f22ec4cb61c43b3ad281df02eb63b6f" modify_external_catalogs: true
I20260928 10:44:08.288865 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f63b5fc9650c4300b6109a4bb30a6cef" } new_table_name: "default.Table_8fe75b83adf34a4e9d1e40f43597c820" modify_external_catalogs: true
I20260928 10:44:08.290794 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a9e4a90e63964c2392953fa50a5ddb5a" } new_table_name: "default.Table_24a55d53ffaa464a96c403e71be3f2e1" modify_external_catalogs: true
I20260928 10:44:08.296577 6273 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.296661 6271 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.296726 6273 ts_tablet_manager.cc:1397] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260928 10:44:08.297286 6271 ts_tablet_manager.cc:1397] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.123s user 0.000s sys 0.003s
I20260928 10:44:08.297878 6273 raft_consensus.cc:348] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.298095 6273 raft_consensus.cc:374] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.298156 6273 raft_consensus.cc:729] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.298113 6271 raft_consensus.cc:348] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.298357 6271 raft_consensus.cc:374] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.298434 6271 raft_consensus.cc:729] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.298357 6273 consensus_queue.cc:260] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.298684 6271 consensus_queue.cc:260] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.299223 6273 ts_tablet_manager.cc:1428] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:08.299427 6271 ts_tablet_manager.cc:1428] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:08.299513 6273 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.299733 6271 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:08.301133 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 270d4148268a47e5a6a5e71651eb0b12 consensus state has no leader
I20260928 10:44:08.301291 6273 tablet_bootstrap.cc:654] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.307380 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7439b747179f45b6a6627c1b8d93956f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.308107 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7439b747179f45b6a6627c1b8d93956f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.310146 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_27e6c402d5e14a40bb00a8d7826f6019"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.310859 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27e6c402d5e14a40bb00a8d7826f6019 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.311688 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b23b0742d5e04154b63487c884850da3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.312283 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b23b0742d5e04154b63487c884850da3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.313522 6271 tablet_bootstrap.cc:654] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.313902 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7f5a671a2bc9426e970e4e3543fe5eb5" } new_table_name: "default.Table_ba73fd95dcae409380b26dc24042792d" modify_external_catalogs: true
W20260928 10:44:08.317193 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aefce878fd0459c9c6502cfd226e2c7 consensus state has no leader
W20260928 10:44:08.317723 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bfcdaa9d8bf45c98411cf0e6febd294 consensus state has no leader
I20260928 10:44:08.307085 6272 rpcz_store.cc:276] 0928 10:44:06.641348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.641479 (+ 131us) service_pool.cc:227] Handling call
0928 10:44:08.235517 (+1594038us) ts_tablet_manager.cc:1145] Deleting tablet 474e9ca2deb1478a87c978d1e119fa5f
0928 10:44:08.235532 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.243379 (+ 7847us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593726}
W20260928 10:44:08.319005 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ced63ab7188472e80d4ff52350be3e0 consensus state has no leader
I20260928 10:44:08.321609 6273 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.321776 6273 ts_tablet_manager.cc:1397] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260928 10:44:08.328967 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 691) took 1685 ms. Trace:
I20260928 10:44:08.295177 6976 raft_consensus.cc:504] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.331066 6273 raft_consensus.cc:348] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.331316 6273 raft_consensus.cc:374] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.331390 6273 raft_consensus.cc:729] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.331678 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.331602 6273 consensus_queue.cc:260] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.333348 6273 ts_tablet_manager.cc:1428] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 10:44:08.333622 6273 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:08.334395 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dddbd630c6d9446b9ff317c963cd00d3 consensus state has no leader
W20260928 10:44:08.338043 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 94683.3us
I20260928 10:44:08.341454 6273 tablet_bootstrap.cc:654] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.342568 6892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 10:44:08.344120 6892 hybrid_clock.cc:648] HybridClock initialized: now 1790592248344032 us; error 65 us; skew 500 ppm
I20260928 10:44:08.344594 6892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 10:44:08.329648 6272 rpcz_store.cc:276] 0928 10:44:06.641610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.641657 (+ 47us) service_pool.cc:227] Handling call
0928 10:44:08.318609 (+1676952us) ts_tablet_manager.cc:1145] Deleting tablet bc7aa301bfbb4097b386a0d23cfa91e1
0928 10:44:08.318623 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.327014 (+ 8391us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1676746}
I20260928 10:44:08.346939 6273 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.350253 6273 ts_tablet_manager.cc:1397] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s
I20260928 10:44:08.351913 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 690) took 1710 ms. Trace:
I20260928 10:44:08.352640 6271 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.352814 6271 ts_tablet_manager.cc:1397] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.001s
I20260928 10:44:08.352921 6273 raft_consensus.cc:348] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.353145 6273 raft_consensus.cc:374] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.353193 6273 raft_consensus.cc:729] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.353390 6273 consensus_queue.cc:260] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.353729 6271 raft_consensus.cc:348] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.353941 6271 raft_consensus.cc:374] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.354035 6271 raft_consensus.cc:729] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.354266 6271 consensus_queue.cc:260] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.354818 6273 ts_tablet_manager.cc:1428] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260928 10:44:08.354647 6091 leader_election.cc:341] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:08.356105 6273 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.356252 6271 ts_tablet_manager.cc:1428] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260928 10:44:08.357064 6271 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:08.349946 6990 raft_consensus.cc:504] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.357713 6273 tablet_bootstrap.cc:654] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:08.357780 5817 consensus_peers.cc:487] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:08.352083 6272 rpcz_store.cc:276] 0928 10:44:06.641515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.642107 (+ 592us) service_pool.cc:227] Handling call
0928 10:44:08.346312 (+1704205us) ts_tablet_manager.cc:1145] Deleting tablet 946188e312c6424f81926465667b5e11
0928 10:44:08.346325 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.351883 (+ 5558us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1704019}
I20260928 10:44:08.364295 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:08.364542 5882 raft_consensus.cc:3037] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.364676 6976 leader_election.cc:288] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.368031 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.369048 6273 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.368427 6990 leader_election.cc:288] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:08.369187 6273 ts_tablet_manager.cc:1397] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20260928 10:44:08.370002 6273 raft_consensus.cc:348] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.370214 6273 raft_consensus.cc:374] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.370267 6273 raft_consensus.cc:729] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.370455 6273 consensus_queue.cc:260] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.371446 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_44112cae47364bd28529eb31c38016db" } modify_external_catalogs: true
I20260928 10:44:08.371711 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_44112cae47364bd28529eb31c38016db" } modify_external_catalogs: true
I20260928 10:44:08.371989 6892 webserver.cc:460] Webserver started at http://127.5.100.125:45673/ using document root <none> and password file <none>
I20260928 10:44:08.373011 6892 fs_manager.cc:359] Metadata directory not provided
I20260928 10:44:08.373153 6892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 10:44:08.373968 6112 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 151) took 1526 ms. Trace:
I20260928 10:44:08.377538 6271 tablet_bootstrap.cc:654] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.376089 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 692) took 1722 ms. Trace:
I20260928 10:44:08.378904 6273 ts_tablet_manager.cc:1428] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:44:08.379184 6273 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.379120 6272 rpcz_store.cc:276] 0928 10:44:06.642028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.642069 (+ 41us) service_pool.cc:227] Handling call
0928 10:44:08.359432 (+1717363us) ts_tablet_manager.cc:1145] Deleting tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4
0928 10:44:08.359444 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.364967 (+ 5523us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715561}
I20260928 10:44:08.380378 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 694) took 1554 ms. Trace:
I20260928 10:44:08.380510 6272 rpcz_store.cc:276] 0928 10:44:06.825635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.835206 (+ 9571us) service_pool.cc:227] Handling call
0928 10:44:08.380227 (+1545021us) ts_tablet_manager.cc:1145] Deleting tablet ab5abdd2484f41d7bd244db14d2b1916
0928 10:44:08.380239 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.380359 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1544743}
I20260928 10:44:08.380641 6273 tablet_bootstrap.cc:654] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.380949 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 693) took 1555 ms. Trace:
I20260928 10:44:08.381063 6272 rpcz_store.cc:276] 0928 10:44:06.825546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.835530 (+ 9984us) service_pool.cc:227] Handling call
0928 10:44:08.380834 (+1545304us) ts_tablet_manager.cc:1145] Deleting tablet 7ef1b939f9aa4f988180d5ea0a4a8a15
0928 10:44:08.380845 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.380933 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545103}
I20260928 10:44:08.381376 6272 tablet_replica.cc:330] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:08.382126 6272 raft_consensus.cc:2229] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.382352 6272 raft_consensus.cc:2258] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.381662 6973 raft_consensus.cc:504] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.385489 6973 leader_election.cc:288] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.387539 6866 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.387673 6866 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:08.388038 6091 leader_election.cc:341] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:08.388221 6866 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.388832 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.389350 6273 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.389470 6273 ts_tablet_manager.cc:1397] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260928 10:44:08.389670 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.389432 5818 leader_election.cc:341] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.390133 6273 raft_consensus.cc:348] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.390321 6273 raft_consensus.cc:374] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:08.390308 5817 leader_election.cc:341] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.390412 6273 raft_consensus.cc:729] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.390462 5817 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.390662 6866 raft_consensus.cc:2726] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.390781 6273 consensus_queue.cc:260] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.391379 6273 ts_tablet_manager.cc:1428] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:08.391624 6273 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.392168 6112 rpcz_store.cc:276] 0928 10:44:06.840185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.840245 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:07.002705 (+162460us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x6150000c9f24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:07.257140 (+254435us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x615000144ea4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:07.613819 (+356679us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x615000242d24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:08.366357 (+752538us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":732350976}
I20260928 10:44:08.393154 6273 tablet_bootstrap.cc:654] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.395615 6892 fs_manager.cc:709] Time spent opening directory manager: real 0.020s user 0.005s sys 0.001s
I20260928 10:44:08.401957 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6e5afe68ebdd46258a4e2ba8e4de308c" } modify_external_catalogs: true
I20260928 10:44:08.402238 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6e5afe68ebdd46258a4e2ba8e4de308c" } modify_external_catalogs: true
I20260928 10:44:08.403987 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d028317843a24ae18ce20c6d26017c92" } modify_external_catalogs: true
I20260928 10:44:08.404232 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d028317843a24ae18ce20c6d26017c92" } modify_external_catalogs: true
I20260928 10:44:08.404812 6866 raft_consensus.cc:482] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.404786 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bfe8dc92029d4e1295963813649f8d7d" } modify_external_catalogs: true
I20260928 10:44:08.404985 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bfe8dc92029d4e1295963813649f8d7d" } modify_external_catalogs: true
I20260928 10:44:08.404964 6866 raft_consensus.cc:504] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.405616 6866 leader_election.cc:288] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.406111 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c23cc31a216a4b848be3124e27ac3758" } modify_external_catalogs: true
I20260928 10:44:08.406368 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c23cc31a216a4b848be3124e27ac3758" } modify_external_catalogs: true
I20260928 10:44:08.406706 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:08.407274 5818 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.408301 6271 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.408493 6271 ts_tablet_manager.cc:1397] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.004s
I20260928 10:44:08.409323 6271 raft_consensus.cc:348] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.409578 6271 raft_consensus.cc:374] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.409641 6271 raft_consensus.cc:729] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.410064 6271 consensus_queue.cc:260] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.412101 6271 ts_tablet_manager.cc:1428] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:44:08.413230 6271 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:08.415179 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:08.415959 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 362ef9f9aa8641cca11c0a154882e1d4
W20260928 10:44:08.418948 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 318894us
I20260928 10:44:08.420903 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48ccd7551f6a4fc8b41e70e94749e6f1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.421151 6020 raft_consensus.cc:2454] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:08.422318 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_11d8d455798b42eca6d68cc8928974c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.423015 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11d8d455798b42eca6d68cc8928974c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.423204 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbd5d1ccd2e54f3884af3af327bb892e" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:08.423478 6018 raft_consensus.cc:3037] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.424260 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.423204 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd13e6a9d8f04fa3abb8d22a80932dae" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:08.427294 6019 raft_consensus.cc:3037] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.429132 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.429809 6271 tablet_bootstrap.cc:654] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.430914 6866 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.431150 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.431095 6866 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.432821 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.431886 6866 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:08.433411 5818 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.431579 6995 tablet.cc:1722] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:08.435932 6273 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.436076 6273 ts_tablet_manager.cc:1397] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.045s user 0.018s sys 0.001s
I20260928 10:44:08.436820 6273 raft_consensus.cc:348] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.437044 6273 raft_consensus.cc:374] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.437098 6273 raft_consensus.cc:729] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.437314 6273 consensus_queue.cc:260] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.438999 6273 ts_tablet_manager.cc:1428] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:08.440117 6273 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.441769 6273 tablet_bootstrap.cc:654] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.442309 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.442536 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.443027 5817 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.443163 5817 leader_election.cc:302] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.443415 6866 raft_consensus.cc:2726] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:08.443563 5817 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.443652 5817 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.443837 6866 raft_consensus.cc:2726] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:08.448913 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet dddbd630c6d9446b9ff317c963cd00d3 consensus state has no leader
I20260928 10:44:08.460345 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:08.463367 5987 tablet_service.cc:1467] Processing CreateTablet for tablet dc5a416d81434147a1155dcfbad1ea0e (DEFAULT_TABLE table=default.Table_937cd54d3af14ef59af0ead89b09fdcb [id=8f3288f2e5fb45c795c65eb46bc5ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.464074 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 05c21bf3bbd7403cbc5a74142a883000 (DEFAULT_TABLE table=default.Table_123771d82cfe40db95628f7b70fb4f4e [id=0ae831032774417884cd40603546a50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.464879 5989 tablet_service.cc:1467] Processing CreateTablet for tablet a8bd8fe9b2284fda972da4528feede7b (DEFAULT_TABLE table=default.Table_3170713c54864f9e94e9b7280cbb8c63 [id=b656f38e05af4ca0995bba2bd134aa6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.467272 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.467425 5855 tablet_service.cc:1467] Processing CreateTablet for tablet a8bd8fe9b2284fda972da4528feede7b (DEFAULT_TABLE table=default.Table_3170713c54864f9e94e9b7280cbb8c63 [id=b656f38e05af4ca0995bba2bd134aa6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.467620 5863 tablet_service.cc:1467] Processing CreateTablet for tablet dc5a416d81434147a1155dcfbad1ea0e (DEFAULT_TABLE table=default.Table_937cd54d3af14ef59af0ead89b09fdcb [id=8f3288f2e5fb45c795c65eb46bc5ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.468031 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 05c21bf3bbd7403cbc5a74142a883000 (DEFAULT_TABLE table=default.Table_123771d82cfe40db95628f7b70fb4f4e [id=0ae831032774417884cd40603546a50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.470167 5852 tablet_service.cc:1467] Processing CreateTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 (DEFAULT_TABLE table=default.Table_1d245c3bafda41cd8fbcdfb061c2e13b [id=c69a927558e7429da0e44d599ca1acf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.470999 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 758fc07a09554ec0b3c1dca43da745fe (DEFAULT_TABLE table=default.Table_01263e8acd0e44a6a7603edccf3d0e17 [id=235e15ba633042b5abb14b7e92428518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.470446 5854 tablet_service.cc:1467] Processing CreateTablet for tablet d5c7540acde04667b9f8aef0bce23940 (DEFAULT_TABLE table=default.Table_b7108f795f52440c8f767d6dbec2d29f [id=03ea232b52af47779c40abb6993e9f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.471236 5849 tablet_service.cc:1467] Processing CreateTablet for tablet cdd708b5c9c44fd69cb9ab981c726ca7 (DEFAULT_TABLE table=default.Table_f8904f2b3dd14bb8947c8a2bfa375a03 [id=999a21fe3a4e479d81746bfd0a62d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.471333 6273 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.471455 6273 ts_tablet_manager.cc:1397] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.003s
I20260928 10:44:08.470654 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 (DEFAULT_TABLE table=default.Table_10db3860b70e4b5ba9d48103a5772cc2 [id=d1f4fe687e584aadae9c4df14fc2f625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.470762 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 01a3dcbe36f84ff984793b2387dad572 (DEFAULT_TABLE table=default.Table_856b2cdcadd34cf9bbdcdbfb02ae6e5f [id=ad71dad4f540478ca690a9ee9da735ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.470932 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.472128 6273 raft_consensus.cc:348] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.472714 5988 tablet_service.cc:1467] Processing CreateTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 (DEFAULT_TABLE table=default.Table_1d245c3bafda41cd8fbcdfb061c2e13b [id=c69a927558e7429da0e44d599ca1acf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.472345 6273 raft_consensus.cc:374] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.473076 6273 raft_consensus.cc:729] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.473037 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 (DEFAULT_TABLE table=default.Table_10db3860b70e4b5ba9d48103a5772cc2 [id=d1f4fe687e584aadae9c4df14fc2f625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.473280 6273 consensus_queue.cc:260] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.473521 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 758fc07a09554ec0b3c1dca43da745fe (DEFAULT_TABLE table=default.Table_01263e8acd0e44a6a7603edccf3d0e17 [id=235e15ba633042b5abb14b7e92428518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.473743 5997 tablet_service.cc:1467] Processing CreateTablet for tablet cdd708b5c9c44fd69cb9ab981c726ca7 (DEFAULT_TABLE table=default.Table_f8904f2b3dd14bb8947c8a2bfa375a03 [id=999a21fe3a4e479d81746bfd0a62d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.473943 6273 ts_tablet_manager.cc:1428] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:08.474010 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.474181 6273 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.474149 5999 tablet_service.cc:1467] Processing CreateTablet for tablet d5c7540acde04667b9f8aef0bce23940 (DEFAULT_TABLE table=default.Table_b7108f795f52440c8f767d6dbec2d29f [id=03ea232b52af47779c40abb6993e9f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.474442 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1cf72cadc54a239c5f457004a4c503 (DEFAULT_TABLE table=default.Table_af2781b090d9458abcf37a9e763c6eac [id=aaf7b4db2c9d422fbcc6611376fcba71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.474524 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 01a3dcbe36f84ff984793b2387dad572 (DEFAULT_TABLE table=default.Table_856b2cdcadd34cf9bbdcdbfb02ae6e5f [id=ad71dad4f540478ca690a9ee9da735ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.474891 5994 tablet_service.cc:1467] Processing CreateTablet for tablet a658dce02ff740f086774aa44aef9fb8 (DEFAULT_TABLE table=default.Table_6661e71ec33a42e6b191196785162b9f [id=5ea9fd8e5f6e4a59a43326622b240d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.475591 6273 tablet_bootstrap.cc:654] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.478744 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 73c8f859a3ac4a4b89f1bb2929aa3c92
I20260928 10:44:08.479151 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 deleted and replaced by tablet 72d616250b7f495fb0fff79ece1a77b1
I20260928 10:44:08.479146 6866 raft_consensus.cc:482] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.479342 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bc8b8b3a518c42ad9e3c76c9743e361b
I20260928 10:44:08.479262 6866 raft_consensus.cc:504] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.479800 6866 leader_election.cc:288] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.480394 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.480481 5984 tablet_service.cc:1467] Processing CreateTablet for tablet d605cff11a05407b979c5aeea4534893 (DEFAULT_TABLE table=default.Table_8a19b71a335045819bf7d07c19b45929 [id=fcb0c8d3da4d4194a5ce44889ac6f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.480492 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.481022 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c90c3e290377422385a15e23a0e7dd9a
W20260928 10:44:08.481037 5818 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.481992 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9a94c95e55fa46d2a8badd9229f55cf7
I20260928 10:44:08.482543 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 19476d14b4a14ab59228638cdcec228f (DEFAULT_TABLE table=default.Table_9184a4f90f1548aca39b16ae56efd5bd [id=7cbd977143df44c391db56b9133ebcb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.483031 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.483219 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet c90c3e290377422385a15e23a0e7dd9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.483523 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9194be57084f2ea4698ec7917857c5 (DEFAULT_TABLE table=default.Table_513b5850f38f4e1eb5e1aeefc9de4191 [id=699ef2cfdc34443d9a32788c67d80984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.487736 5882 raft_consensus.cc:2454] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:08.488289 6002 tablet_service.cc:1467] Processing CreateTablet for tablet a4a802bccb584e7abec289987ecc3c91 (DEFAULT_TABLE table=default.Table_3d7a0234aba14b10acc3793dc22b5a8e [id=59eebfa36dee4137a2c0353c9226b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.488720 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 480c0defb89e4f82897a7e1b040a1b1c (DEFAULT_TABLE table=default.Table_1e218c9efccb4286837019833cd28a8f [id=749b46ea7e244dc39d06d307c6cf76b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.489092 6018 raft_consensus.cc:2454] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:08.489353 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 with delete_type TABLET_DATA_DELETED (replaced by tablet 72d616250b7f495fb0fff79ece1a77b1) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.489708 5983 tablet_service.cc:1467] Processing CreateTablet for tablet ccd819463b35418f9a1b98bffddde87d (DEFAULT_TABLE table=default.Table_20ef0fb161f54bdd9952ca56e6edfe22 [id=aa0ff03dd56a470e9b062e70c9325fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.492094 6273 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.492223 6273 ts_tablet_manager.cc:1397] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20260928 10:44:08.492739 6019 raft_consensus.cc:2454] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:08.493155 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2a359f1585924866be13588125db2dc4 (DEFAULT_TABLE table=default.Table_fac20278f3024dccac767807e51d0656 [id=2a4b136bc255499089f09ec0eaf8b271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.493448 6273 raft_consensus.cc:348] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.493579 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.493666 6273 raft_consensus.cc:374] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.493731 6273 raft_consensus.cc:729] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.493633 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.494203 6273 consensus_queue.cc:260] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.494876 6273 ts_tablet_manager.cc:1428] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:08.494875 5957 leader_election.cc:302] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:08.495139 6273 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.495311 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 1daf1ef2778342f097125f3469e27967 (DEFAULT_TABLE table=default.Table_6ecb8e4169d14e90a7409639bc795f36 [id=bd7025799dbd45e4969b42370375a338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.495662 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daf1ef2778342f097125f3469e27967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.496392 6273 tablet_bootstrap.cc:654] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.497453 6990 raft_consensus.cc:2781] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:08.497605 6990 raft_consensus.cc:686] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:08.497963 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:08.497870 6990 consensus_queue.cc:237] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.499327 6273 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.499459 6273 ts_tablet_manager.cc:1397] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.002s
I20260928 10:44:08.500121 6273 raft_consensus.cc:348] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.500315 6273 raft_consensus.cc:374] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.500360 6273 raft_consensus.cc:729] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.500543 6273 consensus_queue.cc:260] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.500669 6125 tablet_service.cc:1467] Processing CreateTablet for tablet c90c3e290377422385a15e23a0e7dd9a (DEFAULT_TABLE table=default.Table_c23cc31a216a4b848be3124e27ac3758 [id=88d6342a7ba84d8782e78dfc3ee14a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.501145 6273 ts_tablet_manager.cc:1428] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:08.501411 6273 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.501338 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 88f81c47745142568f7a4dd30d468220 (DEFAULT_TABLE table=default.Table_6456c36640e446fda654b2aeee90b200 [id=c2fac1ef879d49b48d4e9ccfc87947c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.501474 6115 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 153) took 1084 ms. Trace:
I20260928 10:44:08.501545 6115 rpcz_store.cc:276] 0928 10:44:07.416748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.416899 (+ 151us) service_pool.cc:227] Handling call
0928 10:44:08.501453 (+1084554us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:08.502660 5817 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.502786 5817 leader_election.cc:302] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.502876 6273 tablet_bootstrap.cc:654] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.503011 6866 raft_consensus.cc:2726] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.504714 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1cf72cadc54a239c5f457004a4c503 (DEFAULT_TABLE table=default.Table_af2781b090d9458abcf37a9e763c6eac [id=aaf7b4db2c9d422fbcc6611376fcba71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.505275 5858 tablet_service.cc:1467] Processing CreateTablet for tablet a658dce02ff740f086774aa44aef9fb8 (DEFAULT_TABLE table=default.Table_6661e71ec33a42e6b191196785162b9f [id=5ea9fd8e5f6e4a59a43326622b240d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.506654 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d
I20260928 10:44:08.508845 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6fa33e7241934357b5a59b4798e3fb42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.509035 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_95f97f40b06e4132af16f9590aeefbb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:08.508915 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b98b5ecf9b894df6a4c878513b6de0b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.509581 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95f97f40b06e4132af16f9590aeefbb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:08.509613 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b98b5ecf9b894df6a4c878513b6de0b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.509826 6090 leader_election.cc:302] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:08.510012 6090 raft_consensus.cc:2670] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:08.510279 6090 leader_election.cc:302] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.510897 6988 raft_consensus.cc:2781] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:08.510969 6988 raft_consensus.cc:482] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:08.511024 6988 raft_consensus.cc:3037] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.511584 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_65353e0a07ac45679535489394b27f44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.512203 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65353e0a07ac45679535489394b27f44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.517037 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1b43e1f04c8b46e2b19dbac633f696c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.517644 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b43e1f04c8b46e2b19dbac633f696c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.521111 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90c3e290377422385a15e23a0e7dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.522889 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f81c47745142568f7a4dd30d468220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.525596 5850 tablet_service.cc:1467] Processing CreateTablet for tablet d605cff11a05407b979c5aeea4534893 (DEFAULT_TABLE table=default.Table_8a19b71a335045819bf7d07c19b45929 [id=fcb0c8d3da4d4194a5ce44889ac6f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.525749 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.526132 5860 tablet_service.cc:1467] Processing CreateTablet for tablet a4a802bccb584e7abec289987ecc3c91 (DEFAULT_TABLE table=default.Table_3d7a0234aba14b10acc3793dc22b5a8e [id=59eebfa36dee4137a2c0353c9226b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.526201 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 19476d14b4a14ab59228638cdcec228f (DEFAULT_TABLE table=default.Table_9184a4f90f1548aca39b16ae56efd5bd [id=7cbd977143df44c391db56b9133ebcb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.526633 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 2a359f1585924866be13588125db2dc4 (DEFAULT_TABLE table=default.Table_fac20278f3024dccac767807e51d0656 [id=2a4b136bc255499089f09ec0eaf8b271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.527034 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 480c0defb89e4f82897a7e1b040a1b1c (DEFAULT_TABLE table=default.Table_1e218c9efccb4286837019833cd28a8f [id=749b46ea7e244dc39d06d307c6cf76b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.527247 6273 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:08.527387 6273 ts_tablet_manager.cc:1397] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
W20260928 10:44:08.527853 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fa33e7241934357b5a59b4798e3fb42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.528110 6273 raft_consensus.cc:348] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.528317 6273 raft_consensus.cc:374] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.528371 6273 raft_consensus.cc:729] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.528541 6273 consensus_queue.cc:260] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.529186 6273 ts_tablet_manager.cc:1428] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:08.529443 6273 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:08.530197 6271 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.530359 6271 ts_tablet_manager.cc:1397] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.001s
W20260928 10:44:08.510610 6090 leader_election.cc:341] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:08.531137 6271 raft_consensus.cc:348] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.531360 6271 raft_consensus.cc:374] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.531440 6271 raft_consensus.cc:729] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.531642 6271 consensus_queue.cc:260] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.531904 6273 tablet_bootstrap.cc:654] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.532186 6271 ts_tablet_manager.cc:1428] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:08.532473 6271 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:08.535015 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f62e7365d93d467fb2c5802cf34b47e8" } new_table_name: "default.Table_0f93296a01d84736bc6c98435eaec057" modify_external_catalogs: true
I20260928 10:44:08.535125 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1ae67fee604d4932ae0e0ade17ccb28a" } new_table_name: "default.Table_9f60cfe53d8b48e981774ea02f9b0b63" modify_external_catalogs: true
I20260928 10:44:08.535454 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet ab5abdd2484f41d7bd244db14d2b1916 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:08.535809 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_861e45cccda8422f9bcc2ecb56c0da0f" } new_table_name: "default.Table_22e1516105d24daaa1e7b491ce777916" modify_external_catalogs: true
I20260928 10:44:08.536154 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_38322efa550a48f0bb9767a94cdbe77d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.536715 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38322efa550a48f0bb9767a94cdbe77d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.539091 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9cd9abadc5e546f8b73c683c41c6c1b8" } new_table_name: "default.Table_966ecf0b9db143a2b6fc2603ea665b11" modify_external_catalogs: true
I20260928 10:44:08.530730 6090 leader_election.cc:302] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.544181 6973 raft_consensus.cc:2726] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.516616 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e25db69b15eb445792e6168f99304bf2 (table default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]) successfully deleted
W20260928 10:44:08.545219 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 474e9ca2deb1478a87c978d1e119fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e9ca2deb1478a87c978d1e119fa5f already in progress: creating tablet
W20260928 10:44:08.545516 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bc7aa301bfbb4097b386a0d23cfa91e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7aa301bfbb4097b386a0d23cfa91e1 already in progress: creating tablet
W20260928 10:44:08.545727 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 946188e312c6424f81926465667b5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946188e312c6424f81926465667b5e11 already in progress: creating tablet
W20260928 10:44:08.545907 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 already in progress: creating tablet
W20260928 10:44:08.546098 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ab5abdd2484f41d7bd244db14d2b1916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5abdd2484f41d7bd244db14d2b1916 already in progress: creating tablet
W20260928 10:44:08.546277 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 already in progress: creating tablet
I20260928 10:44:08.552300 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 362ef9f9aa8641cca11c0a154882e1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.552300 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f07262a710456ea0837dc5af3eaebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.552554 6126 tablet_service.cc:1467] Processing CreateTablet for tablet dc5a416d81434147a1155dcfbad1ea0e (DEFAULT_TABLE table=default.Table_937cd54d3af14ef59af0ead89b09fdcb [id=8f3288f2e5fb45c795c65eb46bc5ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.553907 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5a416d81434147a1155dcfbad1ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.558607 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5bec611c95429ab309957f74b70eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.559659 6127 tablet_service.cc:1467] Processing CreateTablet for tablet cdd708b5c9c44fd69cb9ab981c726ca7 (DEFAULT_TABLE table=default.Table_f8904f2b3dd14bb8947c8a2bfa375a03 [id=999a21fe3a4e479d81746bfd0a62d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.560210 6119 tablet_service.cc:1467] Processing CreateTablet for tablet a8bd8fe9b2284fda972da4528feede7b (DEFAULT_TABLE table=default.Table_3170713c54864f9e94e9b7280cbb8c63 [id=b656f38e05af4ca0995bba2bd134aa6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.561832 6129 tablet_service.cc:1467] Processing CreateTablet for tablet d5c7540acde04667b9f8aef0bce23940 (DEFAULT_TABLE table=default.Table_b7108f795f52440c8f767d6dbec2d29f [id=03ea232b52af47779c40abb6993e9f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.567716 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 758fc07a09554ec0b3c1dca43da745fe (DEFAULT_TABLE table=default.Table_01263e8acd0e44a6a7603edccf3d0e17 [id=235e15ba633042b5abb14b7e92428518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.568089 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.568351 6128 tablet_service.cc:1467] Processing CreateTablet for tablet d605cff11a05407b979c5aeea4534893 (DEFAULT_TABLE table=default.Table_8a19b71a335045819bf7d07c19b45929 [id=fcb0c8d3da4d4194a5ce44889ac6f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.570170 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e1f9c3715e3545728d25c17219e3ddbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.570739 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1f9c3715e3545728d25c17219e3ddbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.571200 6275 tablet_bootstrap.cc:492] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:08.572273 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bed64c4a55fb4edeba9c58e6a404c4b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.572763 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed64c4a55fb4edeba9c58e6a404c4b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.574389 6272 ts_tablet_manager.cc:1905] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:08.575372 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5e0cc66b896a4eac89ac1b70cc98142c" } new_table_name: "default.Table_f75c843498a844a595b6c5bf62c18256" modify_external_catalogs: true
I20260928 10:44:08.575829 6269 ts_tablet_manager.cc:1918] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.575953 6269 log.cc:1196] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:08.576212 6269 ts_tablet_manager.cc:1939] T 5f42d5aef2424b3aacc8564d98cd3b67 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:08.576876 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 678) took 2326 ms. Trace:
I20260928 10:44:08.576951 6269 rpcz_store.cc:276] 0928 10:44:06.250701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.251115 (+ 414us) service_pool.cc:227] Handling call
0928 10:44:08.236238 (+1985123us) ts_tablet_manager.cc:1145] Deleting tablet 5f42d5aef2424b3aacc8564d98cd3b67
0928 10:44:08.236248 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.287675 (+ 51427us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.575735 (+288060us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.576857 (+ 1122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1984864}
I20260928 10:44:08.577363 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 679) took 2319 ms. Trace:
I20260928 10:44:08.577433 6269 rpcz_store.cc:276] 0928 10:44:06.258292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.259450 (+ 1158us) service_pool.cc:227] Handling call
0928 10:44:08.577209 (+2317759us) ts_tablet_manager.cc:1145] Deleting tablet ba28bafb8dea49f6a477927aea223e1d
0928 10:44:08.577220 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.577349 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2317520}
I20260928 10:44:08.577708 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 680) took 2309 ms. Trace:
I20260928 10:44:08.577764 6269 rpcz_store.cc:276] 0928 10:44:06.268286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.268512 (+ 226us) service_pool.cc:227] Handling call
0928 10:44:08.577611 (+2309099us) ts_tablet_manager.cc:1145] Deleting tablet 5a102bf3fe3b4bc8ad60ca76e48928e7
0928 10:44:08.577619 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.577695 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2308736}
I20260928 10:44:08.577950 6269 tablet_replica.cc:330] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:08.578110 6269 raft_consensus.cc:2229] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.578243 6269 raft_consensus.cc:2258] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.581212 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 with delete_type TABLET_DATA_DELETED (replaced by tablet 72d616250b7f495fb0fff79ece1a77b1) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.581367 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.581468 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet c90c3e290377422385a15e23a0e7dd9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.581874 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9194be57084f2ea4698ec7917857c5 (DEFAULT_TABLE table=default.Table_513b5850f38f4e1eb5e1aeefc9de4191 [id=699ef2cfdc34443d9a32788c67d80984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.582211 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9194be57084f2ea4698ec7917857c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.588476 5847 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34882 (request call id 756) took 1109 ms. Trace:
I20260928 10:44:08.588613 5847 rpcz_store.cc:276] 0928 10:44:07.479356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.162808 (+683452us) service_pool.cc:227] Handling call
0928 10:44:08.225759 (+ 62951us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.225791 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:08.578060 (+352269us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.588318 (+ 10258us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:08.588460 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:08.589051 5847 tablet_service.cc:1467] Processing CreateTablet for tablet a2389065f7e7492c97b59252a278eccb (DEFAULT_TABLE table=default.Table_dfb6bcce5abf47849bae23aa3608d3d4 [id=3d1ebdb0d8954c28b66d5e0333fdc374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.589385 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2389065f7e7492c97b59252a278eccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.598152 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet a6b418bbb3364006b097e3a78edf5f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.600721 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b508c7a57bf04f4c9d7293a5e8a55935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.600950 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a658dce02ff740f086774aa44aef9fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.601126 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5c7540acde04667b9f8aef0bce23940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.601404 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d605cff11a05407b979c5aeea4534893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.601577 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1cf72cadc54a239c5f457004a4c503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.601756 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a802bccb584e7abec289987ecc3c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.601909 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5a416d81434147a1155dcfbad1ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.602173 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758fc07a09554ec0b3c1dca43da745fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.602350 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd708b5c9c44fd69cb9ab981c726ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.602511 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0768dea6a40889a3f50b953c0ee4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.605398 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a3dcbe36f84ff984793b2387dad572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.606630 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8bd8fe9b2284fda972da4528feede7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.609514 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.609988 5850 tablet_service.cc:1467] Processing CreateTablet for tablet ccd819463b35418f9a1b98bffddde87d (DEFAULT_TABLE table=default.Table_20ef0fb161f54bdd9952ca56e6edfe22 [id=aa0ff03dd56a470e9b062e70c9325fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.610397 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd819463b35418f9a1b98bffddde87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.620726 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb089481e47455cb7387b0f17eda9fb (DEFAULT_TABLE table=default.Table_bf02637fcfba4e05ab5580423e5d0cfd [id=b432223024a8454a9f35708b6ec9d9d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.622690 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:08.629580 6866 raft_consensus.cc:482] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.629792 6866 raft_consensus.cc:504] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.630504 6866 leader_election.cc:288] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.631247 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480c0defb89e4f82897a7e1b040a1b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.634617 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19476d14b4a14ab59228638cdcec228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.634837 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c21bf3bbd7403cbc5a74142a883000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.638413 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb089481e47455cb7387b0f17eda9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.639748 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.642771 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e22a551121d4d6abb7f43b4bb4d6e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.643271 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a359f1585924866be13588125db2dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.646528 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.647197 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 7834a54e59114a77b4e54e9190049a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.647578 6136 tablet_service.cc:1467] Processing CreateTablet for tablet a4a802bccb584e7abec289987ecc3c91 (DEFAULT_TABLE table=default.Table_3d7a0234aba14b10acc3793dc22b5a8e [id=59eebfa36dee4137a2c0353c9226b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.647094 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 19476d14b4a14ab59228638cdcec228f (DEFAULT_TABLE table=default.Table_9184a4f90f1548aca39b16ae56efd5bd [id=7cbd977143df44c391db56b9133ebcb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.648298 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd708b5c9c44fd69cb9ab981c726ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.648365 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 01a3dcbe36f84ff984793b2387dad572 (DEFAULT_TABLE table=default.Table_856b2cdcadd34cf9bbdcdbfb02ae6e5f [id=ad71dad4f540478ca690a9ee9da735ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.648597 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e22a551121d4d6abb7f43b4bb4d6e06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.648658 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ba28bafb8dea49f6a477927aea223e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba28bafb8dea49f6a477927aea223e1d already in progress: creating tablet
I20260928 10:44:08.648703 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 (DEFAULT_TABLE table=default.Table_10db3860b70e4b5ba9d48103a5772cc2 [id=d1f4fe687e584aadae9c4df14fc2f625]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:08.648917 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 already in progress: creating tablet
I20260928 10:44:08.649014 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.652092 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758fc07a09554ec0b3c1dca43da745fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.654688 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5c7540acde04667b9f8aef0bce23940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.654940 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a802bccb584e7abec289987ecc3c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.655175 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a3dcbe36f84ff984793b2387dad572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.655124 6120 tablet_service.cc:1467] Processing CreateTablet for tablet a658dce02ff740f086774aa44aef9fb8 (DEFAULT_TABLE table=default.Table_6661e71ec33a42e6b191196785162b9f [id=5ea9fd8e5f6e4a59a43326622b240d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.655529 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a658dce02ff740f086774aa44aef9fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.657965 6124 tablet_service.cc:1467] Processing CreateTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 (DEFAULT_TABLE table=default.Table_1d245c3bafda41cd8fbcdfb061c2e13b [id=c69a927558e7429da0e44d599ca1acf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.658624 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 4f1cf72cadc54a239c5f457004a4c503 (DEFAULT_TABLE table=default.Table_af2781b090d9458abcf37a9e763c6eac [id=aaf7b4db2c9d422fbcc6611376fcba71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.659209 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 480c0defb89e4f82897a7e1b040a1b1c (DEFAULT_TABLE table=default.Table_1e218c9efccb4286837019833cd28a8f [id=749b46ea7e244dc39d06d307c6cf76b3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:08.659876 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 75883us
I20260928 10:44:08.660596 6885 raft_consensus.cc:482] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.660933 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19476d14b4a14ab59228638cdcec228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.660802 6885 raft_consensus.cc:504] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.660984 6275 ts_tablet_manager.cc:1397] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.287s user 0.010s sys 0.017s
I20260928 10:44:08.661463 6885 leader_election.cc:288] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:08.662009 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 05c21bf3bbd7403cbc5a74142a883000 (DEFAULT_TABLE table=default.Table_123771d82cfe40db95628f7b70fb4f4e [id=0ae831032774417884cd40603546a50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.662540 6866 consensus_queue.cc:1035] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:08.663295 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 627) took 3512 ms. Trace:
I20260928 10:44:08.663457 6270 rpcz_store.cc:276] 0928 10:44:05.146577 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.147652 (+ 1075us) service_pool.cc:227] Handling call
0928 10:44:08.083126 (+2935474us) ts_tablet_manager.cc:1145] Deleting tablet e25db69b15eb445792e6168f99304bf2
0928 10:44:08.083140 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.176282 (+ 93142us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.280190 (+103908us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.658875 (+378685us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2935309}
I20260928 10:44:08.663928 6270 tablet_replica.cc:330] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:08.664147 6270 raft_consensus.cc:2229] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.664342 6270 raft_consensus.cc:2258] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.664589 6269 ts_tablet_manager.cc:1905] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:08.664949 6270 ts_tablet_manager.cc:1905] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:08.665081 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c21bf3bbd7403cbc5a74142a883000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.659588 6991 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:46336 (request call id 729) took 1283 ms. Trace:
I20260928 10:44:08.666198 6271 tablet_bootstrap.cc:654] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:08.666747 5957 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:08.666810 6991 rpcz_store.cc:276] 0928 10:44:07.291549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.291932 (+ 383us) service_pool.cc:227] Handling call
0928 10:44:08.575016 (+1283084us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:07.339894 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 10:44:07.855025 (+515131us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 10:44:07.855045 (+ 20us) alter_schema_op.cc:65] Acquired schema lock
0928 10:44:07.855053 (+ 8us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 10:44:07.855097 (+ 44us) alter_schema_op.cc:126] START. Timestamp: 1790592247854522
0928 10:44:07.855100 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:07.879671 (+ 24571us) log.cc:842] Serialized 173 byte log entry
0928 10:44:08.155064 (+275393us) op_driver.cc:444] REPLICATION: finished
0928 10:44:08.231044 (+ 75980us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0928 10:44:08.238923 (+ 7879us) log.cc:842] Serialized 5 byte log entry
0928 10:44:08.264091 (+ 25168us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x60b0004409c8. stack: 00007f07d55a366e 00007f07d55a3430 00007f07d462a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f07e0a6f6fa 00007f07e0ab61a4 00007f07e0a14b4c 00007f07e0a1492c 00007f07e0a203bc 00007f07e0a12e45 00007f07e0a145e4 00007f07e0a143b8 00000000009edb7c 00007f07d55e9344
0928 10:44:08.264271 (+ 180us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x6150001e35a4. stack: 00007f07d55a366e 00007f07d55a3430 00007f07d462a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f07e0ab61ad 00007f07e0a14b4c 00007f07e0a1492c 00007f07e0a203bc 00007f07e0a12e45 00007f07e0a145e4 00007f07e0a143b8 00000000009edb7c 00007f07d55e9344 00007f07d55ec91b
0928 10:44:08.574646 (+310375us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.574937 (+ 291us) log.cc:842] Serialized 14 byte log entry
0928 10:44:08.574976 (+ 39us) alter_schema_op.cc:71] Released schema lock
0928 10:44:08.574978 (+ 2us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":75909,"prepare.queue_time_us":35524,"prepare.run_cpu_time_us":16340,"prepare.run_wall_time_us":923504,"raft.queue_time_us":2655,"raft.run_cpu_time_us":13500,"raft.run_wall_time_us":120969,"replication_time_us":299933,"spinlock_wait_cycles":100907008,"thread_start_us":518162,"threads_started":4,"wal-append.queue_time_us":262995}]]}
I20260928 10:44:08.667400 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:08.668107 5818 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.666755 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758fc07a09554ec0b3c1dca43da745fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.669832 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19476d14b4a14ab59228638cdcec228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.668373 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 2a359f1585924866be13588125db2dc4 (DEFAULT_TABLE table=default.Table_fac20278f3024dccac767807e51d0656 [id=2a4b136bc255499089f09ec0eaf8b271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.646895 6090 leader_election.cc:302] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.672719 6973 raft_consensus.cc:2781] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:08.672851 6973 raft_consensus.cc:686] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:08.673041 6973 consensus_queue.cc:237] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.681032 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c3fe3454521a4e2a883b0de7f7c22f85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:08.681707 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3fe3454521a4e2a883b0de7f7c22f85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:08.684847 6275 raft_consensus.cc:348] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.685050 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 with delete_type TABLET_DATA_DELETED (replaced by tablet 72d616250b7f495fb0fff79ece1a77b1) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.685098 6275 raft_consensus.cc:374] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.685127 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.685186 6275 raft_consensus.cc:729] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.685108 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b508c7a57bf04f4c9d7293a5e8a55935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.685570 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8bd8fe9b2284fda972da4528feede7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.685966 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a359f1585924866be13588125db2dc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.685922 5817 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.685922 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet bc8b8b3a518c42ad9e3c76c9743e361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.686043 5817 leader_election.cc:302] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.686103 6275 consensus_queue.cc:260] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.686293 6866 raft_consensus.cc:2726] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.686357 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9194be57084f2ea4698ec7917857c5 (DEFAULT_TABLE table=default.Table_513b5850f38f4e1eb5e1aeefc9de4191 [id=699ef2cfdc34443d9a32788c67d80984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.550408 6988 raft_consensus.cc:504] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.686954 6275 ts_tablet_manager.cc:1428] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20260928 10:44:08.648155 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.689056 6275 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:08.692440 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet c90c3e290377422385a15e23a0e7dd9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.692823 6136 tablet_service.cc:1467] Processing CreateTablet for tablet a2389065f7e7492c97b59252a278eccb (DEFAULT_TABLE table=default.Table_dfb6bcce5abf47849bae23aa3608d3d4 [id=3d1ebdb0d8954c28b66d5e0333fdc374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.696729 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.697412 6118 tablet_service.cc:1467] Processing CreateTablet for tablet ccd819463b35418f9a1b98bffddde87d (DEFAULT_TABLE table=default.Table_20ef0fb161f54bdd9952ca56e6edfe22 [id=aa0ff03dd56a470e9b062e70c9325fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.699398 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb089481e47455cb7387b0f17eda9fb (DEFAULT_TABLE table=default.Table_bf02637fcfba4e05ab5580423e5d0cfd [id=b432223024a8454a9f35708b6ec9d9d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:08.698851 6091 leader_election.cc:341] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:08.700790 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb089481e47455cb7387b0f17eda9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.703410 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd819463b35418f9a1b98bffddde87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.703622 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9194be57084f2ea4698ec7917857c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.703975 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1cf72cadc54a239c5f457004a4c503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.704996 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d605cff11a05407b979c5aeea4534893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.705179 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05c21bf3bbd7403cbc5a74142a883000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.705387 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2389065f7e7492c97b59252a278eccb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.695538 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 140278us
I20260928 10:44:08.705816 6090 leader_election.cc:302] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.706074 6976 raft_consensus.cc:2781] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:08.706193 6976 raft_consensus.cc:686] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:08.706205 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480c0defb89e4f82897a7e1b040a1b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.709957 6866 raft_consensus.cc:482] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.710135 6866 raft_consensus.cc:504] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.710866 6866 leader_election.cc:288] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.702782 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:08.712033 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0768dea6a40889a3f50b953c0ee4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.714366 6988 leader_election.cc:288] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.718604 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e22a551121d4d6abb7f43b4bb4d6e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.719697 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a802bccb584e7abec289987ecc3c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.706431 6976 consensus_queue.cc:237] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.730607 6866 raft_consensus.cc:482] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.730798 6866 raft_consensus.cc:504] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.731483 6866 leader_election.cc:288] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:08.737792 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.740092 5817 leader_election.cc:341] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.740481 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.741423 5817 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.707082 6133 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45886 (request call id 739) took 1102 ms. Trace:
I20260928 10:44:08.742400 6275 tablet_bootstrap.cc:654] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.742017 6133 rpcz_store.cc:276] 0928 10:44:07.604650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.730511 (+125861us) service_pool.cc:227] Handling call
0928 10:44:07.752466 (+ 21955us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:07.752493 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:08.366666 (+614173us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.706927 (+340261us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:08.707065 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:08.744979 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e25db69b15eb445792e6168f99304bf2 (table default.Table_855cceaf3f204f99b1cfe97f4506389f [id=a2981923ee824567a2c55e998b384360]) successfully deleted
I20260928 10:44:08.745970 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 48ccd7551f6a4fc8b41e70e94749e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:08.746547 5955 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.766650 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd9b4092b1242b8a60974c445a2789a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.769788 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:08.747887 5955 leader_election.cc:341] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:08.771363 5818 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.771544 5818 leader_election.cc:302] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.771845 6866 raft_consensus.cc:2726] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:08.783841 5955 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.784322 5955 leader_election.cc:302] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.790019 6116 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 154) took 1190 ms. Trace:
I20260928 10:44:08.790138 6116 rpcz_store.cc:276] 0928 10:44:07.599369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.599588 (+ 219us) service_pool.cc:227] Handling call
0928 10:44:08.364229 (+764641us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x6150001061a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:08.789964 (+425735us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51473280}
I20260928 10:44:08.795120 6113 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 152) took 1373 ms. Trace:
I20260928 10:44:08.795921 6113 rpcz_store.cc:276] 0928 10:44:07.408843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.409140 (+ 297us) service_pool.cc:227] Handling call
0928 10:44:08.369634 (+960494us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x6150001061a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:08.782433 (+412799us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":139125120}
I20260928 10:44:08.805676 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.806389 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f1cf72cadc54a239c5f457004a4c503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.806807 5818 leader_election.cc:341] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.807041 5818 leader_election.cc:302] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:08.807581 6866 raft_consensus.cc:2726] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.817201 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b508c7a57bf04f4c9d7293a5e8a55935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.817888 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9194be57084f2ea4698ec7917857c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.817881 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48ccd7551f6a4fc8b41e70e94749e6f1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:08.818677 6885 raft_consensus.cc:2726] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.818143 6020 raft_consensus.cc:3037] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:08.832746 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a359f1585924866be13588125db2dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.838421 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0768dea6a40889a3f50b953c0ee4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.843885 5996 tablet_service.cc:1467] Processing CreateTablet for tablet a2389065f7e7492c97b59252a278eccb (DEFAULT_TABLE table=default.Table_dfb6bcce5abf47849bae23aa3608d3d4 [id=3d1ebdb0d8954c28b66d5e0333fdc374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.846063 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a94c95e55fa46d2a8badd9229f55cf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:08.848171 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 60738.8us
I20260928 10:44:08.848994 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5c7540acde04667b9f8aef0bce23940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.850102 6866 raft_consensus.cc:482] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.850267 6866 raft_consensus.cc:504] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.851349 6271 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:08.851636 6271 ts_tablet_manager.cc:1397] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.319s user 0.007s sys 0.000s
I20260928 10:44:08.853106 6271 raft_consensus.cc:348] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.853549 6271 raft_consensus.cc:374] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:08.853708 6271 raft_consensus.cc:729] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:08.853886 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb089481e47455cb7387b0f17eda9fb (DEFAULT_TABLE table=default.Table_bf02637fcfba4e05ab5580423e5d0cfd [id=b432223024a8454a9f35708b6ec9d9d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.854151 6271 consensus_queue.cc:260] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:08.856097 5686 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 95758.4us
I20260928 10:44:08.856701 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2389065f7e7492c97b59252a278eccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.857761 6866 leader_election.cc:288] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.858259 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:08.860041 6271 ts_tablet_manager.cc:1428] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260928 10:44:08.860301 5817 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.861521 6271 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:08.861545 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8bd8fe9b2284fda972da4528feede7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.862021 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5a416d81434147a1155dcfbad1ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.870136 6269 ts_tablet_manager.cc:1918] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.871115 6269 log.cc:1196] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a25c7f3b94e94cafb3275a2e190be0ed
I20260928 10:44:08.872089 6269 ts_tablet_manager.cc:1939] T a25c7f3b94e94cafb3275a2e190be0ed P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:08.873502 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 681) took 2578 ms. Trace:
I20260928 10:44:08.873600 6269 rpcz_store.cc:276] 0928 10:44:06.294905 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.295072 (+ 167us) service_pool.cc:227] Handling call
0928 10:44:08.577918 (+2282846us) ts_tablet_manager.cc:1145] Deleting tablet a25c7f3b94e94cafb3275a2e190be0ed
0928 10:44:08.577926 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.775014 (+197088us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.870021 (+ 95007us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.873478 (+ 3457us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2281703}
I20260928 10:44:08.873970 6269 tablet_replica.cc:330] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:08.874147 6269 raft_consensus.cc:2229] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:08.874289 6269 raft_consensus.cc:2258] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:08.874827 6269 ts_tablet_manager.cc:1905] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:08.877995 6991 tablet.cc:1717] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:08.875679 6020 raft_consensus.cc:2454] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:08.880718 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a25c7f3b94e94cafb3275a2e190be0ed (table default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]) successfully deleted
I20260928 10:44:08.880831 6090 leader_election.cc:302] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:08.880859 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.881147 6973 raft_consensus.cc:2781] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:08.881287 6973 raft_consensus.cc:686] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:08.881501 6973 consensus_queue.cc:237] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.885783 6866 raft_consensus.cc:482] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.885924 6866 raft_consensus.cc:504] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.886518 6866 leader_election.cc:288] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.886655 6866 raft_consensus.cc:482] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.886749 6866 raft_consensus.cc:504] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:08.886911 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:08.887225 6866 leader_election.cc:288] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:08.887457 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.899967 5817 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.900303 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.901288 5817 leader_election.cc:341] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.903157 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a3dcbe36f84ff984793b2387dad572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.905409 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd708b5c9c44fd69cb9ab981c726ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.910104 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480c0defb89e4f82897a7e1b040a1b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.910429 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d605cff11a05407b979c5aeea4534893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.911922 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd819463b35418f9a1b98bffddde87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.912644 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.912729 6271 tablet_bootstrap.cc:654] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:08.915241 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb089481e47455cb7387b0f17eda9fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:08.958973 5818 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.959254 5818 leader_election.cc:302] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:08.959438 5803 kernel_stack_watchdog.cc:198] Thread 6273 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 274ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f1e4cef4980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f1e49c0ebfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f1e49c2efd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f1e49c2abeb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f1e49c2fcef kudu::ThreadPool::Submit() at ??:0
@ 0x7f1e54ad006d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f1e54acf0bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f1e54aceca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f1e54ad6a02 kudu::log::Log::Init() at ??:0
@ 0x7f1e54ad5dbf kudu::log::Log::Open() at ??:0
@ 0x7f1e563672ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f1e563637dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f1e56361fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 10:44:08.959473 7021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 10:44:08.960731 6995 tablet.cc:1717] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:08.961388 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:08.962241 7031 raft_consensus.cc:2726] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:08.964498 7031 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:08.964967 7031 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:08.965369 6892 fs_manager.cc:725] Time spent opening block manager: real 0.397s user 0.019s sys 0.047s
I20260928 10:44:08.976173 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 9956318fe8ef4d1cbc92eda9caa98602 (table default.Table_32e4b27c2c494235acd8e4bd96b9270b [id=b97213ac749448e9a97fde5cf9246b9d]). Expected version 1 got 0
I20260928 10:44:08.976248 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 46490066d50847ceb2362e35dce84f31 (DEFAULT_TABLE table=default.Table_94fba3a7181d44e7a0f5fb7e3931745a [id=7f79aba6afe44497bda865fc3df8930b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.976392 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet f7d762e03b384d85b4e04be8331474a4 (table default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]). Expected version 2 got 0
I20260928 10:44:08.976593 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:08.979068 6270 ts_tablet_manager.cc:1918] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:08.979192 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49c40696fe8645de9b639d2293f41403 consensus state has no leader
I20260928 10:44:08.979226 6270 log.cc:1196] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/733ca22794da4015bbe09ed6c374ad05
I20260928 10:44:08.979553 6270 ts_tablet_manager.cc:1939] T 733ca22794da4015bbe09ed6c374ad05 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:08.980391 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c2164ee9e1054e77849d3bcd8c58ccba" } modify_external_catalogs: true
I20260928 10:44:08.980561 5696 catalog_manager.cc:5495] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:08.981041 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:08.982069 7031 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:08.982975 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 65655903a731456c8697648efe2472f9 (DEFAULT_TABLE table=default.Table_5c0099194a374aebbb86c678423e2ae7 [id=858eded329364bb1ab1faa171b09ba76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.983843 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 65655903a731456c8697648efe2472f9 (DEFAULT_TABLE table=default.Table_5c0099194a374aebbb86c678423e2ae7 [id=858eded329364bb1ab1faa171b09ba76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.984223 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65655903a731456c8697648efe2472f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.984596 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 1d72fa48751d46fba41feb7f7c720657 (DEFAULT_TABLE table=default.Table_b23b0742d5e04154b63487c884850da3 [id=b43e23dca2064fad96bfa0ca976a09b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.985031 5850 tablet_service.cc:1467] Processing CreateTablet for tablet dfc770b2448442c98cb66b33e91755af (DEFAULT_TABLE table=default.Table_7439b747179f45b6a6627c1b8d93956f [id=86c9ec5e55ef4cd694cd831e9fee25af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.986541 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c2164ee9e1054e77849d3bcd8c58ccba" } modify_external_catalogs: true
I20260928 10:44:08.986680 5988 tablet_service.cc:1467] Processing CreateTablet for tablet dfc770b2448442c98cb66b33e91755af (DEFAULT_TABLE table=default.Table_7439b747179f45b6a6627c1b8d93956f [id=86c9ec5e55ef4cd694cd831e9fee25af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.987018 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc770b2448442c98cb66b33e91755af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.988802 5852 tablet_service.cc:1467] Processing CreateTablet for tablet d687aaf1c54f497e9999cf49f5b14144 (DEFAULT_TABLE table=default.Table_33fce32326fa4e4d8c37f174f6b55b8a [id=e2ab7c71c497465db0a1e3da57b0b440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.988557 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 46490066d50847ceb2362e35dce84f31 (DEFAULT_TABLE table=default.Table_94fba3a7181d44e7a0f5fb7e3931745a [id=7f79aba6afe44497bda865fc3df8930b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.989447 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46490066d50847ceb2362e35dce84f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.990869 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:08.991499 5817 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:08.966347 6892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data,/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
uuid: "7a1529a7b0d7479db7dabebf471795b5"
format_stamp: "Formatted at 2026-09-28 10:43:51 on dist-test-slave-wgrf"
I20260928 10:44:08.991904 6892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 10:44:08.994316 5996 tablet_service.cc:1467] Processing CreateTablet for tablet d687aaf1c54f497e9999cf49f5b14144 (DEFAULT_TABLE table=default.Table_33fce32326fa4e4d8c37f174f6b55b8a [id=e2ab7c71c497465db0a1e3da57b0b440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.994958 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d687aaf1c54f497e9999cf49f5b14144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.995582 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d72fa48751d46fba41feb7f7c720657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.995630 6269 ts_tablet_manager.cc:1918] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:08.995733 6269 log.cc:1196] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/847b18c212474456ac9b40eee055dbd0
I20260928 10:44:08.995754 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65655903a731456c8697648efe2472f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.996026 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc770b2448442c98cb66b33e91755af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.996027 6269 ts_tablet_manager.cc:1939] T 847b18c212474456ac9b40eee055dbd0 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:08.996361 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46490066d50847ceb2362e35dce84f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:08.998314 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 1d72fa48751d46fba41feb7f7c720657 (DEFAULT_TABLE table=default.Table_b23b0742d5e04154b63487c884850da3 [id=b43e23dca2064fad96bfa0ca976a09b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:08.998790 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d72fa48751d46fba41feb7f7c720657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.008854 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d687aaf1c54f497e9999cf49f5b14144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.010962 6275 tablet_bootstrap.cc:492] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.011106 6275 ts_tablet_manager.cc:1397] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.322s user 0.010s sys 0.003s
I20260928 10:44:08.994267 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 1af4642f16b94e09833ddc4131118e2b (DEFAULT_TABLE table=default.Table_8ca6e9f8325340a98cbba1bd1df669d9 [id=8621193e185c47eaac1db6896e06e466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.011904 6275 raft_consensus.cc:348] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.012110 6275 raft_consensus.cc:374] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.012145 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af4642f16b94e09833ddc4131118e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.012166 6275 raft_consensus.cc:729] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.012362 6275 consensus_queue.cc:260] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.012804 6275 ts_tablet_manager.cc:1428] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.013044 6275 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.015201 7033 tablet.cc:1722] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:09.020584 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 1af4642f16b94e09833ddc4131118e2b (DEFAULT_TABLE table=default.Table_8ca6e9f8325340a98cbba1bd1df669d9 [id=8621193e185c47eaac1db6896e06e466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.021152 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af4642f16b94e09833ddc4131118e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.021898 6114 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 155) took 1422 ms. Trace:
I20260928 10:44:09.022033 6114 rpcz_store.cc:276] 0928 10:44:07.599488 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.601788 (+ 2300us) service_pool.cc:227] Handling call
0928 10:44:08.385942 (+784154us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x61500013b624. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:09.021875 (+635933us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":364313856}
I20260928 10:44:09.023456 6275 tablet_bootstrap.cc:654] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.025117 6271 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.025358 6271 ts_tablet_manager.cc:1397] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.164s user 0.009s sys 0.005s
I20260928 10:44:09.026023 6275 tablet_bootstrap.cc:492] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.026225 6275 ts_tablet_manager.cc:1397] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260928 10:44:09.026229 6271 raft_consensus.cc:348] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.026559 6271 raft_consensus.cc:374] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.026666 6271 raft_consensus.cc:729] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.026634 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.026875 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.026914 6271 consensus_queue.cc:260] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.027441 6271 ts_tablet_manager.cc:1428] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:09.027717 6271 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.028316 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 (DEFAULT_TABLE table=default.Table_11d8d455798b42eca6d68cc8928974c6 [id=33fa64f36cc24937ac19b065bccd9a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.028761 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.029286 6271 tablet_bootstrap.cc:654] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.036468 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 6677b6eb494543fe9314d1aba1372e0c (DEFAULT_TABLE table=default.Table_27e6c402d5e14a40bb00a8d7826f6019 [id=e435b649d84b4b1f99ef7a50b6bd12a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.036468 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 6677b6eb494543fe9314d1aba1372e0c (DEFAULT_TABLE table=default.Table_27e6c402d5e14a40bb00a8d7826f6019 [id=e435b649d84b4b1f99ef7a50b6bd12a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.036870 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6677b6eb494543fe9314d1aba1372e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.037009 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6677b6eb494543fe9314d1aba1372e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.037145 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 72d616250b7f495fb0fff79ece1a77b1 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.037494 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d616250b7f495fb0fff79ece1a77b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.040948 5859 tablet_service.cc:1467] Processing CreateTablet for tablet cf14eb35eb7c458d804bebec4cbee15e (DEFAULT_TABLE table=default.Table_b0a6794e144e406db22950387a851f85 [id=e5ad1cb529b74f9d9e6e7d3451191aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.041448 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf14eb35eb7c458d804bebec4cbee15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.042191 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 29e49298a8544cb294a310022ec414b1 (DEFAULT_TABLE table=default.Table_22c18a9c5f864f6ca0e6a2de9c51c2e3 [id=1d5640e3b4d94bed9dcbdd7f773c4e5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.042615 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e49298a8544cb294a310022ec414b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.043141 7031 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.043262 7031 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.043843 7031 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.044660 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.045251 6976 raft_consensus.cc:482] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:09.045284 5817 leader_election.cc:341] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.045379 6976 raft_consensus.cc:504] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.045920 6976 leader_election.cc:288] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.046554 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d5dd4e5b544262938b1822510d8b9f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.046784 6019 raft_consensus.cc:2454] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.047127 6090 leader_election.cc:302] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:09.047401 6976 raft_consensus.cc:2781] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.047468 6976 raft_consensus.cc:482] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.047529 6976 raft_consensus.cc:3037] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.051738 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 29e49298a8544cb294a310022ec414b1 (DEFAULT_TABLE table=default.Table_22c18a9c5f864f6ca0e6a2de9c51c2e3 [id=1d5640e3b4d94bed9dcbdd7f773c4e5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.052145 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e49298a8544cb294a310022ec414b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.054931 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 (DEFAULT_TABLE table=default.Table_2a81ff9471704a4ab5ddf72671322155 [id=04b45d7f14ba4eef9e9b38cab0b96a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.055389 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f68e9f9bf44cf09fc87f102de60f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.056565 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.056649 5818 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.056906 5818 leader_election.cc:302] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.057197 7031 raft_consensus.cc:2726] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.057163 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.059640 6275 raft_consensus.cc:348] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.059412 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 (DEFAULT_TABLE table=default.Table_2a81ff9471704a4ab5ddf72671322155 [id=04b45d7f14ba4eef9e9b38cab0b96a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.060778 6275 raft_consensus.cc:374] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.061022 6275 raft_consensus.cc:729] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.061529 6275 consensus_queue.cc:260] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.061766 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f68e9f9bf44cf09fc87f102de60f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.063117 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 682) took 2768 ms. Trace:
I20260928 10:44:09.063230 6269 rpcz_store.cc:276] 0928 10:44:06.295027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.295227 (+ 200us) service_pool.cc:227] Handling call
0928 10:44:08.873920 (+2578693us) ts_tablet_manager.cc:1145] Deleting tablet 847b18c212474456ac9b40eee055dbd0
0928 10:44:08.873931 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.972091 (+ 98160us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.995533 (+ 23442us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.063091 (+ 67558us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2577636}
I20260928 10:44:09.063582 6269 tablet_replica.cc:330] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:09.064180 6275 ts_tablet_manager.cc:1428] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.038s user 0.000s sys 0.002s
I20260928 10:44:09.064767 6269 raft_consensus.cc:2229] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.064944 6269 raft_consensus.cc:2258] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.065498 6269 ts_tablet_manager.cc:1905] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:09.066375 6275 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:09.066766 5818 leader_election.cc:341] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.066808 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 847b18c212474456ac9b40eee055dbd0 (table default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]) successfully deleted
I20260928 10:44:09.066879 5818 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.068049 7031 raft_consensus.cc:2726] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:09.068487 5818 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.068809 7029 raft_consensus.cc:482] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.068995 5818 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.068956 7029 raft_consensus.cc:504] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.069597 7029 leader_election.cc:288] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.070554 6275 tablet_bootstrap.cc:654] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.074922 5985 tablet_service.cc:1467] Processing CreateTablet for tablet cf14eb35eb7c458d804bebec4cbee15e (DEFAULT_TABLE table=default.Table_b0a6794e144e406db22950387a851f85 [id=e5ad1cb529b74f9d9e6e7d3451191aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.075461 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 (DEFAULT_TABLE table=default.Table_11d8d455798b42eca6d68cc8928974c6 [id=33fa64f36cc24937ac19b065bccd9a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.071369 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 46490066d50847ceb2362e35dce84f31 (DEFAULT_TABLE table=default.Table_94fba3a7181d44e7a0f5fb7e3931745a [id=7f79aba6afe44497bda865fc3df8930b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.072366 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5b422c70a84cc0bc9f8a686f4e2c82" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.072364 6118 tablet_service.cc:1467] Processing CreateTablet for tablet d687aaf1c54f497e9999cf49f5b14144 (DEFAULT_TABLE table=default.Table_33fce32326fa4e4d8c37f174f6b55b8a [id=e2ab7c71c497465db0a1e3da57b0b440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.072841 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 65655903a731456c8697648efe2472f9 (DEFAULT_TABLE table=default.Table_5c0099194a374aebbb86c678423e2ae7 [id=858eded329364bb1ab1faa171b09ba76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.073283 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 (DEFAULT_TABLE table=default.Table_2a81ff9471704a4ab5ddf72671322155 [id=04b45d7f14ba4eef9e9b38cab0b96a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.073760 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 29e49298a8544cb294a310022ec414b1 (DEFAULT_TABLE table=default.Table_22c18a9c5f864f6ca0e6a2de9c51c2e3 [id=1d5640e3b4d94bed9dcbdd7f773c4e5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.074021 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 72d616250b7f495fb0fff79ece1a77b1 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.078120 6866 raft_consensus.cc:2726] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.078950 6272 ts_tablet_manager.cc:1918] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:09.079077 6272 log.cc:1196] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d40123712b17464e87023f69a6235640
I20260928 10:44:09.079447 6272 ts_tablet_manager.cc:1939] T d40123712b17464e87023f69a6235640 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:09.079725 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65655903a731456c8697648efe2472f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.080549 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f68e9f9bf44cf09fc87f102de60f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.080951 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e49298a8544cb294a310022ec414b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.081297 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d687aaf1c54f497e9999cf49f5b14144. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:09.081475 6091 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:09.081707 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46490066d50847ceb2362e35dce84f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.082087 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 626) took 3935 ms. Trace:
I20260928 10:44:09.082194 6270 rpcz_store.cc:276] 0928 10:44:05.146464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.147902 (+ 1438us) service_pool.cc:227] Handling call
0928 10:44:08.663826 (+3515924us) ts_tablet_manager.cc:1145] Deleting tablet 733ca22794da4015bbe09ed6c374ad05
0928 10:44:08.663840 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.870022 (+206182us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:08.978948 (+108926us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.082061 (+103113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515727}
I20260928 10:44:09.082640 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 629) took 3930 ms. Trace:
I20260928 10:44:09.082718 6270 rpcz_store.cc:276] 0928 10:44:05.152104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.152160 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:09.082511 (+3930351us) ts_tablet_manager.cc:1145] Deleting tablet 4bb1214f8880463fb2bb36c8f922174f
0928 10:44:09.082525 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.082626 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3930107}
I20260928 10:44:09.074232 6132 tablet_service.cc:1467] Processing CreateTablet for tablet cf14eb35eb7c458d804bebec4cbee15e (DEFAULT_TABLE table=default.Table_b0a6794e144e406db22950387a851f85 [id=e5ad1cb529b74f9d9e6e7d3451191aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.083170 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 630) took 3930 ms. Trace:
I20260928 10:44:09.083245 6270 rpcz_store.cc:276] 0928 10:44:05.152354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.152406 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:09.082902 (+3930496us) ts_tablet_manager.cc:1145] Deleting tablet e03f686afffc4d47b5e27fdbc8eb8f75
0928 10:44:09.082911 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.083157 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3930320}
I20260928 10:44:09.074297 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 1d72fa48751d46fba41feb7f7c720657 (DEFAULT_TABLE table=default.Table_b23b0742d5e04154b63487c884850da3 [id=b43e23dca2064fad96bfa0ca976a09b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.074021 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 6677b6eb494543fe9314d1aba1372e0c (DEFAULT_TABLE table=default.Table_27e6c402d5e14a40bb00a8d7826f6019 [id=e435b649d84b4b1f99ef7a50b6bd12a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.074460 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d5dd4e5b544262938b1822510d8b9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.083452 6270 tablet_replica.cc:330] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:09.074788 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 (DEFAULT_TABLE table=default.Table_11d8d455798b42eca6d68cc8928974c6 [id=33fa64f36cc24937ac19b065bccd9a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.083612 6270 raft_consensus.cc:2229] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.075223 6136 tablet_service.cc:1467] Processing CreateTablet for tablet dfc770b2448442c98cb66b33e91755af (DEFAULT_TABLE table=default.Table_7439b747179f45b6a6627c1b8d93956f [id=86c9ec5e55ef4cd694cd831e9fee25af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.075651 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1af4642f16b94e09833ddc4131118e2b (DEFAULT_TABLE table=default.Table_8ca6e9f8325340a98cbba1bd1df669d9 [id=8621193e185c47eaac1db6896e06e466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.083761 6270 raft_consensus.cc:2258] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.084275 6270 ts_tablet_manager.cc:1905] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:09.085538 6976 raft_consensus.cc:504] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:09.085811 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet daf7a87b82424e25ae47d3f61c2ddb7f consensus state has no leader
I20260928 10:44:09.086385 6976 leader_election.cc:288] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.087270 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d5dd4e5b544262938b1822510d8b9f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:09.087463 6020 raft_consensus.cc:3037] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.088996 6275 tablet_bootstrap.cc:492] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.089079 6271 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.089232 6275 ts_tablet_manager.cc:1397] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.006s
I20260928 10:44:09.089293 6271 ts_tablet_manager.cc:1397] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.001s
I20260928 10:44:09.089982 6271 raft_consensus.cc:348] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.090191 6271 raft_consensus.cc:374] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.090251 6271 raft_consensus.cc:729] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.090085 6275 raft_consensus.cc:348] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.090416 6271 consensus_queue.cc:260] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.090562 6275 raft_consensus.cc:374] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.090672 6275 raft_consensus.cc:729] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.091005 6271 ts_tablet_manager.cc:1428] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:09.090965 6275 consensus_queue.cc:260] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.091326 6271 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.092947 6271 tablet_bootstrap.cc:654] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.092931 6275 ts_tablet_manager.cc:1428] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260928 10:44:09.094605 6091 leader_election.cc:341] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:09.102761 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf14eb35eb7c458d804bebec4cbee15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.103540 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af4642f16b94e09833ddc4131118e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.103982 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.104436 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d72fa48751d46fba41feb7f7c720657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.105943 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc770b2448442c98cb66b33e91755af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.106285 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 593015cc3f8547b5a08043d2c016ec91 (table default.Table_3a223846547e4541b652fe1662cd3647 [id=78c21cb16c8e4745b67eb1700a404525]). Expected version 1 got 0
I20260928 10:44:09.106420 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6677b6eb494543fe9314d1aba1372e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.106698 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:09.108439 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c01b6fc2750c48cb84d7530d32378fb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.109035 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c01b6fc2750c48cb84d7530d32378fb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:09.111635 6273 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.108s sys 0.140s
W20260928 10:44:09.111766 6273 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.579s user 0.108s sys 0.140s
I20260928 10:44:09.112635 6273 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.112778 6273 ts_tablet_manager.cc:1397] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.583s user 0.109s sys 0.141s
I20260928 10:44:09.113037 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.113026 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.114012 6275 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.113685 6273 raft_consensus.cc:348] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.117290 6273 raft_consensus.cc:374] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.117388 6273 raft_consensus.cc:729] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.117633 6273 consensus_queue.cc:260] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.118324 6273 ts_tablet_manager.cc:1428] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:09.126452 6273 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:09.127532 5957 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:09.128208 6273 tablet_bootstrap.cc:654] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:09.130918 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 consensus state has no leader
W20260928 10:44:09.131013 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20d2496eaae44b02852cfdc928c7f172 consensus state has no leader
W20260928 10:44:09.135042 5687 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.126:39997, user_credentials={real_user=slave}} blocked reactor thread for 77160.6us
I20260928 10:44:09.140916 6973 raft_consensus.cc:482] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.143023 6273 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.143206 6273 ts_tablet_manager.cc:1397] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.002s
I20260928 10:44:09.143188 6973 raft_consensus.cc:504] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.143949 6273 raft_consensus.cc:348] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.144181 6273 raft_consensus.cc:374] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.144253 6273 raft_consensus.cc:729] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.144470 6273 consensus_queue.cc:260] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.145031 6273 ts_tablet_manager.cc:1428] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:09.145323 6273 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.145852 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_65353e0a07ac45679535489394b27f44" } modify_external_catalogs: true
I20260928 10:44:09.146085 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_65353e0a07ac45679535489394b27f44" } modify_external_catalogs: true
I20260928 10:44:09.146353 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fac20278f3024dccac767807e51d0656" } modify_external_catalogs: true
I20260928 10:44:09.146584 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fac20278f3024dccac767807e51d0656" } modify_external_catalogs: true
I20260928 10:44:09.147226 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a0d63c6cbc4eebaf42dc7f969f243c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.147627 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5cb651a795e04fc59d29bd7535556cbf" } modify_external_catalogs: true
I20260928 10:44:09.147763 6019 raft_consensus.cc:2454] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.147857 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5cb651a795e04fc59d29bd7535556cbf" } modify_external_catalogs: true
I20260928 10:44:09.148294 6090 leader_election.cc:302] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:09.153748 6973 leader_election.cc:288] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.156054 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 733ca22794da4015bbe09ed6c374ad05 (table default.Table_b760d137ae6348e4abddd913d0d12649 [id=92272200f3264e5b9ec4ea1867b83351]) successfully deleted
I20260928 10:44:09.156388 6273 tablet_bootstrap.cc:654] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:09.156652 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4bb1214f8880463fb2bb36c8f922174f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bb1214f8880463fb2bb36c8f922174f already in progress: creating tablet
I20260928 10:44:09.158363 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.165052 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d616250b7f495fb0fff79ece1a77b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:09.172320 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 99944us
W20260928 10:44:09.175100 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57c4f7edb76a4710bd5abe2999451a97 consensus state has no leader
I20260928 10:44:09.178429 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a000edb49a80410497d61b1ac00bc9f0" } modify_external_catalogs: true
I20260928 10:44:09.178699 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a000edb49a80410497d61b1ac00bc9f0" } modify_external_catalogs: true
I20260928 10:44:09.181231 6866 raft_consensus.cc:482] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.181383 6866 raft_consensus.cc:504] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.181973 5700 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:09.182018 6866 leader_election.cc:288] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.182626 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 85f90d3cbc724e289f525c2a89296ce4 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:09.186146 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_62a7f4dbf79f4e048a37852a9c780a55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:09.186729 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dce9710720074022a1cc005217a6ad07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.187139 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dce9710720074022a1cc005217a6ad07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.186337 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b2251f8b3e7e4810b33f0c06a9fe935c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.188352 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2251f8b3e7e4810b33f0c06a9fe935c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:09.187114 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62a7f4dbf79f4e048a37852a9c780a55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.192276 6976 raft_consensus.cc:2781] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 10:44:09.192346 6091 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:09.192551 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 695) took 2099 ms. Trace:
I20260928 10:44:09.193373 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.193941 5818 leader_election.cc:341] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.194417 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 15931372e469401ab22422677bd90d1f
I20260928 10:44:09.194672 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_550e45812a914de2bf9f3d979383be3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.195161 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_550e45812a914de2bf9f3d979383be3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.195199 6272 rpcz_store.cc:276] 0928 10:44:07.071681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.071735 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:08.381335 (+1309600us) ts_tablet_manager.cc:1145] Deleting tablet d40123712b17464e87023f69a6235640
0928 10:44:08.381345 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:08.780002 (+398657us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.078809 (+298807us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.171482 (+ 92673us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246463}
I20260928 10:44:09.195626 6272 tablet_replica.cc:330] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:09.195868 6272 raft_consensus.cc:2229] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.195878 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 15931372e469401ab22422677bd90d1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.196031 6272 raft_consensus.cc:2258] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.196456 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e15c910d058b467693d20c3f1c8fdcdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:09.196622 6272 ts_tablet_manager.cc:1905] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:09.196996 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e15c910d058b467693d20c3f1c8fdcdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.200284 6990 raft_consensus.cc:482] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.200749 6990 raft_consensus.cc:504] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.202330 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d40123712b17464e87023f69a6235640 (table default.Table_296151ac6be54c6487d713bcebc2d867 [id=beb0af193f5f4677ad125facb05b7cf0]) successfully deleted
W20260928 10:44:09.202739 5957 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c2635c7c47ba4383b6b0f07cd3b42f74
I20260928 10:44:09.213577 6866 raft_consensus.cc:482] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.213780 6866 raft_consensus.cc:504] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.214450 6866 leader_election.cc:288] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.215059 6976 raft_consensus.cc:482] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.216109 6273 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.216252 6273 ts_tablet_manager.cc:1397] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.002s
I20260928 10:44:09.217927 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.218075 6866 raft_consensus.cc:482] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.218212 6866 raft_consensus.cc:504] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.218469 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet d257233e5b934d619e2289a6df55d65a with delete_type TABLET_DATA_DELETED (replaced by tablet efa178fc1e344069b086003d39f1b848) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.218834 6866 leader_election.cc:288] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.219341 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.219950 5818 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.220163 6273 raft_consensus.cc:348] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.220395 6273 raft_consensus.cc:374] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.220448 6273 raft_consensus.cc:729] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:09.221844 5817 leader_election.cc:341] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.221975 5817 leader_election.cc:302] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.222437 6866 raft_consensus.cc:2726] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.222311 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d38c0ed54b45a89f8e1daefd5b67a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.225044 6976 raft_consensus.cc:3037] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.226132 6275 tablet_bootstrap.cc:654] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.225989 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.225324 6273 consensus_queue.cc:260] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.229113 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.229247 6273 ts_tablet_manager.cc:1428] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 10:44:09.229558 6273 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.226440 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 15931372e469401ab22422677bd90d1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:09.234776 5817 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:09.235059 5817 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.235183 5817 leader_election.cc:302] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.235668 6866 raft_consensus.cc:2726] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.240578 7029 raft_consensus.cc:482] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.240782 7029 raft_consensus.cc:504] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.241413 7029 leader_election.cc:288] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:09.242347 5957 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 82b3afe074194023ba788094a2a6b81c
I20260928 10:44:09.241348 6275 tablet_bootstrap.cc:492] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.242715 6275 ts_tablet_manager.cc:1397] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.129s user 0.002s sys 0.003s
I20260928 10:44:09.243844 6275 raft_consensus.cc:348] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.244210 6275 raft_consensus.cc:374] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.244333 6275 raft_consensus.cc:729] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.244674 6275 consensus_queue.cc:260] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.245451 6275 ts_tablet_manager.cc:1428] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:09.245820 6275 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.247789 6275 tablet_bootstrap.cc:654] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.247792 6273 tablet_bootstrap.cc:654] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.253091 6275 tablet_bootstrap.cc:492] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.253350 6275 ts_tablet_manager.cc:1397] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260928 10:44:09.253453 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.254074 5818 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.254202 5818 leader_election.cc:302] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.254438 6866 raft_consensus.cc:2726] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.254244 6275 raft_consensus.cc:348] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.254846 6275 raft_consensus.cc:374] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.254977 6275 raft_consensus.cc:729] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.255270 6275 consensus_queue.cc:260] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.256174 6275 ts_tablet_manager.cc:1428] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:44:09.256512 6275 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.258205 6275 tablet_bootstrap.cc:654] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.266680 6275 tablet_bootstrap.cc:492] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.266968 6275 ts_tablet_manager.cc:1397] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260928 10:44:09.267833 6275 raft_consensus.cc:348] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.268175 6275 raft_consensus.cc:374] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.268779 6275 raft_consensus.cc:729] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.269156 6275 consensus_queue.cc:260] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:09.172942 5955 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.269508 5955 leader_election.cc:302] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.269811 7029 raft_consensus.cc:2726] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:09.270213 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 97276.3us
I20260928 10:44:09.270761 6275 ts_tablet_manager.cc:1428] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:09.271871 6275 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.272990 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf14eb35eb7c458d804bebec4cbee15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.273490 6275 tablet_bootstrap.cc:654] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.274307 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.286540 6990 leader_election.cc:288] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.300879 6976 raft_consensus.cc:504] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.301705 6976 leader_election.cc:288] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.303830 6091 leader_election.cc:341] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:09.310345 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a0d63c6cbc4eebaf42dc7f969f243c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:09.311136 6019 raft_consensus.cc:3037] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.326609 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 72d616250b7f495fb0fff79ece1a77b1 (DEFAULT_TABLE table=default.Table_1a4ef15990d04df2b9e997c08557de9a [id=4a91c29a46a944848da152cfab15da88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.329118 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet 15931372e469401ab22422677bd90d1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:08 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.338455 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2635c7c47ba4383b6b0f07cd3b42f74" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.339859 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b3afe074194023ba788094a2a6b81c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.290903 6269 ts_tablet_manager.cc:1918] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:09.346127 6269 log.cc:1196] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/bae5a2038947413f95f134602081c889
I20260928 10:44:09.346729 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.347561 6269 ts_tablet_manager.cc:1939] T bae5a2038947413f95f134602081c889 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:09.349478 7033 tablet.cc:1717] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:09.351106 6018 raft_consensus.cc:2454] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:09.351851 5818 leader_election.cc:302] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.352702 6866 raft_consensus.cc:2781] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.352787 6866 raft_consensus.cc:482] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.352845 6866 raft_consensus.cc:3037] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.353858 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 683) took 2970 ms. Trace:
I20260928 10:44:09.353972 6269 rpcz_store.cc:276] 0928 10:44:06.383075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.383216 (+ 141us) service_pool.cc:227] Handling call
0928 10:44:09.063530 (+2680314us) ts_tablet_manager.cc:1145] Deleting tablet bae5a2038947413f95f134602081c889
0928 10:44:09.063541 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.163423 (+ 99882us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.290778 (+127355us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.353832 (+ 63054us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17,"tablet-delete.queue_time_us":2680109}
I20260928 10:44:09.354640 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet bae5a2038947413f95f134602081c889 (table default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]) successfully deleted
I20260928 10:44:09.354998 6269 tablet_replica.cc:330] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:09.355189 6269 raft_consensus.cc:2229] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.355322 6269 raft_consensus.cc:2258] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.355871 6269 ts_tablet_manager.cc:1905] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:09.370107 5955 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.370407 5955 leader_election.cc:302] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:09.370913 5955 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.371071 5955 leader_election.cc:302] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.371773 7029 raft_consensus.cc:2726] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.371946 7029 raft_consensus.cc:2726] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.378989 6273 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.379135 6273 ts_tablet_manager.cc:1397] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.150s user 0.013s sys 0.031s
I20260928 10:44:09.379791 6273 raft_consensus.cc:348] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.380009 6273 raft_consensus.cc:374] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.380059 6273 raft_consensus.cc:729] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.380259 6273 consensus_queue.cc:260] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.380846 6273 ts_tablet_manager.cc:1428] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:09.381116 6273 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.382534 6271 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.382673 6271 ts_tablet_manager.cc:1397] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.291s user 0.020s sys 0.043s
I20260928 10:44:09.383369 6271 raft_consensus.cc:348] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.383565 6271 raft_consensus.cc:374] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.383620 6271 raft_consensus.cc:729] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.383813 6271 consensus_queue.cc:260] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.384379 6271 ts_tablet_manager.cc:1428] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.385452 6271 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.392915 6273 tablet_bootstrap.cc:654] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.394348 6271 tablet_bootstrap.cc:654] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.395896 6273 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.396014 6273 ts_tablet_manager.cc:1397] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20260928 10:44:09.396683 6272 ts_tablet_manager.cc:1918] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:09.396801 6272 log.cc:1196] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/59bfe1f8050f47429ef80a19fdcd8198
I20260928 10:44:09.396680 6273 raft_consensus.cc:348] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.396883 6273 raft_consensus.cc:374] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.396930 6273 raft_consensus.cc:729] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.397074 6272 ts_tablet_manager.cc:1939] T 59bfe1f8050f47429ef80a19fdcd8198 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:09.397113 6273 consensus_queue.cc:260] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.397679 6273 ts_tablet_manager.cc:1428] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:09.397907 6273 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.398694 6866 raft_consensus.cc:504] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.399353 6866 leader_election.cc:288] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.399668 6273 tablet_bootstrap.cc:654] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.403934 6271 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.404099 6271 ts_tablet_manager.cc:1397] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260928 10:44:09.404886 6271 raft_consensus.cc:348] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.405112 6271 raft_consensus.cc:374] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.405169 6271 raft_consensus.cc:729] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.405340 6271 consensus_queue.cc:260] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.405992 6271 ts_tablet_manager.cc:1428] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.406263 6271 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.406750 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cd65a860b00d4a7ba8ae92dde5818212
I20260928 10:44:09.408416 6271 tablet_bootstrap.cc:654] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.413066 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.415392 5693 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5c37ef00862646cf8681f0255d59520a
I20260928 10:44:09.415505 6892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 10:44:09.416412 6273 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.416563 6273 ts_tablet_manager.cc:1397] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260928 10:44:09.416966 7031 raft_consensus.cc:482] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.417104 7031 raft_consensus.cc:504] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.417744 6273 raft_consensus.cc:348] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.417997 6273 raft_consensus.cc:374] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.418053 6273 raft_consensus.cc:729] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.418231 6273 consensus_queue.cc:260] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.418746 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.419306 6976 raft_consensus.cc:482] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.419543 6271 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.419481 6976 raft_consensus.cc:504] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.419672 6271 ts_tablet_manager.cc:1397] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260928 10:44:09.420143 6976 leader_election.cc:288] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.420424 6271 raft_consensus.cc:348] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.420627 6271 raft_consensus.cc:374] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.420684 6271 raft_consensus.cc:729] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.420861 6271 consensus_queue.cc:260] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.420974 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 1631d396362a4cffa1dec06d00894c63 with delete_type TABLET_DATA_DELETED (replaced by tablet 95e1f8a63fed4c82ac95c2fbb7bc633d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.421187 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet f9a0d63c6cbc4eebaf42dc7f969f243c with delete_type TABLET_DATA_DELETED (replaced by tablet 206400064f5c4060b8e7da8dfbdc5d02) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.421474 6271 ts_tablet_manager.cc:1428] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.421748 6271 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.424525 6271 tablet_bootstrap.cc:654] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.424114 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:09.426164 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.417778 7031 leader_election.cc:288] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.426940 7031 raft_consensus.cc:482] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.427129 6892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 10:44:09.427057 7031 raft_consensus.cc:504] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.427464 6892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 10:44:09.427656 7031 leader_election.cc:288] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.429641 5817 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.430280 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:09.431221 5818 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.431378 5818 leader_election.cc:302] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.431885 6866 raft_consensus.cc:2726] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.432515 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.438791 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 85f90d3cbc724e289f525c2a89296ce4
I20260928 10:44:09.439415 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 85f90d3cbc724e289f525c2a89296ce4 deleted and replaced by tablet 775974ff84e2417fb9ed089f5aa4ca87
I20260928 10:44:09.439757 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet d64c1af58d6a4dfcabd6eecb8c75d572 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:09.440359 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 95e1f8a63fed4c82ac95c2fbb7bc633d from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:09.440928 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 01bd3593f7ac421cbed8ac5797e068fa from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:09.441433 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f799021aca384269bfcd67829f3a7db5
I20260928 10:44:09.443032 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet 775974ff84e2417fb9ed089f5aa4ca87) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.443821 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet f799021aca384269bfcd67829f3a7db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.444041 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet 775974ff84e2417fb9ed089f5aa4ca87) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.444324 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet f799021aca384269bfcd67829f3a7db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.447710 6273 ts_tablet_manager.cc:1428] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.031s user 0.004s sys 0.004s
I20260928 10:44:09.448067 6273 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.448361 6271 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.448499 6271 ts_tablet_manager.cc:1397] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260928 10:44:09.449193 6271 raft_consensus.cc:348] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.449432 6271 raft_consensus.cc:374] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.449488 6271 raft_consensus.cc:729] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.449687 6271 consensus_queue.cc:260] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.449965 5988 tablet_service.cc:1514] Processing DeleteTablet for tablet f799021aca384269bfcd67829f3a7db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.450027 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 85f90d3cbc724e289f525c2a89296ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet 775974ff84e2417fb9ed089f5aa4ca87) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.449976 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.450186 6271 ts_tablet_manager.cc:1428] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:09.450492 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3168fb311ee64931bd326b043a397ea1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.450639 6273 tablet_bootstrap.cc:654] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:09.451011 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 (table default.Table_9f60cfe53d8b48e981774ea02f9b0b63 [id=613bbe90d61e405599e0d4813171ba06], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 consensus state has no leader
I20260928 10:44:09.454766 6271 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.454839 6020 raft_consensus.cc:2454] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:09.456398 6271 tablet_bootstrap.cc:654] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.465680 6090 leader_election.cc:302] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.466266 6090 leader_election.cc:302] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.466637 6973 raft_consensus.cc:2726] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.466800 6973 raft_consensus.cc:2781] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:09.466885 6973 raft_consensus.cc:686] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:09.467124 6973 consensus_queue.cc:237] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:09.462441 5818 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.471457 7058 raft_consensus.cc:482] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.475483 7058 raft_consensus.cc:504] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.475818 6990 consensus_queue.cc:1035] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:09.476156 7058 leader_election.cc:288] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.477233 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.478468 5817 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.478819 5817 leader_election.cc:302] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.479075 7058 raft_consensus.cc:2726] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.479516 6273 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.479650 6273 ts_tablet_manager.cc:1397] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.012s
I20260928 10:44:09.480067 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.480432 6273 raft_consensus.cc:348] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.480660 6273 raft_consensus.cc:374] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.480734 6273 raft_consensus.cc:729] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.480953 6273 consensus_queue.cc:260] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.481549 6273 ts_tablet_manager.cc:1428] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.481837 6273 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:09.482232 5818 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.483557 6273 tablet_bootstrap.cc:654] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.483565 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:09.487887 5817 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.488075 5817 leader_election.cc:302] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.488333 7058 raft_consensus.cc:2726] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:09.488500 5817 leader_election.cc:341] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.490964 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 709) took 2287 ms. Trace:
I20260928 10:44:09.491066 6272 rpcz_store.cc:276] 0928 10:44:07.203181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.203237 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:09.195563 (+1992326us) ts_tablet_manager.cc:1145] Deleting tablet 59bfe1f8050f47429ef80a19fdcd8198
0928 10:44:09.195575 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.296732 (+101157us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.396527 (+ 99795us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.490939 (+ 94412us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992070}
I20260928 10:44:09.491463 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 710) took 2270 ms. Trace:
I20260928 10:44:09.491528 6272 rpcz_store.cc:276] 0928 10:44:07.220839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.220902 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:09.491333 (+2270431us) ts_tablet_manager.cc:1145] Deleting tablet bb5eed4318fe482789fee32e24a49bfc
0928 10:44:09.491344 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.491449 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2270183}
I20260928 10:44:09.491802 6273 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.491799 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 711) took 2235 ms. Trace:
I20260928 10:44:09.491855 6272 rpcz_store.cc:276] 0928 10:44:07.256456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.256510 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:09.491708 (+2235198us) ts_tablet_manager.cc:1145] Deleting tablet f63312cb046844dc8eddbb76f614029b
0928 10:44:09.491715 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.491787 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086600}
I20260928 10:44:09.491993 6273 ts_tablet_manager.cc:1397] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260928 10:44:09.492041 6272 tablet_replica.cc:330] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:09.492197 6272 raft_consensus.cc:2229] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:09.492390 6272 pending_rounds.cc:62] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:09.492424 6272 pending_rounds.cc:68] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265850782326784 op_type: NO_OP noop_request { }
I20260928 10:44:09.492539 6272 raft_consensus.cc:2866] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:09.492609 6272 raft_consensus.cc:2258] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.492651 6273 raft_consensus.cc:348] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.492892 6273 raft_consensus.cc:374] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.492955 6273 raft_consensus.cc:729] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.493209 6273 consensus_queue.cc:260] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.493839 6273 ts_tablet_manager.cc:1428] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:09.494089 6273 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.494932 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 59bfe1f8050f47429ef80a19fdcd8198 (table default.Table_d9a96605aae94e7c808991e537e19ff4 [id=bff58e9db4de4c67b9ad1860e38f6237]) successfully deleted
W20260928 10:44:09.495252 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bb5eed4318fe482789fee32e24a49bfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb5eed4318fe482789fee32e24a49bfc already in progress: creating tablet
W20260928 10:44:09.495455 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f63312cb046844dc8eddbb76f614029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f63312cb046844dc8eddbb76f614029b already in progress: creating tablet
I20260928 10:44:09.495671 6273 tablet_bootstrap.cc:654] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.497313 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d616250b7f495fb0fff79ece1a77b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.498955 6273 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.499095 6273 ts_tablet_manager.cc:1397] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260928 10:44:09.500785 6273 raft_consensus.cc:348] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.501029 6273 raft_consensus.cc:374] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.501098 6273 raft_consensus.cc:729] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.501313 6273 consensus_queue.cc:260] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.502072 6273 ts_tablet_manager.cc:1428] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:09.502388 6273 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.504225 6273 tablet_bootstrap.cc:654] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.506930 6270 ts_tablet_manager.cc:1918] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:09.507071 6270 log.cc:1196] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d40123712b17464e87023f69a6235640
I20260928 10:44:09.507364 6270 ts_tablet_manager.cc:1939] T d40123712b17464e87023f69a6235640 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:09.508132 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 631) took 4315 ms. Trace:
I20260928 10:44:09.508235 6270 rpcz_store.cc:276] 0928 10:44:05.192846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.196035 (+ 3189us) service_pool.cc:227] Handling call
0928 10:44:09.083418 (+3887383us) ts_tablet_manager.cc:1145] Deleting tablet d40123712b17464e87023f69a6235640
0928 10:44:09.083427 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.306384 (+222957us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.506804 (+200420us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.508109 (+ 1305us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3887175}
I20260928 10:44:09.508673 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 640) took 4082 ms. Trace:
I20260928 10:44:09.508738 6270 rpcz_store.cc:276] 0928 10:44:05.426565 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.426813 (+ 248us) service_pool.cc:227] Handling call
0928 10:44:09.508512 (+4081699us) ts_tablet_manager.cc:1145] Deleting tablet 7c3bf7a6b83344c886362cc216c9e26e
0928 10:44:09.508523 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.508646 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909142}
I20260928 10:44:09.509002 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 641) took 4082 ms. Trace:
I20260928 10:44:09.509056 6270 rpcz_store.cc:276] 0928 10:44:05.426637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.427010 (+ 373us) service_pool.cc:227] Handling call
0928 10:44:09.508921 (+4081911us) ts_tablet_manager.cc:1145] Deleting tablet 2eded874aa094054b0c2e7c2e592dba1
0928 10:44:09.508929 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.508991 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909485}
I20260928 10:44:09.509290 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 642) took 4082 ms. Trace:
I20260928 10:44:09.509343 6270 rpcz_store.cc:276] 0928 10:44:05.426759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.427149 (+ 390us) service_pool.cc:227] Handling call
0928 10:44:09.509216 (+4082067us) ts_tablet_manager.cc:1145] Deleting tablet 1d0584d6b80e43eb913c3932256cd89e
0928 10:44:09.509223 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.509280 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909737}
I20260928 10:44:09.509575 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 639) took 4083 ms. Trace:
I20260928 10:44:09.509650 6270 rpcz_store.cc:276] 0928 10:44:05.426432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.427326 (+ 894us) service_pool.cc:227] Handling call
0928 10:44:09.509498 (+4082172us) ts_tablet_manager.cc:1145] Deleting tablet 03ebfc156361479c909ff263c3be4601
0928 10:44:09.509506 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.509564 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909775}
I20260928 10:44:09.509912 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 643) took 4059 ms. Trace:
I20260928 10:44:09.509968 6270 rpcz_store.cc:276] 0928 10:44:05.450163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.450217 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:09.509828 (+4059611us) ts_tablet_manager.cc:1145] Deleting tablet 37a685d70ec44acb9f9ffadec2105307
0928 10:44:09.509837 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.509899 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3910031}
I20260928 10:44:09.510200 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 644) took 4027 ms. Trace:
I20260928 10:44:09.510251 6270 rpcz_store.cc:276] 0928 10:44:05.482568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.482626 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:09.510124 (+4027498us) ts_tablet_manager.cc:1145] Deleting tablet 975fffba16ba46a295df724d65cf319a
0928 10:44:09.510132 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.510188 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3910285}
I20260928 10:44:09.511870 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d40123712b17464e87023f69a6235640 (table default.Table_296151ac6be54c6487d713bcebc2d867 [id=beb0af193f5f4677ad125facb05b7cf0]) successfully deleted
W20260928 10:44:09.512212 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7c3bf7a6b83344c886362cc216c9e26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3bf7a6b83344c886362cc216c9e26e already in progress: creating tablet
W20260928 10:44:09.512398 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2eded874aa094054b0c2e7c2e592dba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2eded874aa094054b0c2e7c2e592dba1 already in progress: creating tablet
W20260928 10:44:09.512863 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1d0584d6b80e43eb913c3932256cd89e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0584d6b80e43eb913c3932256cd89e already in progress: creating tablet
I20260928 10:44:09.512908 6273 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.513068 6273 ts_tablet_manager.cc:1397] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
W20260928 10:44:09.513099 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 03ebfc156361479c909ff263c3be4601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ebfc156361479c909ff263c3be4601 already in progress: creating tablet
W20260928 10:44:09.513294 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 37a685d70ec44acb9f9ffadec2105307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37a685d70ec44acb9f9ffadec2105307 already in progress: creating tablet
W20260928 10:44:09.513443 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 975fffba16ba46a295df724d65cf319a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 975fffba16ba46a295df724d65cf319a already in progress: creating tablet
I20260928 10:44:09.513844 6273 raft_consensus.cc:348] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.514086 6273 raft_consensus.cc:374] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.514169 6273 raft_consensus.cc:729] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.514384 6273 consensus_queue.cc:260] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.515080 6273 ts_tablet_manager.cc:1428] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.515364 6273 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.517210 6273 tablet_bootstrap.cc:654] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.517959 7058 raft_consensus.cc:482] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.518100 7058 raft_consensus.cc:504] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.518736 7058 leader_election.cc:288] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.518783 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.494464 6272 ts_tablet_manager.cc:1905] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:09.527697 6273 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:09.527850 6273 ts_tablet_manager.cc:1397] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260928 10:44:09.528425 6273 raft_consensus.cc:348] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.528620 6273 raft_consensus.cc:374] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.528674 6273 raft_consensus.cc:729] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.528877 6273 consensus_queue.cc:260] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.529459 6273 ts_tablet_manager.cc:1428] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:09.530133 6273 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:09.532749 6273 tablet_bootstrap.cc:654] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:09.542447 6135 consensus_meta.cc:287] T c683d17d41e243e798cf9837fa88a4c9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent flushing consensus metadata: real 1.545s user 0.022s sys 0.003s
I20260928 10:44:09.551430 6135 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45886 (request call id 747) took 1792 ms. Trace:
I20260928 10:44:09.551756 6135 rpcz_store.cc:276] 0928 10:44:07.759018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.926283 (+167265us) service_pool.cc:227] Handling call
0928 10:44:07.926985 (+ 702us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:07.927008 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:07.991269 (+ 64261us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.551217 (+1559948us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.551402 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.552718 6275 tablet_bootstrap.cc:492] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.552870 6275 ts_tablet_manager.cc:1397] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.282s user 0.093s sys 0.097s
I20260928 10:44:09.553620 6275 raft_consensus.cc:348] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.553860 6275 raft_consensus.cc:374] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.553922 6275 raft_consensus.cc:729] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.554149 6275 consensus_queue.cc:260] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.554729 6275 ts_tablet_manager.cc:1428] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.555016 6275 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.556680 6275 tablet_bootstrap.cc:654] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.558043 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:09.563582 5817 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.510447 6270 tablet_replica.cc:330] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:09.519692 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.531057 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a658dce02ff740f086774aa44aef9fb8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:09.580626 5818 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.580964 5818 leader_election.cc:302] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.581956 6270 raft_consensus.cc:2229] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.582183 6270 raft_consensus.cc:2258] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.582793 6270 ts_tablet_manager.cc:1905] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:09.583637 7058 raft_consensus.cc:2726] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.532424 6990 raft_consensus.cc:482] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.583907 6990 raft_consensus.cc:504] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.584537 6990 leader_election.cc:288] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.538791 5987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 778) took 1075 ms. Trace:
I20260928 10:44:09.585333 5987 rpcz_store.cc:276] 0928 10:44:08.462969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.463043 (+ 74us) service_pool.cc:227] Handling call
0928 10:44:08.463610 (+ 567us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.463641 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.061173 (+597532us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.538577 (+477404us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.538767 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:09.544539 6002 consensus_meta.cc:287] T 6677b6eb494543fe9314d1aba1372e0c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent flushing consensus metadata: real 0.504s user 0.002s sys 0.000s
I20260928 10:44:09.547252 5991 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 785) took 1074 ms. Trace:
W20260928 10:44:09.559654 5999 consensus_meta.cc:287] T 1af4642f16b94e09833ddc4131118e2b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent flushing consensus metadata: real 0.524s user 0.000s sys 0.003s
I20260928 10:44:09.562311 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:09.587419 6018 raft_consensus.cc:3037] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.586436 5991 rpcz_store.cc:276] 0928 10:44:08.472656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.472768 (+ 112us) service_pool.cc:227] Handling call
0928 10:44:08.473214 (+ 446us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.473232 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.248640 (+775408us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.547019 (+298379us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.547225 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:09.575397 5955 consensus_peers.cc:487] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:09.589778 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b21a965426145c9b678ae80869be833" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.541584 5992 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 793) took 1059 ms. Trace:
W20260928 10:44:09.585772 5957 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8b21a965426145c9b678ae80869be833
I20260928 10:44:09.590346 5992 rpcz_store.cc:276] 0928 10:44:08.482268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.482317 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:08.482730 (+ 413us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.482881 (+ 151us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.260367 (+777486us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.541354 (+280987us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.541540 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:09.591672 5955 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.591857 5955 leader_election.cc:302] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.592248 6990 raft_consensus.cc:2726] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.599581 6976 raft_consensus.cc:482] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.599792 6976 raft_consensus.cc:504] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.600430 6976 leader_election.cc:288] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.602763 6091 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:09.603309 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d38c0ed54b45a89f8e1daefd5b67a1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.603560 6020 raft_consensus.cc:2454] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.604125 6090 leader_election.cc:302] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.604640 6976 raft_consensus.cc:2781] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.604732 6976 raft_consensus.cc:482] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.604786 6976 raft_consensus.cc:3037] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.609405 6269 ts_tablet_manager.cc:1918] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:09.609802 6269 log.cc:1196] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:09.610267 6269 ts_tablet_manager.cc:1939] T 4a973a1d20e3437c87ad889c723e7ebc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:09.612042 6988 raft_consensus.cc:482] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.612211 6988 raft_consensus.cc:504] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.613126 6988 leader_election.cc:288] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.614532 6091 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1631d396362a4cffa1dec06d00894c63
I20260928 10:44:09.615228 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1631d396362a4cffa1dec06d00894c63" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.615494 6020 raft_consensus.cc:2454] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.615989 7058 raft_consensus.cc:482] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.616271 6090 leader_election.cc:302] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.616215 7058 raft_consensus.cc:504] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.616878 6988 raft_consensus.cc:2781] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.616966 6988 raft_consensus.cc:482] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.616981 7058 leader_election.cc:288] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.617020 6988 raft_consensus.cc:3037] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.617892 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.618645 5818 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.619163 6019 raft_consensus.cc:2454] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:09.629418 5986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 803) took 1144 ms. Trace:
I20260928 10:44:09.629709 5986 rpcz_store.cc:276] 0928 10:44:08.485069 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.846238 (+361169us) service_pool.cc:227] Handling call
0928 10:44:08.854138 (+ 7900us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.854173 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.258927 (+404754us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.629199 (+370272us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.629388 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.630497 5984 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 790) took 1150 ms. Trace:
I20260928 10:44:09.630743 5984 rpcz_store.cc:276] 0928 10:44:08.480207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.480259 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:08.480651 (+ 392us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.480672 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.253024 (+772352us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.630312 (+377288us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.630457 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.634754 7058 raft_consensus.cc:482] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.634985 7058 raft_consensus.cc:504] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.635768 7058 leader_election.cc:288] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.637255 5998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 784) took 1164 ms. Trace:
I20260928 10:44:09.637364 5998 rpcz_store.cc:276] 0928 10:44:08.472541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.474343 (+ 1802us) service_pool.cc:227] Handling call
0928 10:44:08.474646 (+ 303us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.474661 (+ 15us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.285610 (+810949us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.637017 (+351407us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.637229 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.639639 6090 leader_election.cc:302] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.640349 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.641156 5818 leader_election.cc:341] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.641848 5993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 791) took 1159 ms. Trace:
I20260928 10:44:09.642035 5993 rpcz_store.cc:276] 0928 10:44:08.482072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.492933 (+ 10861us) service_pool.cc:227] Handling call
0928 10:44:08.493322 (+ 389us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.493342 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.207828 (+714486us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.641623 (+433795us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.641829 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.643600 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.644263 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.634399 6000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 786) took 1160 ms. Trace:
I20260928 10:44:09.644791 6000 rpcz_store.cc:276] 0928 10:44:08.472784 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.473306 (+ 522us) service_pool.cc:227] Handling call
0928 10:44:08.473682 (+ 376us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.473701 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.268824 (+795123us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.633443 (+364619us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.633614 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.646001 5983 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 802) took 1161 ms. Trace:
I20260928 10:44:09.646225 5983 rpcz_store.cc:276] 0928 10:44:08.484774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.489481 (+ 4707us) service_pool.cc:227] Handling call
0928 10:44:08.489849 (+ 368us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:08.489867 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.267120 (+777253us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.645800 (+378680us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.645982 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:09.648021 7074 raft_consensus.cc:2781] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:09.648669 5994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 789) took 1175 ms. Trace:
I20260928 10:44:09.648842 5994 rpcz_store.cc:276] 0928 10:44:08.473128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.474690 (+ 1562us) service_pool.cc:227] Handling call
0928 10:44:09.530857 (+1056167us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:09.530885 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.583261 (+ 52376us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.648481 (+ 65220us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:09.648648 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:09.650527 5817 leader_election.cc:341] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.650833 5817 leader_election.cc:302] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.651294 7058 raft_consensus.cc:2726] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:09.651587 5817 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.651794 5817 leader_election.cc:302] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.652100 7058 raft_consensus.cc:2726] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.664791 6990 raft_consensus.cc:482] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.664961 6990 raft_consensus.cc:504] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.665619 6990 leader_election.cc:288] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:09.667073 5957 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:09.668224 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bd99e7bdb647ceb9357f88affc45d9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:09.668931 5955 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.669096 5955 leader_election.cc:302] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.669414 6990 raft_consensus.cc:2726] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.672446 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet 51df1f1107e14996bb1b4787819de64f from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:09.675953 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fd6798c7a514425c9c9f3e15748748e2" } new_table_name: "default.Table_f63c073e55804622a62b0e1468ed6ba3" modify_external_catalogs: true
I20260928 10:44:09.679078 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:09.680371 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_818fbd013f2146f58d27d364c7e9e410" } new_table_name: "default.Table_41dd2a3c11bc45cfa4df997465553ffe" modify_external_catalogs: true
I20260928 10:44:09.683506 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_31d744c3757844c388bd3f29ac469dc7" } new_table_name: "default.Table_0e3de1a8ed3d4a7abb7e614b4b4dc00a" modify_external_catalogs: true
I20260928 10:44:09.685400 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_29a5cb184a6844e8823710b31cfec866" } new_table_name: "default.Table_d650a78055d649f1b107e9bd8789967c" modify_external_catalogs: true
I20260928 10:44:09.688441 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.689579 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e9583b5637a428db383320d98a7a280 with delete_type TABLET_DATA_DELETED (replaced by tablet 39cbecd1c19541f28bd32b7c46f2df61) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.691164 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_18daf257df304b87a04bbf5f584865fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.691705 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18daf257df304b87a04bbf5f584865fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:09.694757 6091 consensus_peers.cc:487] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbd5d1ccd2e54f3884af3af327bb892e. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:09.696419 6271 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.698026 6973 raft_consensus.cc:482] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.698303 6973 raft_consensus.cc:504] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.700136 6973 leader_election.cc:288] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.699618 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9583b5637a428db383320d98a7a280" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.700609 6271 ts_tablet_manager.cc:1397] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.246s user 0.025s sys 0.049s
I20260928 10:44:09.700603 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 684) took 3317 ms. Trace:
I20260928 10:44:09.700752 6269 rpcz_store.cc:276] 0928 10:44:06.383165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.383431 (+ 266us) service_pool.cc:227] Handling call
0928 10:44:09.354944 (+2971513us) ts_tablet_manager.cc:1145] Deleting tablet 4a973a1d20e3437c87ad889c723e7ebc
0928 10:44:09.354958 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.605416 (+250458us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.609227 (+ 3811us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.700544 (+ 91317us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2971382}
I20260928 10:44:09.701149 6269 tablet_replica.cc:330] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:09.701388 6269 raft_consensus.cc:2229] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:09.701552 6269 raft_consensus.cc:2258] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:09.700764 6019 raft_consensus.cc:2454] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:09.700497 6091 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0e9583b5637a428db383320d98a7a280
I20260928 10:44:09.702033 6090 leader_election.cc:302] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.702168 6269 ts_tablet_manager.cc:1905] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:09.702466 6973 raft_consensus.cc:2781] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.702564 6973 raft_consensus.cc:482] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.702622 6973 raft_consensus.cc:3037] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.703722 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4a973a1d20e3437c87ad889c723e7ebc (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
I20260928 10:44:09.706964 6271 raft_consensus.cc:348] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.708949 6271 raft_consensus.cc:374] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.709511 6271 raft_consensus.cc:729] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.710100 6271 consensus_queue.cc:260] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.712076 6271 ts_tablet_manager.cc:1428] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 10:44:09.711971 6976 raft_consensus.cc:504] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.712642 6976 leader_election.cc:288] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.714015 6271 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:09.719005 6091 leader_election.cc:341] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:09.720160 6018 raft_consensus.cc:2454] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:09.720870 5818 leader_election.cc:302] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.722653 7058 raft_consensus.cc:2781] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:09.722834 7058 raft_consensus.cc:686] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:09.723121 7058 consensus_queue.cc:237] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.725792 7029 raft_consensus.cc:482] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.725979 7029 raft_consensus.cc:504] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.726620 7029 leader_election.cc:288] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.727865 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d4da5ccb214a4bbc543c67529b59cf" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.730880 6272 ts_tablet_manager.cc:1918] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 10:44:09.729472 5955 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.736840 6866 raft_consensus.cc:482] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.737044 6866 raft_consensus.cc:504] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.736255 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d38c0ed54b45a89f8e1daefd5b67a1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:09.737751 6866 leader_election.cc:288] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.737344 6019 raft_consensus.cc:3037] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:09.736598 5957 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:09.740149 5957 leader_election.cc:302] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.740708 6271 tablet_bootstrap.cc:654] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.741654 6990 raft_consensus.cc:2726] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.741894 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.743446 5818 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.738696 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:09.744704 5817 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.744908 5817 leader_election.cc:302] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.745225 6866 raft_consensus.cc:2726] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.745373 6272 log.cc:1196] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:09.745956 6272 ts_tablet_manager.cc:1939] T cd13e6a9d8f04fa3abb8d22a80932dae P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:09.754799 7058 raft_consensus.cc:482] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.755003 7058 raft_consensus.cc:504] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.755697 7058 leader_election.cc:288] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.756448 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.757155 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.757714 5817 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:09.757941 5818 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.758044 5818 leader_election.cc:302] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.758325 7058 raft_consensus.cc:2726] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.760476 6271 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.762740 6271 ts_tablet_manager.cc:1397] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.005s
I20260928 10:44:09.764889 6271 raft_consensus.cc:348] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.768875 7074 raft_consensus.cc:686] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:09.769951 7074 consensus_queue.cc:237] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.770349 6271 raft_consensus.cc:374] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.770851 6271 raft_consensus.cc:729] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.770985 6275 tablet_bootstrap.cc:492] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:09.771167 6275 ts_tablet_manager.cc:1397] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.216s user 0.020s sys 0.035s
I20260928 10:44:09.771472 6271 consensus_queue.cc:260] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.772851 6275 raft_consensus.cc:348] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.773504 6271 ts_tablet_manager.cc:1428] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:44:09.773903 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:09.774251 6275 raft_consensus.cc:374] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.774314 6275 raft_consensus.cc:729] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.774601 6271 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.774922 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_54215b2fe6184beaba657eca6c992e0a" } new_table_name: "default.Table_5fad44d7253f493788268121109a5671" modify_external_catalogs: true
W20260928 10:44:09.775796 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cea632558fd546a0a7ef17c050973ebc consensus state has no leader
I20260928 10:44:09.776144 6271 tablet_bootstrap.cc:654] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.776222 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5cd9c9a158b7458d83040f7fd15a911c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:09.776322 6275 consensus_queue.cc:260] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:09.776746 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cd9c9a158b7458d83040f7fd15a911c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.777753 6275 ts_tablet_manager.cc:1428] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:44:09.778013 6275 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:09.778040 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 07b918180f7b4ba7bce326012360a10d (DEFAULT_TABLE table=default.Table_6fa33e7241934357b5a59b4798e3fb42 [id=26a89b23317d49b2a35867ce7b427a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.778568 5858 tablet_service.cc:1467] Processing CreateTablet for tablet d17fe373ea094f13bc9ceb9657fe7e6f (DEFAULT_TABLE table=default.Table_b98b5ecf9b894df6a4c878513b6de0b8 [id=8aecbcd363174d929007c98a1fddee3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.779043 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 8938b775da094b538963551378a018b7 (DEFAULT_TABLE table=default.Table_95f97f40b06e4132af16f9590aeefbb4 [id=b10e4626404843b39fd311d6837e4e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.779592 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.779955 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 376c867aca86457f9289bd188449590c (DEFAULT_TABLE table=default.Table_1b43e1f04c8b46e2b19dbac633f696c4 [id=dac29af1b8d145788b393d8c33053d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.780040 6275 tablet_bootstrap.cc:654] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.780369 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:09.780643 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:09.780799 7058 raft_consensus.cc:482] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.780932 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:09.780923 7058 raft_consensus.cc:504] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.781090 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:09.781504 7058 leader_election.cc:288] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.782058 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 07b918180f7b4ba7bce326012360a10d (DEFAULT_TABLE table=default.Table_6fa33e7241934357b5a59b4798e3fb42 [id=26a89b23317d49b2a35867ce7b427a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.782418 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b918180f7b4ba7bce326012360a10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.783399 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f8ca99f63fd244578040776ca622e0c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.783929 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8ca99f63fd244578040776ca622e0c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.785768 6136 tablet_service.cc:1467] Processing CreateTablet for tablet d17fe373ea094f13bc9ceb9657fe7e6f (DEFAULT_TABLE table=default.Table_b98b5ecf9b894df6a4c878513b6de0b8 [id=8aecbcd363174d929007c98a1fddee3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.786134 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 8938b775da094b538963551378a018b7 (DEFAULT_TABLE table=default.Table_95f97f40b06e4132af16f9590aeefbb4 [id=b10e4626404843b39fd311d6837e4e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.787071 6271 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.787926 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17fe373ea094f13bc9ceb9657fe7e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.787918 6271 ts_tablet_manager.cc:1397] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260928 10:44:09.788611 6271 raft_consensus.cc:348] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.788800 6271 raft_consensus.cc:374] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.788842 6271 raft_consensus.cc:729] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.789018 6271 consensus_queue.cc:260] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.789479 6271 ts_tablet_manager.cc:1428] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 10:44:09.789732 6271 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.791025 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8938b775da094b538963551378a018b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.791435 6271 tablet_bootstrap.cc:654] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:09.797516 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bbfcdf8895ce49809a8911c819a057e7 consensus state has no leader
I20260928 10:44:09.798878 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_73d7639b37c4419f9c00c915503a0668"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.799563 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d7639b37c4419f9c00c915503a0668 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:09.800961 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc50ec106e9b4137b64bf6ce71487979 consensus state has no leader
W20260928 10:44:09.802842 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b67cd4597914a1483fe2bad4de4a8b8 consensus state has no leader
I20260928 10:44:09.803773 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9e760012a7a44dc983c1531038042cac" } modify_external_catalogs: true
I20260928 10:44:09.803884 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a74bbb6670bc44b2880e7e7e36ba415c" } modify_external_catalogs: true
I20260928 10:44:09.804652 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9e760012a7a44dc983c1531038042cac" } modify_external_catalogs: true
I20260928 10:44:09.804742 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a74bbb6670bc44b2880e7e7e36ba415c" } modify_external_catalogs: true
I20260928 10:44:09.805388 6271 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.805552 6271 ts_tablet_manager.cc:1397] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260928 10:44:09.806389 6271 raft_consensus.cc:348] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.806646 6271 raft_consensus.cc:374] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.806707 6271 raft_consensus.cc:729] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.806938 6271 consensus_queue.cc:260] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.807533 6271 ts_tablet_manager.cc:1428] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:09.807857 6271 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.809547 6271 tablet_bootstrap.cc:654] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.812525 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376c867aca86457f9289bd188449590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.813467 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17fe373ea094f13bc9ceb9657fe7e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.814069 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8938b775da094b538963551378a018b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.814985 7074 raft_consensus.cc:482] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.815119 7074 raft_consensus.cc:504] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.815755 7074 leader_election.cc:288] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.816493 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:09.818650 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b918180f7b4ba7bce326012360a10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.823101 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f078ae6d2b498d8c5af90afba887ad" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.823786 7029 raft_consensus.cc:482] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.823935 7029 raft_consensus.cc:504] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.824504 7029 leader_election.cc:288] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.824666 6988 raft_consensus.cc:504] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.825318 6988 leader_election.cc:288] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.826604 6090 leader_election.cc:302] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:09.827670 5957 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bd225da0b4b445c6ac03634d975e8396
I20260928 10:44:09.827976 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1631d396362a4cffa1dec06d00894c63" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:09.828198 6020 raft_consensus.cc:3037] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.832952 6988 raft_consensus.cc:2726] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:09.835052 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 376c867aca86457f9289bd188449590c (DEFAULT_TABLE table=default.Table_1b43e1f04c8b46e2b19dbac633f696c4 [id=dac29af1b8d145788b393d8c33053d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.835503 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376c867aca86457f9289bd188449590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:09.836830 6271 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:09.836994 6271 ts_tablet_manager.cc:1397] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260928 10:44:09.837857 6271 raft_consensus.cc:348] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.838109 6271 raft_consensus.cc:374] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:09.838196 6271 raft_consensus.cc:729] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:09.838419 6271 consensus_queue.cc:260] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.839119 6271 ts_tablet_manager.cc:1428] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260928 10:44:09.839176 6090 consensus_peers.cc:487] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:09.839506 6271 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:09.841488 6271 tablet_bootstrap.cc:654] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:09.846944 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 07b918180f7b4ba7bce326012360a10d (DEFAULT_TABLE table=default.Table_6fa33e7241934357b5a59b4798e3fb42 [id=26a89b23317d49b2a35867ce7b427a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.847546 5985 tablet_service.cc:1467] Processing CreateTablet for tablet d17fe373ea094f13bc9ceb9657fe7e6f (DEFAULT_TABLE table=default.Table_b98b5ecf9b894df6a4c878513b6de0b8 [id=8aecbcd363174d929007c98a1fddee3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.847944 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.848146 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b3afe074194023ba788094a2a6b81c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.848315 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.848924 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 8938b775da094b538963551378a018b7 (DEFAULT_TABLE table=default.Table_95f97f40b06e4132af16f9590aeefbb4 [id=b10e4626404843b39fd311d6837e4e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.849641 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 376c867aca86457f9289bd188449590c (DEFAULT_TABLE table=default.Table_1b43e1f04c8b46e2b19dbac633f696c4 [id=dac29af1b8d145788b393d8c33053d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:09.852435 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c1af1980a6344ca7b54ded68d92e688f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.853147 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1af1980a6344ca7b54ded68d92e688f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:09.856325 6091 leader_election.cc:341] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1631d396362a4cffa1dec06d00894c63
I20260928 10:44:09.872289 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2a359f1585924866be13588125db2dc4
I20260928 10:44:09.872865 5701 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 959) took 1179 ms. Trace:
W20260928 10:44:09.873679 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a47129ab5444dcab0a3f92a16046db consensus state has no leader
I20260928 10:44:09.876092 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_32e4b27c2c494235acd8e4bd96b9270b" } modify_external_catalogs: true
I20260928 10:44:09.876302 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_32e4b27c2c494235acd8e4bd96b9270b" } modify_external_catalogs: true
I20260928 10:44:09.879063 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 51df1f1107e14996bb1b4787819de64f
I20260928 10:44:09.879457 5697 catalog_manager.cc:6565] ReplaceTablet: tablet 51df1f1107e14996bb1b4787819de64f deleted and replaced by tablet 1415cbe9fa15468a91932cdec4612cf9
I20260928 10:44:09.879825 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d9811c82d1fa4eff8a1065a89a8c5c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.880463 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9811c82d1fa4eff8a1065a89a8c5c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.882076 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 01bd3593f7ac421cbed8ac5797e068fa
I20260928 10:44:09.882411 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 01bd3593f7ac421cbed8ac5797e068fa deleted and replaced by tablet 4f45a52f81e64b13ac52ae74d26d7ea7
I20260928 10:44:09.882911 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d725bb48e71f48e2beb23ef4d0b0c7b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.883448 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d725bb48e71f48e2beb23ef4d0b0c7b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.873003 5701 rpcz_store.cc:276] 0928 10:44:08.693449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.131164 (+437715us) service_pool.cc:227] Handling call
0928 10:44:09.146267 (+ 15103us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05ff2e6 00007fa6d78f2126 00007fa6d78f1e55 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:09.146693 (+ 426us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:09.146832 (+ 139us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:09.146895 (+ 63us) catalog_manager.cc:2761] Locking tablets
0928 10:44:09.772780 (+625885us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:09.872071 (+ 99291us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:09.872175 (+ 104us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:09.872222 (+ 47us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:09.872788 (+ 566us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:09.777775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:09.777864 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:09.777869 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:09.777871 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:09.777979 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:09.777991 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:09.777995 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:09.778099 (+ 104us) tablet.cc:699] Row locks acquired
0928 10:44:09.778101 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:09.778136 (+ 35us) write_op.cc:270] Start()
0928 10:44:09.778167 (+ 31us) write_op.cc:276] Timestamp: P: 1790592249778100 usec, L: 0
0928 10:44:09.778171 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:09.778343 (+ 172us) log.cc:842] Serialized 728 byte log entry
0928 10:44:09.871259 (+ 92916us) op_driver.cc:444] REPLICATION: finished
0928 10:44:09.871513 (+ 254us) write_op.cc:301] APPLY: starting
0928 10:44:09.871533 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:09.871584 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:09.871626 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:09.871704 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:09.871755 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:09.871761 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:09.871858 (+ 97us) log.cc:842] Serialized 29 byte log entry
0928 10:44:09.871927 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:09.871951 (+ 24us) write_op.cc:454] Released schema lock
0928 10:44:09.871959 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:09.872028 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:09.872031 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":34132224,"child_traces":[["op",{"apply.queue_time_us":205,"apply.run_cpu_time_us":572,"apply.run_wall_time_us":571,"num_ops":2,"prepare.queue_time_us":4122,"prepare.run_cpu_time_us":649,"prepare.run_wall_time_us":650,"replication_time_us":93036}]]}
I20260928 10:44:09.885879 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b793fca06095448a80f39e6924ba7963" } modify_external_catalogs: true
I20260928 10:44:09.886056 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b793fca06095448a80f39e6924ba7963" } modify_external_catalogs: true
I20260928 10:44:09.887674 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a359f1585924866be13588125db2dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.887930 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 97401498df144cc689066ea3033d68ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:56 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.888098 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 51df1f1107e14996bb1b4787819de64f with delete_type TABLET_DATA_DELETED (replaced by tablet 1415cbe9fa15468a91932cdec4612cf9) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.888240 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa with delete_type TABLET_DATA_DELETED (replaced by tablet 4f45a52f81e64b13ac52ae74d26d7ea7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.888464 6988 raft_consensus.cc:482] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.888569 6988 raft_consensus.cc:504] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.889160 6988 leader_election.cc:288] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.890290 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97401498df144cc689066ea3033d68ef" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.890550 6021 raft_consensus.cc:2454] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.891079 6090 leader_election.cc:302] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:09.892664 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a359f1585924866be13588125db2dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.892666 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa with delete_type TABLET_DATA_DELETED (replaced by tablet 4f45a52f81e64b13ac52ae74d26d7ea7) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.893090 7074 raft_consensus.cc:2781] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.893175 7074 raft_consensus.cc:482] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.893244 7074 raft_consensus.cc:3037] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.894623 7058 raft_consensus.cc:482] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.894809 7058 raft_consensus.cc:504] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:09.895454 7058 leader_election.cc:288] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:09.895802 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 51df1f1107e14996bb1b4787819de64f with delete_type TABLET_DATA_DELETED (replaced by tablet 1415cbe9fa15468a91932cdec4612cf9) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.898028 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.899112 5818 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.904872 6988 consensus_queue.cc:1035] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:09.907538 6091 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 97401498df144cc689066ea3033d68ef
I20260928 10:44:09.910578 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bd3593f7ac421cbed8ac5797e068fa with delete_type TABLET_DATA_DELETED (replaced by tablet 4f45a52f81e64b13ac52ae74d26d7ea7) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.910897 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 51df1f1107e14996bb1b4787819de64f with delete_type TABLET_DATA_DELETED (replaced by tablet 1415cbe9fa15468a91932cdec4612cf9) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.911285 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a359f1585924866be13588125db2dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.927176 6019 raft_consensus.cc:2454] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:09.930199 6988 raft_consensus.cc:482] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.930370 6988 raft_consensus.cc:504] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.931341 6988 leader_election.cc:288] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:09.932647 6090 leader_election.cc:302] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.933192 6990 raft_consensus.cc:482] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.933372 6990 raft_consensus.cc:504] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.934221 6990 leader_election.cc:288] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.934825 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:09.935067 5884 raft_consensus.cc:2454] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:09.935684 6091 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d257233e5b934d619e2289a6df55d65a
I20260928 10:44:09.936018 5957 leader_election.cc:302] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:09.936645 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d257233e5b934d619e2289a6df55d65a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:09.936894 6019 raft_consensus.cc:2454] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:09.937383 6090 leader_election.cc:302] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:09.937644 6976 raft_consensus.cc:2781] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:09.937739 6976 raft_consensus.cc:686] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:09.937961 6976 consensus_queue.cc:237] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:09.943382 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.944377 5818 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.944859 6988 raft_consensus.cc:2781] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.944952 6988 raft_consensus.cc:482] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.945006 6988 raft_consensus.cc:3037] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.945493 6990 raft_consensus.cc:2781] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:09.945633 6990 raft_consensus.cc:482] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:09.945712 6990 raft_consensus.cc:3037] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:09.950562 7029 raft_consensus.cc:482] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.950804 7029 raft_consensus.cc:504] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.951457 7029 leader_election.cc:288] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:09.953315 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.953940 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb1d807c9f04fe4b02e3343f0c6511c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.954525 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd225da0b4b445c6ac03634d975e8396" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:09.955183 5957 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:44:09.961808 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:09.962677 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0c245579875c41028091fc6ace944ffc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:09.962754 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.963389 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c245579875c41028091fc6ace944ffc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.965760 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670
I20260928 10:44:09.966519 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ca398b35ea764963925612fa671ebaef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:09.967142 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca398b35ea764963925612fa671ebaef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.968752 7058 raft_consensus.cc:482] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.968801 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3e15b3cc46734ed5b8f0aef2f50025dd
I20260928 10:44:09.968925 7058 raft_consensus.cc:504] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.969537 7058 leader_election.cc:288] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.963384 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:09.970829 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.972026 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:09.972080 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:09.975857 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.976502 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e15b3cc46734ed5b8f0aef2f50025dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:09.979058 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.979714 5818 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.981174 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.981957 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.982807 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.990340 6866 raft_consensus.cc:482] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:09.990546 6866 raft_consensus.cc:504] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:09.991143 6866 leader_election.cc:288] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:09.991972 5817 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.992139 5817 leader_election.cc:302] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:09.992384 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:09.993407 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:09.997623 5955 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:09.998364 5955 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:09.999573 5955 leader_election.cc:302] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.000121 6866 raft_consensus.cc:482] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.000278 6866 raft_consensus.cc:504] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.000872 6866 leader_election.cc:288] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.001003 6866 raft_consensus.cc:2726] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.001581 5817 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.001799 5817 leader_election.cc:302] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.002070 7058 raft_consensus.cc:2726] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.002281 5817 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.002525 5817 leader_election.cc:302] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.002771 7058 raft_consensus.cc:2726] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:09.994023 5818 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.004390 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.017068 7029 raft_consensus.cc:2726] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.017719 5955 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.018044 5955 leader_election.cc:302] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.018349 7029 raft_consensus.cc:2726] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.019824 6155 raft_consensus.cc:3037] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.003679 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.020870 5818 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:10.021742 5817 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.021893 5817 leader_election.cc:302] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.023808 7058 raft_consensus.cc:2726] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.033849 6091 consensus_peers.cc:487] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48ccd7551f6a4fc8b41e70e94749e6f1. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.036944 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.037846 7058 raft_consensus.cc:482] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:10.037882 5817 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.038017 7058 raft_consensus.cc:504] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.038146 5817 leader_election.cc:302] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.038458 6866 raft_consensus.cc:2726] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.038630 7058 leader_election.cc:288] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.039705 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.040757 5817 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.041191 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.041868 5818 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.042032 5818 leader_election.cc:302] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.042346 7058 raft_consensus.cc:2726] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.048189 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9956318fe8ef4d1cbc92eda9caa98602
I20260928 10:44:10.049767 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.051481 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.053915 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d5a63d9baed7423480f46bd6010a919e" } new_table_name: "default.Table_e5da24d045c54481a7ca17b05bd81ca4" modify_external_catalogs: true
I20260928 10:44:10.055668 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed31eead32684a629bc6dc930678fa40" } new_table_name: "default.Table_2357f1366fe443be8c84b81b162dc35a" modify_external_catalogs: true
I20260928 10:44:10.057250 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bd532df1bba0449693d242f921a74c00" } new_table_name: "default.Table_7c2b9260216f400fb44101905b2c3c36" modify_external_catalogs: true
I20260928 10:44:10.058848 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_846ca9a639fe42a886d986ddffd8f1a1" } new_table_name: "default.Table_186b2d54b8844c4abf376552ec9f2e5d" modify_external_catalogs: true
I20260928 10:44:10.060536 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f333b9300b284c31b2f59f434eeb2f48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.061199 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f333b9300b284c31b2f59f434eeb2f48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.064476 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.075829 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b918180f7b4ba7bce326012360a10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.082332 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d17fe373ea094f13bc9ceb9657fe7e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.083268 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8938b775da094b538963551378a018b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.083683 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376c867aca86457f9289bd188449590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.095039 6020 raft_consensus.cc:2454] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:10.103371 6269 ts_tablet_manager.cc:1918] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:10.103534 6269 log.cc:1196] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9e05cdd590894adcb987ef3ac78bf416
I20260928 10:44:10.103885 6269 ts_tablet_manager.cc:1939] T 9e05cdd590894adcb987ef3ac78bf416 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:10.109517 6090 leader_election.cc:302] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.122931 6973 raft_consensus.cc:504] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:10.123185 5803 kernel_stack_watchdog.cc:198] Thread 6273 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 430ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f1e4cef4980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f1e49c0ebfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f1e49c2efd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f1e49c2abeb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f1e49c2fcef kudu::ThreadPool::Submit() at ??:0
@ 0x7f1e54ad006d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f1e54acf0bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f1e54aceca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f1e54ad6a02 kudu::log::Log::Init() at ??:0
@ 0x7f1e54ad5dbf kudu::log::Log::Open() at ??:0
@ 0x7f1e563672ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f1e563637dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f1e56361fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 10:44:10.137323 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 685) took 3647 ms. Trace:
I20260928 10:44:10.137524 6269 rpcz_store.cc:276] 0928 10:44:06.489509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.489699 (+ 190us) service_pool.cc:227] Handling call
0928 10:44:09.701073 (+3211374us) ts_tablet_manager.cc:1145] Deleting tablet 9e05cdd590894adcb987ef3ac78bf416
0928 10:44:09.701085 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.812439 (+111354us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.103162 (+290723us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.137289 (+ 34127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3211144}
I20260928 10:44:10.138144 6269 tablet_replica.cc:330] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:10.138538 6269 raft_consensus.cc:2229] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:10.138801 6269 raft_consensus.cc:2258] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:10.139464 6269 ts_tablet_manager.cc:1905] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:10.140002 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9e05cdd590894adcb987ef3ac78bf416 (table default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]) successfully deleted
I20260928 10:44:10.141494 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 712) took 2741 ms. Trace:
I20260928 10:44:10.141773 6272 rpcz_store.cc:276] 0928 10:44:07.399841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.399999 (+ 158us) service_pool.cc:227] Handling call
0928 10:44:09.492009 (+2092010us) ts_tablet_manager.cc:1145] Deleting tablet cd13e6a9d8f04fa3abb8d22a80932dae
0928 10:44:09.492016 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.652959 (+160943us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:09.730749 (+ 77790us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.141459 (+410710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2073024}
I20260928 10:44:10.143059 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet cd13e6a9d8f04fa3abb8d22a80932dae (table default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916]) successfully deleted
I20260928 10:44:10.147935 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9583b5637a428db383320d98a7a280" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:10.148244 6020 raft_consensus.cc:3037] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.142442 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 713) took 2741 ms. Trace:
I20260928 10:44:10.153306 6272 rpcz_store.cc:276] 0928 10:44:07.401163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.401526 (+ 363us) service_pool.cc:227] Handling call
0928 10:44:10.142238 (+2740712us) ts_tablet_manager.cc:1145] Deleting tablet 9aeb55c2547e417090fd36664cbe69f6
0928 10:44:10.142257 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.142416 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722938}
W20260928 10:44:10.155104 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9aeb55c2547e417090fd36664cbe69f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb55c2547e417090fd36664cbe69f6 already in progress: creating tablet
I20260928 10:44:10.155762 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 714) took 2746 ms. Trace:
I20260928 10:44:10.155956 6272 rpcz_store.cc:276] 0928 10:44:07.409681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.411312 (+ 1631us) service_pool.cc:227] Handling call
0928 10:44:10.155559 (+2744247us) ts_tablet_manager.cc:1145] Deleting tablet 75539c390965493eaa69a0d1215fa922
0928 10:44:10.155575 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.155733 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735460}
W20260928 10:44:10.156539 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 75539c390965493eaa69a0d1215fa922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75539c390965493eaa69a0d1215fa922 already in progress: creating tablet
I20260928 10:44:10.157027 6272 tablet_replica.cc:330] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:10.157393 6272 raft_consensus.cc:2229] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:10.157673 6272 raft_consensus.cc:2258] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:10.147266 6973 leader_election.cc:288] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.158037 6973 raft_consensus.cc:2781] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 10:44:10.152981 6091 leader_election.cc:341] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 0e9583b5637a428db383320d98a7a280
I20260928 10:44:10.158304 6973 raft_consensus.cc:686] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:10.158609 6973 consensus_queue.cc:237] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.163136 7029 raft_consensus.cc:482] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.163335 7029 raft_consensus.cc:504] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.164220 7029 leader_election.cc:288] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.165169 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:10.165561 5882 raft_consensus.cc:2454] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:10.166158 5957 leader_election.cc:302] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:10.166498 7029 raft_consensus.cc:2781] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:10.166589 7029 raft_consensus.cc:482] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:10.166673 7029 raft_consensus.cc:3037] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.168521 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.172026 6153 raft_consensus.cc:3037] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.172703 6270 ts_tablet_manager.cc:1918] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:10.172981 6270 log.cc:1196] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:10.173358 6270 ts_tablet_manager.cc:1939] T dbd5d1ccd2e54f3884af3af327bb892e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:10.176003 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d26c74de94724ee2b24a0473731ab348" } new_table_name: "default.Table_5b4e3c0c3dcd4fb3a0266851331247f2" modify_external_catalogs: true
W20260928 10:44:10.188288 5955 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.188408 7121 raft_consensus.cc:482] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.188786 7121 raft_consensus.cc:504] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.189565 7121 leader_election.cc:288] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:10.191566 5957 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 21b4deb353974c8aae4bb8148869758d
I20260928 10:44:10.194129 6272 ts_tablet_manager.cc:1905] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:10.196378 7122 raft_consensus.cc:482] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.196519 7122 raft_consensus.cc:504] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:10.198244 5957 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:10.198446 7122 leader_election.cc:288] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.204689 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3dcb8c957cf04531b6c32f9e7d079d32" } modify_external_catalogs: true
I20260928 10:44:10.205070 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3dcb8c957cf04531b6c32f9e7d079d32" } modify_external_catalogs: true
I20260928 10:44:10.221733 7074 raft_consensus.cc:504] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.222554 7074 leader_election.cc:288] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:10.223963 6091 leader_election.cc:341] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 97401498df144cc689066ea3033d68ef
I20260928 10:44:10.230717 6020 raft_consensus.cc:2454] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:10.231390 6090 leader_election.cc:302] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.231839 7074 raft_consensus.cc:2781] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.231966 7074 raft_consensus.cc:686] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:10.232183 7074 consensus_queue.cc:237] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.233708 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97401498df144cc689066ea3033d68ef" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:10.233963 6018 raft_consensus.cc:3037] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:10.264026 6091 consensus_peers.cc:487] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87d5dd4e5b544262938b1822510d8b9f. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.269637 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b4deb353974c8aae4bb8148869758d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.270134 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104a223ec6ef47988d0aa3335a1f81de" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.288546 5955 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.288795 5955 leader_election.cc:302] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.289064 7121 raft_consensus.cc:2726] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.289495 5955 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.289671 5955 leader_election.cc:302] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.289927 7121 raft_consensus.cc:2726] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.292076 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_246184c33447431eaeb718fe8ce2708d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.292797 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_246184c33447431eaeb718fe8ce2708d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.297623 7106 raft_consensus.cc:482] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.297963 7106 raft_consensus.cc:504] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.298723 7106 leader_election.cc:288] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:10.299670 6091 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e
I20260928 10:44:10.300450 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "734c3196929d4814b77bce7938bf598e" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:10.300740 6020 raft_consensus.cc:2454] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:10.301321 6090 leader_election.cc:302] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.304632 7106 raft_consensus.cc:2781] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:10.305661 7106 raft_consensus.cc:482] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:10.305750 7106 raft_consensus.cc:3037] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:10.314891 5686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260928 10:44:10.326790 6135 consensus_meta.cc:287] T 07b918180f7b4ba7bce326012360a10d P 4dab87557ec9445dbe35ea05e3561a94: Time spent flushing consensus metadata: real 0.541s user 0.002s sys 0.003s
W20260928 10:44:10.326956 6125 consensus_meta.cc:287] T 8938b775da094b538963551378a018b7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent flushing consensus metadata: real 0.533s user 0.005s sys 0.000s
I20260928 10:44:10.333542 6990 raft_consensus.cc:504] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.334946 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:10.335201 5882 raft_consensus.cc:3037] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.340673 6990 leader_election.cc:288] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:10.346578 6273 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.813s user 0.142s sys 0.240s
W20260928 10:44:10.346704 6273 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.813s user 0.142s sys 0.240s
I20260928 10:44:10.347852 6273 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.348019 6273 ts_tablet_manager.cc:1397] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.818s user 0.144s sys 0.241s
I20260928 10:44:10.348791 6273 raft_consensus.cc:348] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.349043 6273 raft_consensus.cc:374] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.349098 6273 raft_consensus.cc:729] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.349355 6273 consensus_queue.cc:260] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.350050 6273 ts_tablet_manager.cc:1428] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:10.350745 6273 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.352210 6273 tablet_bootstrap.cc:654] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:10.365314 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f2a010ebf004152bda4b2c27e23bc6b consensus state has no leader
W20260928 10:44:10.369349 6271 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.040s sys 0.083s
W20260928 10:44:10.369807 6271 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.528s user 0.040s sys 0.083s
W20260928 10:44:10.370357 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 80109.3us
I20260928 10:44:10.371235 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:10.374229 6078 kernel_stack_watchdog.cc:198] Thread 6275 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 326ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f6f88640980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f6f8535abfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f6f8537afd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f6f85376beb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f6f8537bcef kudu::ThreadPool::Submit() at ??:0
@ 0x7f6f9021c06d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f6f9021b0bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f6f9021aca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f6f90222a02 kudu::log::Log::Init() at ??:0
@ 0x7f6f90221dbf kudu::log::Log::Open() at ??:0
@ 0x7f6f91ab32ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f6f91aaf7dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f6f91aadfd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 10:44:10.375540 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5cada558676a41b2b81abaae00369c39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.376199 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cada558676a41b2b81abaae00369c39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.376643 6273 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.376782 6273 ts_tablet_manager.cc:1397] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20260928 10:44:10.377473 6273 raft_consensus.cc:348] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.377681 6273 raft_consensus.cc:374] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.377728 6273 raft_consensus.cc:729] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.378034 6273 consensus_queue.cc:260] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.378248 7058 raft_consensus.cc:482] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.378334 7058 raft_consensus.cc:504] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.379058 7058 leader_election.cc:288] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.379590 6273 ts_tablet_manager.cc:1428] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:10.379825 6273 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.379791 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.380308 5818 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.381222 6273 tablet_bootstrap.cc:654] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:10.389745 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c67f960eb84426f9ebdfef33306a9d0 consensus state has no leader
I20260928 10:44:10.390869 6273 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.390993 6273 ts_tablet_manager.cc:1397] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260928 10:44:10.391638 6273 raft_consensus.cc:348] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.392231 6273 raft_consensus.cc:374] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.392292 6273 raft_consensus.cc:729] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.392458 6273 consensus_queue.cc:260] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.393066 6273 ts_tablet_manager.cc:1428] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:10.393324 6273 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.394672 6273 tablet_bootstrap.cc:654] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.398434 6273 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.398597 6273 ts_tablet_manager.cc:1397] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:44:10.399375 6273 raft_consensus.cc:348] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.399607 6273 raft_consensus.cc:374] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.399653 6273 raft_consensus.cc:729] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.399832 6273 consensus_queue.cc:260] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.400483 6273 ts_tablet_manager.cc:1428] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.400758 6273 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.400676 7130 consensus_queue.cc:1035] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:10.401953 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.405035 6271 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.405186 6271 ts_tablet_manager.cc:1397] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.566s user 0.041s sys 0.083s
I20260928 10:44:10.405867 6271 raft_consensus.cc:348] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.406085 6271 raft_consensus.cc:374] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.406128 6271 raft_consensus.cc:729] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.406309 6271 consensus_queue.cc:260] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.406836 6271 ts_tablet_manager.cc:1428] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.407110 6271 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.408919 6271 tablet_bootstrap.cc:654] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.410750 6273 tablet_bootstrap.cc:654] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.414738 7121 raft_consensus.cc:482] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.414992 7121 raft_consensus.cc:504] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.415609 7121 leader_election.cc:288] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:10.416779 5957 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 86b16eb36c034591ac1603ab84fd9342
W20260928 10:44:10.417177 5955 leader_election.cc:341] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.418715 6273 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.418859 6273 ts_tablet_manager.cc:1397] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
W20260928 10:44:10.420245 6275 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.640s user 0.029s sys 0.128s
W20260928 10:44:10.420329 6275 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.640s user 0.029s sys 0.128s
I20260928 10:44:10.420619 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86b16eb36c034591ac1603ab84fd9342" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.421038 6271 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.421164 6271 ts_tablet_manager.cc:1397] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260928 10:44:10.421638 6273 raft_consensus.cc:348] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.421865 6273 raft_consensus.cc:374] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.421921 6273 raft_consensus.cc:729] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.421866 6271 raft_consensus.cc:348] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.422047 6271 raft_consensus.cc:374] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.422096 6271 raft_consensus.cc:729] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.422135 6273 consensus_queue.cc:260] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.422238 6271 consensus_queue.cc:260] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.422811 6273 ts_tablet_manager.cc:1428] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:10.422839 6271 ts_tablet_manager.cc:1428] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:10.423089 6273 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.423107 6271 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.423260 5882 raft_consensus.cc:2454] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:10.423763 5957 leader_election.cc:302] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.424264 7121 raft_consensus.cc:2781] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.424371 7121 raft_consensus.cc:686] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:10.424580 7121 consensus_queue.cc:237] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.425876 7029 raft_consensus.cc:504] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.426240 6273 tablet_bootstrap.cc:654] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.426735 7029 leader_election.cc:288] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.427295 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:10.427488 5882 raft_consensus.cc:3037] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.428702 6271 tablet_bootstrap.cc:654] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.433101 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 638) took 5035 ms. Trace:
I20260928 10:44:10.435671 6273 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.435824 6273 ts_tablet_manager.cc:1397] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260928 10:44:10.436650 6273 raft_consensus.cc:348] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.433218 6270 rpcz_store.cc:276] 0928 10:44:05.397556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.486436 (+ 88880us) service_pool.cc:227] Handling call
0928 10:44:09.510409 (+4023973us) ts_tablet_manager.cc:1145] Deleting tablet dbd5d1ccd2e54f3884af3af327bb892e
0928 10:44:09.510416 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:09.749565 (+239149us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.172567 (+423002us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.433070 (+260503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909647}
I20260928 10:44:10.436900 6273 raft_consensus.cc:374] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.436949 6273 raft_consensus.cc:729] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.437175 6270 tablet_replica.cc:330] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:10.437157 6273 consensus_queue.cc:260] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.437386 6270 raft_consensus.cc:2229] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:10.437531 6270 raft_consensus.cc:2258] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:10.437834 6273 ts_tablet_manager.cc:1428] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.438112 6273 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.438088 6270 ts_tablet_manager.cc:1905] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:10.438952 6271 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.439080 6271 ts_tablet_manager.cc:1397] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260928 10:44:10.439148 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet dbd5d1ccd2e54f3884af3af327bb892e (table default.Table_dd487bf423e44aa3b7c72ea54b5f2283 [id=e00c83d4870444d3ab8051f21ece4c22]) successfully deleted
I20260928 10:44:10.439689 6273 tablet_bootstrap.cc:654] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.439766 6271 raft_consensus.cc:348] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.439966 6271 raft_consensus.cc:374] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.440027 6271 raft_consensus.cc:729] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.440280 6271 consensus_queue.cc:260] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.440824 6271 ts_tablet_manager.cc:1428] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:10.441068 6271 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.442946 6271 tablet_bootstrap.cc:654] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.452180 6273 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.452327 6273 ts_tablet_manager.cc:1397] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260928 10:44:10.453328 6273 raft_consensus.cc:348] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.453557 6273 raft_consensus.cc:374] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.453626 6273 raft_consensus.cc:729] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:10.453866 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_2357f1366fe443be8c84b81b162dc35a [id=6677562fe2604addb84af531539cbebd], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3c67f960eb84426f9ebdfef33306a9d0 consensus state has no leader
I20260928 10:44:10.453846 6273 consensus_queue.cc:260] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.454531 6273 ts_tablet_manager.cc:1428] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:10.454819 6273 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.455958 6271 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.456091 6271 ts_tablet_manager.cc:1397] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.001s
I20260928 10:44:10.456386 6273 tablet_bootstrap.cc:654] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.457360 6271 raft_consensus.cc:348] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.457561 6271 raft_consensus.cc:374] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.457607 6271 raft_consensus.cc:729] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.457803 6271 consensus_queue.cc:260] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.458307 6271 ts_tablet_manager.cc:1428] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:10.460248 6271 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.461607 6275 tablet_bootstrap.cc:492] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.461706 6271 tablet_bootstrap.cc:654] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.461742 6275 ts_tablet_manager.cc:1397] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.684s user 0.030s sys 0.128s
I20260928 10:44:10.462404 6275 raft_consensus.cc:348] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.462623 6275 raft_consensus.cc:374] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.462677 6275 raft_consensus.cc:729] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.462862 6275 consensus_queue.cc:260] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.463366 6275 ts_tablet_manager.cc:1428] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.463506 6273 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.463620 6275 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:10.463627 6273 ts_tablet_manager.cc:1397] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260928 10:44:10.464352 6271 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.464458 6271 ts_tablet_manager.cc:1397] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260928 10:44:10.464687 6273 raft_consensus.cc:348] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.464871 6273 raft_consensus.cc:374] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.464919 6273 raft_consensus.cc:729] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.465103 6273 consensus_queue.cc:260] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.465236 6271 raft_consensus.cc:348] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.465408 6271 raft_consensus.cc:374] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.465456 6271 raft_consensus.cc:729] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.465698 6273 ts_tablet_manager.cc:1428] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.465764 6275 tablet_bootstrap.cc:654] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.465684 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b4cea29f67244120946fe29fe5b1e2f6" } modify_external_catalogs: true
I20260928 10:44:10.465903 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b4cea29f67244120946fe29fe5b1e2f6" } modify_external_catalogs: true
I20260928 10:44:10.465618 6271 consensus_queue.cc:260] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.466558 6271 ts_tablet_manager.cc:1428] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:10.466794 6271 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.468871 6271 tablet_bootstrap.cc:654] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:10.471274 5817 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.474318 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2187fe4785f9466eb7ed729a4e0407f2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:10.475747 5817 leader_election.cc:302] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.477325 6275 tablet_bootstrap.cc:492] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.477351 6273 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.477458 6275 ts_tablet_manager.cc:1397] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260928 10:44:10.478137 6275 raft_consensus.cc:348] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.478351 6275 raft_consensus.cc:374] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.478395 6275 raft_consensus.cc:729] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.478619 6275 consensus_queue.cc:260] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.479023 6273 tablet_bootstrap.cc:654] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.479308 6275 ts_tablet_manager.cc:1428] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260928 10:44:10.479278 5955 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.479398 5955 leader_election.cc:302] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.479943 7058 raft_consensus.cc:2726] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.480362 6275 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:10.482045 6271 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.482175 6271 ts_tablet_manager.cc:1397] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260928 10:44:10.482681 6275 tablet_bootstrap.cc:654] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.483609 6273 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.483728 6273 ts_tablet_manager.cc:1397] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.002s
I20260928 10:44:10.484365 6273 raft_consensus.cc:348] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.484565 6273 raft_consensus.cc:374] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.484611 6273 raft_consensus.cc:729] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.484783 6273 consensus_queue.cc:260] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.485391 6273 ts_tablet_manager.cc:1428] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:10.487255 6273 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.488765 6273 tablet_bootstrap.cc:654] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.497335 6273 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.497578 6273 ts_tablet_manager.cc:1397] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260928 10:44:10.497958 5700 catalog_manager.cc:5495] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b reported cstate change: term changed from 0 to 1, leader changed from <none> to ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65). New cstate: current_term: 1 leader_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:10.498369 6273 raft_consensus.cc:348] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.498610 6273 raft_consensus.cc:374] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.498660 6273 raft_consensus.cc:729] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.498848 6273 consensus_queue.cc:260] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.499513 6273 ts_tablet_manager.cc:1428] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:10.499802 6273 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.499810 5700 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:10.500079 5700 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:10.500280 5700 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 76a47129ab5444dcab0a3f92a16046db (table default.Table_5fad44d7253f493788268121109a5671 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]). Expected version 2 got 0
I20260928 10:44:10.501428 6273 tablet_bootstrap.cc:654] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.503341 5993 tablet_service.cc:1467] Processing CreateTablet for tablet de3da93167484afba0c91d1c8167f876 (DEFAULT_TABLE table=default.Table_e1f9c3715e3545728d25c17219e3ddbf [id=6d57bee026154c67a16fd843f52f1a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.503540 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8389880591441a9c2aabf22d67005f (DEFAULT_TABLE table=default.Table_550e45812a914de2bf9f3d979383be3e [id=8ae8d1a492204e2b9d15a82b63dbf67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.503808 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de3da93167484afba0c91d1c8167f876. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:10.503886 5955 leader_election.cc:341] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.503887 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 (DEFAULT_TABLE table=default.Table_e15c910d058b467693d20c3f1c8fdcdd [id=32d1eb8bb113425ab456b2b9943f47da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.504334 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 4706d214d3184f4ebcec28f609b00a53 (DEFAULT_TABLE table=default.Table_b2251f8b3e7e4810b33f0c06a9fe935c [id=bfb51774707347c5991989eef94104b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.504495 6271 raft_consensus.cc:348] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.504738 6271 raft_consensus.cc:374] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.504787 6271 raft_consensus.cc:729] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.504961 6271 consensus_queue.cc:260] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.505314 6275 tablet_bootstrap.cc:492] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.505429 6275 ts_tablet_manager.cc:1397] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.003s
I20260928 10:44:10.506263 6275 raft_consensus.cc:348] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.506695 6275 raft_consensus.cc:374] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.506752 6275 raft_consensus.cc:729] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.506778 5984 tablet_service.cc:1467] Processing CreateTablet for tablet d8bb524f0fc74503903f341d0e567e40 (DEFAULT_TABLE table=default.Table_dce9710720074022a1cc005217a6ad07 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.507151 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8bb524f0fc74503903f341d0e567e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.507702 6275 consensus_queue.cc:260] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.510741 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 20366392a9ef46a2b3aa8d99deb17a94 (DEFAULT_TABLE table=default.Table_38322efa550a48f0bb9767a94cdbe77d [id=89a221b950074d779623250ceccbd222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.511160 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20366392a9ef46a2b3aa8d99deb17a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.513278 6275 ts_tablet_manager.cc:1428] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260928 10:44:10.514377 6269 ts_tablet_manager.cc:1918] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:10.515169 6275 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:10.515216 6269 log.cc:1196] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:10.515640 6269 ts_tablet_manager.cc:1939] T 122fbbe54c174c4ea9cf38698debcb27 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:10.518400 6275 tablet_bootstrap.cc:654] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.518857 6990 raft_consensus.cc:2726] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.519007 7122 raft_consensus.cc:482] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.519140 7122 raft_consensus.cc:504] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.519501 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.519802 7122 leader_election.cc:288] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.520054 6124 tablet_service.cc:1467] Processing CreateTablet for tablet de3da93167484afba0c91d1c8167f876 (DEFAULT_TABLE table=default.Table_e1f9c3715e3545728d25c17219e3ddbf [id=6d57bee026154c67a16fd843f52f1a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.520460 6122 tablet_service.cc:1467] Processing CreateTablet for tablet d8bb524f0fc74503903f341d0e567e40 (DEFAULT_TABLE table=default.Table_dce9710720074022a1cc005217a6ad07 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.520866 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 20366392a9ef46a2b3aa8d99deb17a94 (DEFAULT_TABLE table=default.Table_38322efa550a48f0bb9767a94cdbe77d [id=89a221b950074d779623250ceccbd222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.523164 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 20366392a9ef46a2b3aa8d99deb17a94 (DEFAULT_TABLE table=default.Table_38322efa550a48f0bb9767a94cdbe77d [id=89a221b950074d779623250ceccbd222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.523617 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20366392a9ef46a2b3aa8d99deb17a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.532071 6275 tablet_bootstrap.cc:492] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.532223 6275 ts_tablet_manager.cc:1397] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260928 10:44:10.533985 5848 tablet_service.cc:1467] Processing CreateTablet for tablet d8bb524f0fc74503903f341d0e567e40 (DEFAULT_TABLE table=default.Table_dce9710720074022a1cc005217a6ad07 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.535331 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.535851 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a3cb198fb3d481eb6bdab29d968144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.532884 6275 raft_consensus.cc:348] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.537806 6275 raft_consensus.cc:374] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.537889 6275 raft_consensus.cc:729] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.538117 6275 consensus_queue.cc:260] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.540668 6275 ts_tablet_manager.cc:1428] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
W20260928 10:44:10.546278 5957 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:10.546926 6275 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:10.548668 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 (DEFAULT_TABLE table=default.Table_e15c910d058b467693d20c3f1c8fdcdd [id=32d1eb8bb113425ab456b2b9943f47da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.534458 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8bb524f0fc74503903f341d0e567e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.540313 5845 tablet_service.cc:1467] Processing CreateTablet for tablet de3da93167484afba0c91d1c8167f876 (DEFAULT_TABLE table=default.Table_e1f9c3715e3545728d25c17219e3ddbf [id=6d57bee026154c67a16fd843f52f1a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.550952 6275 tablet_bootstrap.cc:654] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.551183 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de3da93167484afba0c91d1c8167f876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.541163 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.555007 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a3cb198fb3d481eb6bdab29d968144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.547766 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 4706d214d3184f4ebcec28f609b00a53 (DEFAULT_TABLE table=default.Table_b2251f8b3e7e4810b33f0c06a9fe935c [id=bfb51774707347c5991989eef94104b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.559365 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4706d214d3184f4ebcec28f609b00a53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:10.562837 6988 consensus_meta.cc:287] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Time spent flushing consensus metadata: real 0.618s user 0.002s sys 0.001s
I20260928 10:44:10.562955 6988 raft_consensus.cc:504] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.563789 6988 leader_election.cc:288] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.564704 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8389880591441a9c2aabf22d67005f (DEFAULT_TABLE table=default.Table_550e45812a914de2bf9f3d979383be3e [id=8ae8d1a492204e2b9d15a82b63dbf67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.565119 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8389880591441a9c2aabf22d67005f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.569069 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 4706d214d3184f4ebcec28f609b00a53 (DEFAULT_TABLE table=default.Table_b2251f8b3e7e4810b33f0c06a9fe935c [id=bfb51774707347c5991989eef94104b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.574853 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 (DEFAULT_TABLE table=default.Table_e15c910d058b467693d20c3f1c8fdcdd [id=32d1eb8bb113425ab456b2b9943f47da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.575315 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d66d697f2740a98138a08fc6ef9b60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:10.580922 6091 leader_election.cc:341] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d257233e5b934d619e2289a6df55d65a
I20260928 10:44:10.581807 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8389880591441a9c2aabf22d67005f (DEFAULT_TABLE table=default.Table_550e45812a914de2bf9f3d979383be3e [id=8ae8d1a492204e2b9d15a82b63dbf67c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.594769 5990 tablet_service.cc:1467] Processing CreateTablet for tablet b91a14ab76cc49f5b8bacd064b67ce12 (DEFAULT_TABLE table=default.Table_c01b6fc2750c48cb84d7530d32378fb1 [id=cc8704070328405fa441016687f9d7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.596678 5857 tablet_service.cc:1467] Processing CreateTablet for tablet b91a14ab76cc49f5b8bacd064b67ce12 (DEFAULT_TABLE table=default.Table_c01b6fc2750c48cb84d7530d32378fb1 [id=cc8704070328405fa441016687f9d7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.597177 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 (DEFAULT_TABLE table=default.Table_62a7f4dbf79f4e048a37852a9c780a55 [id=a9d6bf1d68ea46adb185683d44793e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.598443 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 (DEFAULT_TABLE table=default.Table_62a7f4dbf79f4e048a37852a9c780a55 [id=a9d6bf1d68ea46adb185683d44793e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.599082 5992 tablet_service.cc:1467] Processing CreateTablet for tablet d309e810473b4854ac512473f9412105 (DEFAULT_TABLE table=default.Table_bed64c4a55fb4edeba9c58e6a404c4b0 [id=ce741b47e0a2413eaecde959208c812f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.600450 5863 tablet_service.cc:1467] Processing CreateTablet for tablet d309e810473b4854ac512473f9412105 (DEFAULT_TABLE table=default.Table_bed64c4a55fb4edeba9c58e6a404c4b0 [id=ce741b47e0a2413eaecde959208c812f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.601539 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 775974ff84e2417fb9ed089f5aa4ca87 (DEFAULT_TABLE table=default.Table_a2df4c84bb2e4b3095ad3099ac5093bf [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.602013 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 775974ff84e2417fb9ed089f5aa4ca87 (DEFAULT_TABLE table=default.Table_a2df4c84bb2e4b3095ad3099ac5093bf [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.602885 5882 raft_consensus.cc:2454] T 2187fe4785f9466eb7ed729a4e0407f2 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:10.603439 5957 leader_election.cc:302] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.603947 7029 raft_consensus.cc:2781] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.604168 7029 raft_consensus.cc:686] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:10.604390 7029 consensus_queue.cc:237] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:10.606760 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc5d744dbc904525858a39c27636443e consensus state has no leader
I20260928 10:44:10.608278 7058 raft_consensus.cc:482] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.608448 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:10.608443 7058 raft_consensus.cc:504] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.609063 7058 leader_election.cc:288] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.612502 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.613463 5818 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.615340 7058 raft_consensus.cc:482] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.615520 7058 raft_consensus.cc:504] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.616122 7058 leader_election.cc:288] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.616606 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:10.616835 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.617161 5818 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:10.617364 5817 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.617451 5817 leader_election.cc:302] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.618643 7058 raft_consensus.cc:2726] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:10.622044 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51d3d85454204faca17e5de63d330330 consensus state has no leader
I20260928 10:44:10.626605 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 349d67ee0d3840ef813f241ac13968fe
I20260928 10:44:10.627140 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9ecd8d56d7a945a0afbd9541048f232b
I20260928 10:44:10.627693 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 349d67ee0d3840ef813f241ac13968fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.628252 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 733ac3eb76f74468a4811c5d642d53f0
I20260928 10:44:10.628393 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 349d67ee0d3840ef813f241ac13968fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.628615 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.629230 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.629392 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.629681 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.632056 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:10.632367 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_bd532df1bba0449693d242f921a74c00 [id=1594b568b0ff4e288800f014304d6757]). Expected version 2 got 0
I20260928 10:44:10.635766 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.635766 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.636253 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.637800 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.638118 5847 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.638330 5846 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:10.641129 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.641360 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.641865 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b18320697c0483895d8cef27a3f663f" } modify_external_catalogs: true
I20260928 10:44:10.642082 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b18320697c0483895d8cef27a3f663f" } modify_external_catalogs: true
I20260928 10:44:10.642958 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_02a2d4e1648a495da6f9df0920977d38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.643585 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a2d4e1648a495da6f9df0920977d38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.646517 6988 raft_consensus.cc:482] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.646625 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b511e6944bb54de49970e8c6fee87274"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:10.646674 6988 raft_consensus.cc:504] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:10.647181 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b511e6944bb54de49970e8c6fee87274 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.647603 6988 leader_election.cc:288] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.647989 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:10.649245 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a1160cb2c67c46d0829bea1d983dca12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.649797 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1160cb2c67c46d0829bea1d983dca12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.650769 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ad06e835386b437d8a8ccb4b8dbc479c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.651264 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad06e835386b437d8a8ccb4b8dbc479c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.653699 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_7c2b9260216f400fb44101905b2c3c36 [id=1594b568b0ff4e288800f014304d6757]). Expected version 3 got 0
I20260928 10:44:10.653894 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:10.654019 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:10.655093 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df04fd38822944cc8bbfb2765e68488a" } modify_external_catalogs: true
I20260928 10:44:10.655303 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df04fd38822944cc8bbfb2765e68488a" } modify_external_catalogs: true
I20260928 10:44:10.658025 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_218b83d626d64b79bb195bd691125578"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.658813 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_218b83d626d64b79bb195bd691125578 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.661468 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01da441e756d46a991c3b81c3321667a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.662020 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01da441e756d46a991c3b81c3321667a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.663743 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8ace400a292441809e397be68d13712c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:10.664398 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ace400a292441809e397be68d13712c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:10.667608 6119 tablet_service.cc:1467] Processing CreateTablet for tablet b91a14ab76cc49f5b8bacd064b67ce12 (DEFAULT_TABLE table=default.Table_c01b6fc2750c48cb84d7530d32378fb1 [id=cc8704070328405fa441016687f9d7f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.668614 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 (DEFAULT_TABLE table=default.Table_62a7f4dbf79f4e048a37852a9c780a55 [id=a9d6bf1d68ea46adb185683d44793e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.669447 6118 tablet_service.cc:1467] Processing CreateTablet for tablet d309e810473b4854ac512473f9412105 (DEFAULT_TABLE table=default.Table_bed64c4a55fb4edeba9c58e6a404c4b0 [id=ce741b47e0a2413eaecde959208c812f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.669498 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 349d67ee0d3840ef813f241ac13968fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.669886 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ecd8d56d7a945a0afbd9541048f232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.670089 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 733ac3eb76f74468a4811c5d642d53f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.670665 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.670785 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b3afe074194023ba788094a2a6b81c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:10.670969 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:10.672305 5686 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer 7a1529a7b0d7479db7dabebf471795b5 (127.5.100.125:37939): Couldn't send request to peer 7a1529a7b0d7479db7dabebf471795b5. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.125:37939: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 10:44:10.678669 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7cce0e772e4e8aae5b56350834cee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.679251 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775974ff84e2417fb9ed089f5aa4ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.679611 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d309e810473b4854ac512473f9412105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.679898 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b91a14ab76cc49f5b8bacd064b67ce12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.683173 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 686) took 4193 ms. Trace:
I20260928 10:44:10.683280 6269 rpcz_store.cc:276] 0928 10:44:06.489644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.489969 (+ 325us) service_pool.cc:227] Handling call
0928 10:44:10.138088 (+3648119us) ts_tablet_manager.cc:1145] Deleting tablet 122fbbe54c174c4ea9cf38698debcb27
0928 10:44:10.138101 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.347728 (+209627us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.511475 (+163747us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.683148 (+171673us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3647924}
I20260928 10:44:10.683634 6269 tablet_replica.cc:330] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:10.683817 6269 raft_consensus.cc:2229] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:10.683944 6269 raft_consensus.cc:2258] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:10.684438 6269 ts_tablet_manager.cc:1905] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:10.689589 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 122fbbe54c174c4ea9cf38698debcb27 (table default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]) successfully deleted
I20260928 10:44:10.699775 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.700536 5817 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.700729 5817 leader_election.cc:302] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.701186 7058 raft_consensus.cc:2726] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.703325 7029 raft_consensus.cc:482] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.703572 7029 raft_consensus.cc:504] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.704243 7029 leader_election.cc:288] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.705039 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:10.705255 5881 raft_consensus.cc:2454] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:10.705905 5957 leader_election.cc:302] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:10.706264 7029 raft_consensus.cc:2781] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:10.706348 7029 raft_consensus.cc:482] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:10.706406 7029 raft_consensus.cc:3037] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.707955 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 775974ff84e2417fb9ed089f5aa4ca87 (DEFAULT_TABLE table=default.Table_a2df4c84bb2e4b3095ad3099ac5093bf [id=66014dc8377e450f82d79b62a481c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:10.713793 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d257233e5b934d619e2289a6df55d65a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:10.714043 6020 raft_consensus.cc:3037] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.716543 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.716607 6988 consensus_queue.cc:1035] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:10.716615 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.716923 6018 raft_consensus.cc:2454] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
W20260928 10:44:10.717577 5955 consensus_peers.cc:487] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.717782 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:10.717902 5955 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.718001 5955 leader_election.cc:302] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.718353 6990 raft_consensus.cc:2726] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.718533 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:10.718781 5955 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.719246 6090 leader_election.cc:302] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.719376 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:10.719555 6988 raft_consensus.cc:2781] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.719662 6988 raft_consensus.cc:686] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:10.719882 6988 consensus_queue.cc:237] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.724033 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d5479a2ce44c20a9437720820f3cec" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:10.724783 6090 leader_election.cc:302] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.725138 6988 raft_consensus.cc:2726] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.725684 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d66d697f2740a98138a08fc6ef9b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.725878 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d309e810473b4854ac512473f9412105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.726325 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775974ff84e2417fb9ed089f5aa4ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.726603 7106 raft_consensus.cc:504] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.726913 6270 ts_tablet_manager.cc:1918] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:10.727023 6270 log.cc:1196] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:10.727161 7106 leader_election.cc:288] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.727349 6270 ts_tablet_manager.cc:1939] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:10.727593 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7cce0e772e4e8aae5b56350834cee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.728116 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775974ff84e2417fb9ed089f5aa4ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.728642 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b91a14ab76cc49f5b8bacd064b67ce12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.729053 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d66d697f2740a98138a08fc6ef9b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.726612 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8389880591441a9c2aabf22d67005f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.729449 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8389880591441a9c2aabf22d67005f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.730381 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4706d214d3184f4ebcec28f609b00a53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:10.730756 6091 consensus_peers.cc:487] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9a0d63c6cbc4eebaf42dc7f969f243c. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.730955 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8bb524f0fc74503903f341d0e567e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.731781 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de3da93167484afba0c91d1c8167f876. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:10.732064 6091 leader_election.cc:341] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e
I20260928 10:44:10.732380 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7cce0e772e4e8aae5b56350834cee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.732841 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20366392a9ef46a2b3aa8d99deb17a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.734056 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d309e810473b4854ac512473f9412105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.734735 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "734c3196929d4814b77bce7938bf598e" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:10.734938 6019 raft_consensus.cc:3037] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.735417 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b91a14ab76cc49f5b8bacd064b67ce12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.735918 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a3cb198fb3d481eb6bdab29d968144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.746747 7058 raft_consensus.cc:482] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.746954 7058 raft_consensus.cc:504] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.747735 7058 leader_election.cc:288] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:10.748754 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.749878 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.750128 5817 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:10.750510 5818 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.750635 5818 leader_election.cc:302] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.750924 7058 raft_consensus.cc:2726] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.786832 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4706d214d3184f4ebcec28f609b00a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:10.790889 7029 raft_consensus.cc:504] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.791708 7029 leader_election.cc:288] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.792222 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:10.792418 5883 raft_consensus.cc:3037] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.794631 7058 consensus_queue.cc:1035] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:10.795276 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6b418bbb3364006b097e3a78edf5f55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:10.798986 6136 consensus_meta.cc:287] T d17fe373ea094f13bc9ceb9657fe7e6f P 4dab87557ec9445dbe35ea05e3561a94: Time spent flushing consensus metadata: real 0.879s user 0.005s sys 0.001s
I20260928 10:44:10.799391 6136 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45886 (request call id 815) took 1017 ms. Trace:
I20260928 10:44:10.799479 6136 rpcz_store.cc:276] 0928 10:44:09.781430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.785543 (+ 4113us) service_pool.cc:227] Handling call
0928 10:44:09.787709 (+ 2166us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:09.787774 (+ 65us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:09.919699 (+131925us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.799179 (+879480us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:10.799374 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260928 10:44:10.803505 5955 leader_election.cc:341] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.803718 6152 raft_consensus.cc:3037] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:10.833117 7029 raft_consensus.cc:482] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.833357 7029 raft_consensus.cc:504] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:10.835186 5957 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:10.835484 7029 leader_election.cc:288] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.836545 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 645) took 5343 ms. Trace:
I20260928 10:44:10.836651 6270 rpcz_store.cc:276] 0928 10:44:05.492690 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.492747 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:10.437114 (+4944367us) ts_tablet_manager.cc:1145] Deleting tablet e2d38c0ed54b45a89f8e1daefd5b67a1
0928 10:44:10.437129 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.517663 (+ 80534us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.726803 (+209140us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.836513 (+109710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4834451}
I20260928 10:44:10.837013 6270 tablet_replica.cc:330] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:10.837189 6270 raft_consensus.cc:2229] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:10.837359 6270 raft_consensus.cc:2258] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:10.837852 6020 raft_consensus.cc:2454] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:10.838300 6090 leader_election.cc:302] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.838798 6976 raft_consensus.cc:2781] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.838923 6976 raft_consensus.cc:686] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:10.839133 6976 consensus_queue.cc:237] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.843060 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (table default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]) successfully deleted
W20260928 10:44:10.846554 6091 consensus_peers.cc:487] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2d38c0ed54b45a89f8e1daefd5b67a1. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.847517 5883 raft_consensus.cc:2454] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:10.848388 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b77c90bc2ecc4fc29a4786152cb977bd" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.849037 5955 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.849193 5955 leader_election.cc:302] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.849423 6990 raft_consensus.cc:2726] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.851145 5957 leader_election.cc:302] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.853518 7029 raft_consensus.cc:2781] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.854694 7029 raft_consensus.cc:686] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:10.855052 7029 consensus_queue.cc:237] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.860482 6112 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 158) took 1131 ms. Trace:
I20260928 10:44:10.860666 6112 rpcz_store.cc:276] 0928 10:44:09.728588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.728661 (+ 73us) service_pool.cc:227] Handling call
0928 10:44:10.123708 (+395047us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x61500013de24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.222577 (+ 98869us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x6150001089a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.455709 (+233132us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x6150000373a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.735945 (+280236us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x6150001255a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.750606 (+ 14661us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x615000136124. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.860429 (+109823us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2321372160}
I20260928 10:44:10.896785 5983 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46336 (request call id 821) took 1050 ms. Trace:
I20260928 10:44:10.896936 5983 rpcz_store.cc:276] 0928 10:44:09.845981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.849398 (+ 3417us) service_pool.cc:227] Handling call
0928 10:44:09.849828 (+ 430us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0928 10:44:09.849846 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0928 10:44:10.790235 (+940389us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:10.896629 (+106394us) tablet_replica.cc:205] Creating consensus instance
0928 10:44:10.896761 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 10:44:10.897588 7058 raft_consensus.cc:482] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.897756 7058 raft_consensus.cc:504] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.898450 7058 leader_election.cc:288] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.899322 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.900156 5817 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.902036 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.902938 5818 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.903085 5818 leader_election.cc:302] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.903434 7058 raft_consensus.cc:2726] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.905725 6270 ts_tablet_manager.cc:1905] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:10.927228 5817 consensus_peers.cc:487] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.931048 7058 raft_consensus.cc:482] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.931246 7058 raft_consensus.cc:504] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.931883 7058 leader_election.cc:288] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:10.932721 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.933410 5817 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:10.933884 6090 consensus_peers.cc:487] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2d38c0ed54b45a89f8e1daefd5b67a1. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.934247 7121 raft_consensus.cc:482] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.934438 7121 raft_consensus.cc:504] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.935346 7121 leader_election.cc:288] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:10.935660 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5a2038947413f95f134602081c889" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:10.936681 5955 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.938956 6271 ts_tablet_manager.cc:1428] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.457s user 0.108s sys 0.100s
I20260928 10:44:10.939368 6271 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:10.940634 6091 consensus_peers.cc:487] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1631d396362a4cffa1dec06d00894c63. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:10.940963 6271 tablet_bootstrap.cc:654] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:10.941622 5957 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bae5a2038947413f95f134602081c889
I20260928 10:44:10.941792 5957 leader_election.cc:302] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.942011 7168 raft_consensus.cc:2726] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.946095 6275 tablet_bootstrap.cc:492] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.946234 6275 ts_tablet_manager.cc:1397] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.405s user 0.031s sys 0.106s
I20260928 10:44:10.948952 6275 raft_consensus.cc:348] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.949184 6275 raft_consensus.cc:374] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.949116 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:10.949249 6275 raft_consensus.cc:729] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:10.949709 5818 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.949960 5818 leader_election.cc:302] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.951180 6271 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:10.951365 6271 ts_tablet_manager.cc:1397] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20260928 10:44:10.952092 6271 raft_consensus.cc:348] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.952351 6271 raft_consensus.cc:374] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.952445 6271 raft_consensus.cc:729] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.952603 7058 raft_consensus.cc:2726] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.951504 6275 consensus_queue.cc:260] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.952741 6271 consensus_queue.cc:260] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.954218 6275 ts_tablet_manager.cc:1428] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:10.954613 6271 ts_tablet_manager.cc:1428] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:10.955084 6275 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:10.955809 6271 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:10.957175 6271 tablet_bootstrap.cc:654] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.957811 6275 tablet_bootstrap.cc:654] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.959142 6273 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:10.959280 6273 ts_tablet_manager.cc:1397] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.460s user 0.080s sys 0.155s
I20260928 10:44:10.960003 6273 raft_consensus.cc:348] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.960225 6273 raft_consensus.cc:374] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.960290 6273 raft_consensus.cc:729] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.961973 6019 raft_consensus.cc:2454] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:10.963091 6273 consensus_queue.cc:260] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:10.965509 6273 ts_tablet_manager.cc:1428] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:44:10.965806 6273 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:10.967366 6273 tablet_bootstrap.cc:654] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:10.978169 6090 leader_election.cc:302] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:10.978754 6976 raft_consensus.cc:2781] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:10.978914 6976 raft_consensus.cc:686] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:10.979153 6976 consensus_queue.cc:237] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:10.988265 7058 raft_consensus.cc:482] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:10.988444 7058 raft_consensus.cc:504] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.989056 7058 leader_election.cc:288] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:10.989727 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:10.990070 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:10.990303 5817 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:10.991755 5818 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:10.992282 5818 leader_election.cc:302] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:10.992533 7058 raft_consensus.cc:2726] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:10.996358 6275 tablet_bootstrap.cc:492] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:10.996537 6275 ts_tablet_manager.cc:1397] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.002s
I20260928 10:44:10.997361 6275 raft_consensus.cc:348] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.997642 6275 raft_consensus.cc:374] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:10.997721 6275 raft_consensus.cc:729] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:10.998010 6275 consensus_queue.cc:260] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:10.998703 6275 ts_tablet_manager.cc:1428] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:10.999073 6275 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.000887 6273 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.001053 6273 ts_tablet_manager.cc:1397] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.006s
I20260928 10:44:11.001879 6273 raft_consensus.cc:348] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.002127 6273 raft_consensus.cc:374] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.002188 6273 raft_consensus.cc:729] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.002406 6273 consensus_queue.cc:260] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.003085 6273 ts_tablet_manager.cc:1428] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.003396 6273 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.005141 6273 tablet_bootstrap.cc:654] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.005713 7058 raft_consensus.cc:482] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.005872 7058 raft_consensus.cc:504] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.006567 7058 leader_election.cc:288] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.007170 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.007786 5817 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.008497 7196 tablet.cc:1722] T 43d5479a2ce44c20a9437720820f3cec P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:11.009045 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.010624 6271 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.011366 6271 ts_tablet_manager.cc:1397] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.028s
W20260928 10:44:11.011212 5818 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.011536 5818 leader_election.cc:302] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.011776 7058 raft_consensus.cc:2726] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:11.010599 5984 consensus_meta.cc:287] T d8bb524f0fc74503903f341d0e567e40 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent flushing consensus metadata: real 0.500s user 0.005s sys 0.001s
I20260928 10:44:11.012630 6271 raft_consensus.cc:348] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.014161 6271 raft_consensus.cc:374] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.014279 6271 raft_consensus.cc:729] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.014532 6271 consensus_queue.cc:260] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.015584 6271 ts_tablet_manager.cc:1428] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 10:44:11.018008 6271 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.021709 6275 tablet_bootstrap.cc:654] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.031390 6275 tablet_bootstrap.cc:492] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.031582 6275 ts_tablet_manager.cc:1397] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260928 10:44:11.032464 6275 raft_consensus.cc:348] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.032737 6275 raft_consensus.cc:374] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.032852 6275 raft_consensus.cc:729] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.033170 6275 consensus_queue.cc:260] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.036260 6976 raft_consensus.cc:482] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.036437 6976 raft_consensus.cc:504] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.037449 6976 leader_election.cc:288] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.033771 6275 ts_tablet_manager.cc:1428] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260928 10:44:11.038933 6275 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:11.038956 6091 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:44:11.041306 6275 tablet_bootstrap.cc:654] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.044174 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet be50535c36a54453b2a1a6d6d09207eb
I20260928 10:44:11.047868 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 917513e857de49a7a57416eca237f70b
I20260928 10:44:11.051581 6273 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.051748 6273 ts_tablet_manager.cc:1397] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.003s
I20260928 10:44:11.052536 6273 raft_consensus.cc:348] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.052798 6273 raft_consensus.cc:374] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:11.052817 6091 consensus_peers.cc:487] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e9583b5637a428db383320d98a7a280. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.052870 6273 raft_consensus.cc:729] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.053071 6273 consensus_queue.cc:260] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.058674 6271 tablet_bootstrap.cc:654] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.061760 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 917513e857de49a7a57416eca237f70b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.063313 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_06078e7cac34487a94b8b2e5291896bb" } new_table_name: "default.Table_4527e778dec6400a88d3f4d152764a21" modify_external_catalogs: true
I20260928 10:44:11.065147 5697 catalog_manager.cc:5495] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:11.066922 5697 catalog_manager.cc:5495] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:11.067399 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:11.069607 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_70a5507af48d4a689baa7a6e5d1c39b3" } new_table_name: "default.Table_551474a9e56d482fa803f2681a7be608" modify_external_catalogs: true
I20260928 10:44:11.069834 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_48d4da09446e4cfa882d3a941745fcd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.070726 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_48080e9dfbf64580b869f48141af3593" } new_table_name: "default.Table_b46068b5ed384605b42768dd7ae47fb0" modify_external_catalogs: true
I20260928 10:44:11.071545 6275 tablet_bootstrap.cc:492] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.072052 6275 ts_tablet_manager.cc:1397] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260928 10:44:11.073717 6275 raft_consensus.cc:348] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.074275 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3a223846547e4541b652fe1662cd3647" } new_table_name: "default.Table_05e9e2f2253945c286361ae7fb235dfe" modify_external_catalogs: true
I20260928 10:44:11.074615 6275 raft_consensus.cc:374] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.074908 6275 raft_consensus.cc:729] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.075479 6275 consensus_queue.cc:260] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.076295 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3e40822e797d4d10b1aa9757f8008373"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.076951 6275 ts_tablet_manager.cc:1428] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260928 10:44:11.077080 7058 raft_consensus.cc:482] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.077361 7058 raft_consensus.cc:504] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.077862 6275 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.069175 6271 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.078599 6271 ts_tablet_manager.cc:1397] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.001s
I20260928 10:44:11.078896 7058 leader_election.cc:288] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.078508 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.079324 6271 raft_consensus.cc:348] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.079561 6271 raft_consensus.cc:374] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:11.079550 5818 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.079635 6271 raft_consensus.cc:729] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.079819 6271 consensus_queue.cc:260] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.080343 6271 ts_tablet_manager.cc:1428] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.080615 6271 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.082696 6271 tablet_bootstrap.cc:654] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.083274 6275 tablet_bootstrap.cc:654] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.085656 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet be50535c36a54453b2a1a6d6d09207eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.085999 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 917513e857de49a7a57416eca237f70b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.086567 6269 ts_tablet_manager.cc:1918] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.086736 6269 log.cc:1196] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/db824b43256640e9bfef44da1ccf8e1a
I20260928 10:44:11.087109 6269 ts_tablet_manager.cc:1939] T db824b43256640e9bfef44da1ccf8e1a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.087563 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb1d807c9f04fe4b02e3343f0c6511c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.087852 6018 raft_consensus.cc:2454] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.088373 6090 leader_election.cc:302] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.088723 6976 raft_consensus.cc:2781] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.088811 6976 raft_consensus.cc:482] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.088894 6976 raft_consensus.cc:3037] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.089389 7106 raft_consensus.cc:482] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.089514 7106 raft_consensus.cc:504] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.090065 7106 leader_election.cc:288] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.090684 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet be50535c36a54453b2a1a6d6d09207eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.090929 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b3afe074194023ba788094a2a6b81c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.091377 6018 raft_consensus.cc:2454] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.091745 6090 leader_election.cc:302] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.092017 7106 raft_consensus.cc:2781] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.092121 7106 raft_consensus.cc:482] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.092232 7106 raft_consensus.cc:3037] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.093516 6271 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.093642 6271 ts_tablet_manager.cc:1397] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260928 10:44:11.094274 6271 raft_consensus.cc:348] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:11.094741 6091 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 82b3afe074194023ba788094a2a6b81c
I20260928 10:44:11.094457 6271 raft_consensus.cc:374] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.097463 6271 raft_consensus.cc:729] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.097690 6271 consensus_queue.cc:260] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.098255 6271 ts_tablet_manager.cc:1428] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 10:44:11.098615 6271 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.100286 6271 tablet_bootstrap.cc:654] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.100455 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_796649c7c07c4a35b70da51f042d468f" } modify_external_catalogs: true
I20260928 10:44:11.100704 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_796649c7c07c4a35b70da51f042d468f" } modify_external_catalogs: true
I20260928 10:44:11.101791 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_dadadc27cb47481fac861cc24bd236c0 [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 2 got 0
I20260928 10:44:11.102101 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:11.102326 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet a61d97ed6b7b4dcba34a7a2190316b02 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:11.103025 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48d4da09446e4cfa882d3a941745fcd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.104398 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 917513e857de49a7a57416eca237f70b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.104804 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet be50535c36a54453b2a1a6d6d09207eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.106392 6275 tablet_bootstrap.cc:492] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:11.106576 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e40822e797d4d10b1aa9757f8008373 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.106669 6275 ts_tablet_manager.cc:1397] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.011s
I20260928 10:44:11.107612 6275 raft_consensus.cc:348] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.107935 6275 raft_consensus.cc:374] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.108054 6275 raft_consensus.cc:729] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.108327 6275 consensus_queue.cc:260] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.109161 6275 ts_tablet_manager.cc:1428] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:11.109912 6275 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.112665 6271 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.112906 6271 ts_tablet_manager.cc:1397] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260928 10:44:11.114096 6273 ts_tablet_manager.cc:1428] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.062s user 0.002s sys 0.002s
I20260928 10:44:11.114202 7201 raft_consensus.cc:482] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.114336 7201 raft_consensus.cc:504] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.114565 6273 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.115036 7201 leader_election.cc:288] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.116297 6273 tablet_bootstrap.cc:654] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.116214 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.113921 6271 raft_consensus.cc:348] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.116822 6271 raft_consensus.cc:374] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.116951 6271 raft_consensus.cc:729] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:11.116992 5818 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.117213 6271 consensus_queue.cc:260] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.117791 6271 ts_tablet_manager.cc:1428] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:11.117827 7201 raft_consensus.cc:482] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.117951 7201 raft_consensus.cc:504] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.118108 6271 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.118649 6273 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.118769 6273 ts_tablet_manager.cc:1397] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:44:11.119279 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.119513 6273 raft_consensus.cc:348] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.119709 6273 raft_consensus.cc:374] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.119765 6273 raft_consensus.cc:729] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.119732 6018 raft_consensus.cc:2454] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:11.119788 7201 leader_election.cc:288] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.119957 6273 consensus_queue.cc:260] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.120468 6273 ts_tablet_manager.cc:1428] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:11.120512 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.120721 6273 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.120968 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.121503 5818 leader_election.cc:302] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:11.121851 7205 raft_consensus.cc:2781] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.121918 7205 raft_consensus.cc:482] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.121985 7205 raft_consensus.cc:3037] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.122265 6273 tablet_bootstrap.cc:654] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.129288 7197 tablet.cc:1722] T 43d5479a2ce44c20a9437720820f3cec P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:11.119728 6271 tablet_bootstrap.cc:654] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.134085 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_186b2d54b8844c4abf376552ec9f2e5d" } modify_external_catalogs: true
I20260928 10:44:11.134797 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_186b2d54b8844c4abf376552ec9f2e5d" } modify_external_catalogs: true
I20260928 10:44:11.139066 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.138870 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6456c36640e446fda654b2aeee90b200" } modify_external_catalogs: true
I20260928 10:44:11.139494 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6456c36640e446fda654b2aeee90b200" } modify_external_catalogs: true
I20260928 10:44:11.139698 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.139894 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.140137 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.140419 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.140656 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.140877 6275 tablet_bootstrap.cc:654] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.144945 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.150269 7029 raft_consensus.cc:482] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.150573 6271 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.150611 7029 raft_consensus.cc:504] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.150830 6271 ts_tablet_manager.cc:1397] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260928 10:44:11.150938 6275 tablet_bootstrap.cc:492] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.151078 6275 ts_tablet_manager.cc:1397] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.003s
I20260928 10:44:11.151891 6275 raft_consensus.cc:348] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.152141 6275 raft_consensus.cc:374] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.152221 6275 raft_consensus.cc:729] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:11.152381 5957 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:11.152560 7029 leader_election.cc:288] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.152470 6275 consensus_queue.cc:260] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.153956 6275 ts_tablet_manager.cc:1428] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:11.154258 6275 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:11.154664 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed7cd14e0039402ea51f34e8b88e2605 consensus state has no leader
I20260928 10:44:11.154976 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 698) took 4504 ms. Trace:
I20260928 10:44:11.155426 6269 rpcz_store.cc:276] 0928 10:44:06.650780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.650888 (+ 108us) service_pool.cc:227] Handling call
0928 10:44:10.683589 (+4032701us) ts_tablet_manager.cc:1145] Deleting tablet db824b43256640e9bfef44da1ccf8e1a
0928 10:44:10.683599 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.822820 (+139221us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.086427 (+263607us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.154900 (+ 68473us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4032338}
I20260928 10:44:11.156633 7205 raft_consensus.cc:504] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.157068 6275 tablet_bootstrap.cc:654] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.157511 7205 leader_election.cc:288] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.161659 6976 raft_consensus.cc:504] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.162441 6976 leader_election.cc:288] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:11.164229 5817 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.164402 5817 leader_election.cc:302] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.156147 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet db824b43256640e9bfef44da1ccf8e1a (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
I20260928 10:44:11.165936 6988 raft_consensus.cc:482] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.166139 7205 raft_consensus.cc:2726] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.166078 6988 raft_consensus.cc:504] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:11.166607 5817 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.166627 6988 leader_election.cc:288] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.166762 5817 leader_election.cc:302] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.167244 7205 raft_consensus.cc:2726] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:11.168074 5817 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.170540 6275 tablet_bootstrap.cc:492] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.170697 6275 ts_tablet_manager.cc:1397] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20260928 10:44:11.170658 7214 tablet.cc:1722] T 43d5479a2ce44c20a9437720820f3cec P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:11.159404 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bbd9fe7116a429f8faf1b38184b2f4a consensus state has no leader
I20260928 10:44:11.171463 6275 raft_consensus.cc:348] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.171640 7205 raft_consensus.cc:482] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.171689 6275 raft_consensus.cc:374] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.171797 7205 raft_consensus.cc:504] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.172236 6275 raft_consensus.cc:729] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.172408 7205 leader_election.cc:288] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.172518 6275 consensus_queue.cc:260] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.172966 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.173164 6275 ts_tablet_manager.cc:1428] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.173445 6275 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:11.173518 5818 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.160643 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6216f539f2e940c9b18befaa86c8b046 consensus state has no leader
I20260928 10:44:11.175489 6275 tablet_bootstrap.cc:654] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.176296 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:11.176543 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
W20260928 10:44:11.161785 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 593015cc3f8547b5a08043d2c016ec91 consensus state has no leader
I20260928 10:44:11.162323 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4eb3f2523bb2424f89c69fcb65ef6616"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.177534 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9d87a6f28ce74fccb644babb0704ed0f" } new_table_name: "default.Table_702ce53597184b5c8e3ed3e16f49d491" modify_external_catalogs: true
W20260928 10:44:11.177796 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eb3f2523bb2424f89c69fcb65ef6616 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.179248 6275 tablet_bootstrap.cc:492] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.179386 6275 ts_tablet_manager.cc:1397] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260928 10:44:11.180121 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.180189 6275 raft_consensus.cc:348] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.180384 6275 raft_consensus.cc:374] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.180452 6275 raft_consensus.cc:729] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.180642 6275 consensus_queue.cc:260] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.181944 6275 ts_tablet_manager.cc:1428] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.182192 6275 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.182893 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5b422c70a84cc0bc9f8a686f4e2c82" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.183111 6020 raft_consensus.cc:2454] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.183357 6273 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.183529 6273 ts_tablet_manager.cc:1397] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.026s
I20260928 10:44:11.183576 6090 leader_election.cc:302] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.183542 6988 consensus_queue.cc:1035] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.183916 7074 raft_consensus.cc:2781] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.184000 7074 raft_consensus.cc:482] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.184072 7074 raft_consensus.cc:3037] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.184231 6273 raft_consensus.cc:348] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.184471 6273 raft_consensus.cc:374] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.184552 6273 raft_consensus.cc:729] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.184680 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 4a5564088c5e45788794f130134b5ba5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.184764 6273 consensus_queue.cc:260] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.185276 6273 ts_tablet_manager.cc:1428] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.185572 6273 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.186419 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.187587 6273 tablet_bootstrap.cc:654] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.187968 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:11.189388 6275 tablet_bootstrap.cc:654] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:11.191712 6091 leader_election.cc:341] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: ecb1d807c9f04fe4b02e3343f0c6511c
W20260928 10:44:11.192390 6091 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 3d5b422c70a84cc0bc9f8a686f4e2c82
W20260928 10:44:11.192791 5817 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.192917 5817 leader_election.cc:302] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.193145 7205 raft_consensus.cc:2726] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:11.193296 5817 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.195762 5694 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:11.195976 5694 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 43d5479a2ce44c20a9437720820f3cec (table default.Table_7c2b9260216f400fb44101905b2c3c36 [id=1594b568b0ff4e288800f014304d6757]). Expected version 3 got 0
I20260928 10:44:11.198108 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.198367 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.198544 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.198686 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.199170 6270 ts_tablet_manager.cc:1918] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:11.199291 6270 log.cc:1196] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:11.199656 6270 ts_tablet_manager.cc:1939] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:11.199699 6273 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.199854 6273 ts_tablet_manager.cc:1397] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260928 10:44:11.199930 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.200709 6273 raft_consensus.cc:348] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.200968 6273 raft_consensus.cc:374] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.201053 6273 raft_consensus.cc:729] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.201054 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.201295 6273 consensus_queue.cc:260] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.201876 6273 ts_tablet_manager.cc:1428] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.202358 6273 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.203830 6273 tablet_bootstrap.cc:654] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.216176 6275 tablet_bootstrap.cc:492] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.216372 6275 ts_tablet_manager.cc:1397] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260928 10:44:11.217213 6275 raft_consensus.cc:348] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.217447 6275 raft_consensus.cc:374] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.217517 6275 raft_consensus.cc:729] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.217796 6275 consensus_queue.cc:260] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.220605 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 699) took 4569 ms. Trace:
I20260928 10:44:11.220920 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.221124 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.221199 6275 ts_tablet_manager.cc:1428] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:11.221688 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecb1d807c9f04fe4b02e3343f0c6511c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.222306 6275 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.223980 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:11.226553 6018 raft_consensus.cc:3037] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.228291 7205 raft_consensus.cc:482] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.220747 6269 rpcz_store.cc:276] 0928 10:44:06.650913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.651313 (+ 400us) service_pool.cc:227] Handling call
0928 10:44:11.220399 (+4569086us) ts_tablet_manager.cc:1145] Deleting tablet 474e9ca2deb1478a87c978d1e119fa5f
0928 10:44:11.220413 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.220536 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4568926}
I20260928 10:44:11.228641 6275 tablet_bootstrap.cc:654] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.228510 7205 raft_consensus.cc:504] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.229183 7205 leader_election.cc:288] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.229235 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 700) took 4578 ms. Trace:
I20260928 10:44:11.229453 6269 rpcz_store.cc:276] 0928 10:44:06.651029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.651288 (+ 259us) service_pool.cc:227] Handling call
0928 10:44:11.229030 (+4577742us) ts_tablet_manager.cc:1145] Deleting tablet 946188e312c6424f81926465667b5e11
0928 10:44:11.229043 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.229155 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4577477}
I20260928 10:44:11.229822 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.230073 6019 raft_consensus.cc:3037] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.230822 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.231017 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 474e9ca2deb1478a87c978d1e119fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e9ca2deb1478a87c978d1e119fa5f already in progress: creating tablet
I20260928 10:44:11.232681 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ddd0439f5f6d4323978bb5fe2d039f75
I20260928 10:44:11.233042 6976 raft_consensus.cc:482] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.233214 6976 raft_consensus.cc:504] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.233839 6976 leader_election.cc:288] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.234738 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:11.235230 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:11.235409 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c322d11fab43499f82e077fd8a8c02f3 (table default.Table_0796215bba1f4ecc85937aef3b01bee7 [id=07eac26ccf134fb5b9bcc53ba57eb067]). Expected version 1 got 0
I20260928 10:44:11.236075 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 104a223ec6ef47988d0aa3335a1f81de from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.236193 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 45a00a2c4692459cbdd0628af0184f09 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.236788 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bc5d744dbc904525858a39c27636443e
W20260928 10:44:11.239535 6091 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:11.239682 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5d744dbc904525858a39c27636443e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.239144 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.240226 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.240387 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet bae5a2038947413f95f134602081c889 with delete_type TABLET_DATA_DELETED (replaced by tablet b820ef6381c44b44a4d4e3ebb9f99802) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.240572 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.235232 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d4da5ccb214a4bbc543c67529b59cf" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.243404 6021 raft_consensus.cc:2454] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.237810 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.244577 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet add5cbcbede9481494444371b44b5ab6 consensus state has no leader
I20260928 10:44:11.244578 6272 ts_tablet_manager.cc:1918] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:11.244730 6272 log.cc:1196] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/72a0adec506e4ca9b10989f18d6c0c22
I20260928 10:44:11.245146 6272 ts_tablet_manager.cc:1939] T 72a0adec506e4ca9b10989f18d6c0c22 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:11.240787 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5d744dbc904525858a39c27636443e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:11.231539 5817 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.238114 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5d744dbc904525858a39c27636443e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.238404 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:11.246048 5818 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.246258 5818 leader_election.cc:302] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.246659 7201 raft_consensus.cc:2726] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.246693 6090 leader_election.cc:302] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.245232 7205 raft_consensus.cc:482] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.246959 7205 raft_consensus.cc:504] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.247124 6976 raft_consensus.cc:2781] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.247210 6976 raft_consensus.cc:482] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.247306 6976 raft_consensus.cc:3037] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.247520 7205 leader_election.cc:288] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:11.248598 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 946188e312c6424f81926465667b5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946188e312c6424f81926465667b5e11 already in progress: creating tablet
I20260928 10:44:11.152745 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a973a1d20e3437c87ad889c723e7ebc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.249398 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.249794 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cb9f9c6d2a964f2591f62a0693cef5c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.250116 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5cd4c574cbc049038d93b2c1b85f0ceb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.250437 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb9f9c6d2a964f2591f62a0693cef5c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:11.250716 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cd4c574cbc049038d93b2c1b85f0ceb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.252187 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 650) took 5663 ms. Trace:
I20260928 10:44:11.252285 6270 rpcz_store.cc:276] 0928 10:44:05.588664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.588710 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:10.836964 (+5248254us) ts_tablet_manager.cc:1145] Deleting tablet 48ccd7551f6a4fc8b41e70e94749e6f1
0928 10:44:10.836977 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:10.983803 (+146826us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.199051 (+215248us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.252155 (+ 53104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5233587}
W20260928 10:44:11.252422 5818 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.252699 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 668) took 5512 ms. Trace:
I20260928 10:44:11.253793 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_87f60777a09c47299a48851d4774c1c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.254351 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87f60777a09c47299a48851d4774c1c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.255692 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (table default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]) successfully deleted
I20260928 10:44:11.256912 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d44a54bafba54a7695918e49e2da9dec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.257443 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d44a54bafba54a7695918e49e2da9dec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.240944 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet ddd0439f5f6d4323978bb5fe2d039f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.260259 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4d8ef7a42dd64e22b5231719906319db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.260861 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d8ef7a42dd64e22b5231719906319db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.260748 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6ca7a0abc0e848c0884ef93ec7363e84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.261512 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ca7a0abc0e848c0884ef93ec7363e84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.263178 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 702) took 4611 ms. Trace:
I20260928 10:44:11.263667 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4a5564088c5e45788794f130134b5ba5
I20260928 10:44:11.263648 6269 rpcz_store.cc:276] 0928 10:44:06.651231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.659304 (+ 8073us) service_pool.cc:227] Handling call
0928 10:44:11.262573 (+4603269us) ts_tablet_manager.cc:1145] Deleting tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4
0928 10:44:11.262586 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.263106 (+ 520us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4602982}
W20260928 10:44:11.264246 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 already in progress: creating tablet
I20260928 10:44:11.264688 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 701) took 4613 ms. Trace:
I20260928 10:44:11.265050 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_91be0f66e619422c865c1ec44ab5e9ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.265395 6269 rpcz_store.cc:276] 0928 10:44:06.651122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.651596 (+ 474us) service_pool.cc:227] Handling call
0928 10:44:11.264535 (+4612939us) ts_tablet_manager.cc:1145] Deleting tablet bc7aa301bfbb4097b386a0d23cfa91e1
0928 10:44:11.264546 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.264635 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4604622}
I20260928 10:44:11.265754 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a5564088c5e45788794f130134b5ba5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0e3177956744198b74adbd2c31dbed) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.252781 6270 rpcz_store.cc:276] 0928 10:44:05.740676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.740809 (+ 133us) service_pool.cc:227] Handling call
0928 10:44:11.252554 (+5511745us) ts_tablet_manager.cc:1145] Deleting tablet 30fb3f88e66b4f8582fb348e035af290
0928 10:44:11.252566 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.252681 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5508648}
I20260928 10:44:11.266119 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a5564088c5e45788794f130134b5ba5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0e3177956744198b74adbd2c31dbed) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.266444 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 669) took 5521 ms. Trace:
I20260928 10:44:11.266599 6270 rpcz_store.cc:276] 0928 10:44:05.744886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.744958 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:11.266317 (+5521359us) ts_tablet_manager.cc:1145] Deleting tablet 734c09c7645c4dd3a05f6508297ee48b
0928 10:44:11.266328 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.266428 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5515228}
I20260928 10:44:11.267112 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 670) took 5520 ms. Trace:
I20260928 10:44:11.267315 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 703) took 4467 ms. Trace:
I20260928 10:44:11.267270 6270 rpcz_store.cc:276] 0928 10:44:05.746864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.746935 (+ 71us) service_pool.cc:227] Handling call
0928 10:44:11.267006 (+5520071us) ts_tablet_manager.cc:1145] Deleting tablet 9cc439f216a04f2e861c2d87364eb3dd
0928 10:44:11.267016 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.267098 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5512754}
I20260928 10:44:11.265971 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 4a5564088c5e45788794f130134b5ba5 deleted and replaced by tablet 5c0e3177956744198b74adbd2c31dbed
W20260928 10:44:11.266165 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 30fb3f88e66b4f8582fb348e035af290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fb3f88e66b4f8582fb348e035af290 already in progress: creating tablet
I20260928 10:44:11.267681 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 672) took 5512 ms. Trace:
I20260928 10:44:11.267750 6270 rpcz_store.cc:276] 0928 10:44:05.755520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.755678 (+ 158us) service_pool.cc:227] Handling call
0928 10:44:11.267575 (+5511897us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:11.267584 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.267666 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5508391}
W20260928 10:44:11.267835 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91be0f66e619422c865c1ec44ab5e9ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.268247 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 671) took 5514 ms. Trace:
I20260928 10:44:11.268337 6270 rpcz_store.cc:276] 0928 10:44:05.753452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.753577 (+ 125us) service_pool.cc:227] Handling call
0928 10:44:11.268090 (+5514513us) ts_tablet_manager.cc:1145] Deleting tablet 66f13643dbb64dcf97c4d6d94c22d8b1
0928 10:44:11.268103 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.268230 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5498086}
W20260928 10:44:11.268585 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 734c09c7645c4dd3a05f6508297ee48b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 734c09c7645c4dd3a05f6508297ee48b already in progress: creating tablet
I20260928 10:44:11.268658 6270 tablet_replica.cc:330] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:11.268814 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9cc439f216a04f2e861c2d87364eb3dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cc439f216a04f2e861c2d87364eb3dd already in progress: creating tablet
I20260928 10:44:11.268831 6270 raft_consensus.cc:2229] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.268998 6270 raft_consensus.cc:2258] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:11.269006 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b6d5121db2d34ea99c851595c395f3be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6d5121db2d34ea99c851595c395f3be already in progress: creating tablet
I20260928 10:44:11.268967 6269 rpcz_store.cc:276] 0928 10:44:06.800293 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.800366 (+ 73us) service_pool.cc:227] Handling call
0928 10:44:11.267168 (+4466802us) ts_tablet_manager.cc:1145] Deleting tablet 7ef1b939f9aa4f988180d5ea0a4a8a15
0928 10:44:11.267178 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.267258 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4465153}
W20260928 10:44:11.269209 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f13643dbb64dcf97c4d6d94c22d8b1 already in progress: creating tablet
I20260928 10:44:11.269510 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 704) took 4456 ms. Trace:
I20260928 10:44:11.269611 6270 ts_tablet_manager.cc:1905] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:11.267027 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet bc7aa301bfbb4097b386a0d23cfa91e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7aa301bfbb4097b386a0d23cfa91e1 already in progress: creating tablet
I20260928 10:44:11.248951 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.269735 6269 rpcz_store.cc:276] 0928 10:44:06.812978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.813048 (+ 70us) service_pool.cc:227] Handling call
0928 10:44:11.269348 (+4456300us) ts_tablet_manager.cc:1145] Deleting tablet ab5abdd2484f41d7bd244db14d2b1916
0928 10:44:11.269359 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.269449 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4456038}
I20260928 10:44:11.260506 7106 raft_consensus.cc:504] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:11.270006 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 already in progress: creating tablet
W20260928 10:44:11.270202 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ab5abdd2484f41d7bd244db14d2b1916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5abdd2484f41d7bd244db14d2b1916 already in progress: creating tablet
W20260928 10:44:11.270324 5817 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.270447 5817 leader_election.cc:302] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.270509 7106 leader_election.cc:288] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.270959 7205 raft_consensus.cc:2726] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.264528 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a5564088c5e45788794f130134b5ba5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0e3177956744198b74adbd2c31dbed) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.271770 6269 tablet_replica.cc:330] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:11.271941 6091 leader_election.cc:341] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 82b3afe074194023ba788094a2a6b81c
I20260928 10:44:11.272027 6269 raft_consensus.cc:2229] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.272228 6269 raft_consensus.cc:2258] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.273437 6269 ts_tablet_manager.cc:1905] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.273898 7106 consensus_queue.cc:1035] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.277660 7205 raft_consensus.cc:482] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.277817 7205 raft_consensus.cc:504] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.270916 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b3afe074194023ba788094a2a6b81c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
W20260928 10:44:11.271221 5955 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.278870 7205 leader_election.cc:288] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.278923 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.278980 5955 leader_election.cc:302] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.279774 6020 raft_consensus.cc:3037] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:11.281114 5818 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.281323 7029 raft_consensus.cc:2726] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.282677 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.283293 5817 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.283417 5817 leader_election.cc:302] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.283805 7205 raft_consensus.cc:2726] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.288810 7205 raft_consensus.cc:482] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.288968 7205 raft_consensus.cc:504] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.289564 7205 leader_election.cc:288] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.290364 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.226383 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3168fb311ee64931bd326b043a397ea1 (table default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7]). Expected version 1 got 0
I20260928 10:44:11.291246 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
W20260928 10:44:11.291282 5817 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.295717 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.296298 5818 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.296424 5818 leader_election.cc:302] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.296654 7205 raft_consensus.cc:2726] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.301201 7029 raft_consensus.cc:482] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.301365 7029 raft_consensus.cc:504] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.301905 6113 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 162) took 1187 ms. Trace:
I20260928 10:44:11.302021 7029 leader_election.cc:288] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.302017 6113 rpcz_store.cc:276] 0928 10:44:10.114034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.114102 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:10.128574 (+ 14472us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x61500013de24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.234090 (+105516us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x6150001089a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.454422 (+220332us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x6150000373a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:10.754902 (+300480us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x6150001255a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:11.301874 (+546972us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1458005248}
W20260928 10:44:11.303399 5957 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9e05cdd590894adcb987ef3ac78bf416
I20260928 10:44:11.310317 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e05cdd590894adcb987ef3ac78bf416" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.312414 5955 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.312595 5955 leader_election.cc:302] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.312878 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:11.301232 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 88f81c47745142568f7a4dd30d468220
I20260928 10:44:11.310307 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0c283584d125415e848f4d61a2838a78" } modify_external_catalogs: true
I20260928 10:44:11.313906 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f81c47745142568f7a4dd30d468220 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.314260 7029 raft_consensus.cc:2726] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.315243 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f81c47745142568f7a4dd30d468220 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.315548 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f81c47745142568f7a4dd30d468220 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.313423 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0c283584d125415e848f4d61a2838a78" } modify_external_catalogs: true
I20260928 10:44:11.310712 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_988aa420fecd47ddb39944580036195a" } modify_external_catalogs: true
I20260928 10:44:11.316497 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_988aa420fecd47ddb39944580036195a" } modify_external_catalogs: true
I20260928 10:44:11.319959 6271 raft_consensus.cc:348] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.320892 6271 raft_consensus.cc:374] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.321558 6275 tablet_bootstrap.cc:492] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.321699 6275 ts_tablet_manager.cc:1397] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.000s
I20260928 10:44:11.323509 7184 raft_consensus.cc:482] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.324275 7184 raft_consensus.cc:504] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.324971 7184 leader_election.cc:288] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.325398 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.325995 5817 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.326337 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.328848 6271 raft_consensus.cc:729] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.329088 6271 consensus_queue.cc:260] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:11.329478 5818 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.329597 5818 leader_election.cc:302] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.329833 6271 ts_tablet_manager.cc:1428] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.179s user 0.002s sys 0.000s
I20260928 10:44:11.330099 6271 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.330322 7184 raft_consensus.cc:2726] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.332473 6273 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.332825 6273 ts_tablet_manager.cc:1397] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.131s user 0.014s sys 0.026s
I20260928 10:44:11.333711 6273 raft_consensus.cc:348] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.334021 6273 raft_consensus.cc:374] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.334134 6273 raft_consensus.cc:729] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.334455 6273 consensus_queue.cc:260] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.335127 6273 ts_tablet_manager.cc:1428] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:11.335166 6275 raft_consensus.cc:348] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.335377 6275 raft_consensus.cc:374] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.335433 6275 raft_consensus.cc:729] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.335522 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 6bfcdaa9d8bf45c98411cf0e6febd294 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.335670 6275 consensus_queue.cc:260] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.336412 6273 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.338274 6273 tablet_bootstrap.cc:654] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.341631 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet bd225da0b4b445c6ac03634d975e8396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.346890 6273 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.347168 6273 ts_tablet_manager.cc:1397] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20260928 10:44:11.348277 6273 raft_consensus.cc:348] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.348654 6273 raft_consensus.cc:374] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.348816 6273 raft_consensus.cc:729] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.349407 6273 consensus_queue.cc:260] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.350574 6273 ts_tablet_manager.cc:1428] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:11.350914 6273 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.353034 6273 tablet_bootstrap.cc:654] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.357456 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2df1933315314f7394f4f47e678c4645" } new_table_name: "default.Table_24fe230debec4239b8c473528085c2ed" modify_external_catalogs: true
I20260928 10:44:11.358251 7074 raft_consensus.cc:504] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.358923 7074 leader_election.cc:288] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.359241 6020 raft_consensus.cc:2454] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.360813 6269 ts_tablet_manager.cc:1918] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.360946 6269 log.cc:1196] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9afe3c828c9747958a7c558716643007
I20260928 10:44:11.361229 6269 ts_tablet_manager.cc:1939] T 9afe3c828c9747958a7c558716643007 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.364074 6018 raft_consensus.cc:2454] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.367755 6019 raft_consensus.cc:2454] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:11.368583 5818 leader_election.cc:302] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.369114 6090 leader_election.cc:302] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.369535 6090 leader_election.cc:302] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.370195 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5b422c70a84cc0bc9f8a686f4e2c82" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.370456 6018 raft_consensus.cc:3037] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.371295 6275 ts_tablet_manager.cc:1428] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.050s user 0.002s sys 0.001s
I20260928 10:44:11.371577 6275 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.373049 6018 raft_consensus.cc:2454] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.373271 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b2251f8b3e7e4810b33f0c06a9fe935c" } new_table_name: "default.Table_92ad2ddc81c049f9a6338ba4475638fc" modify_external_catalogs: true
I20260928 10:44:11.373857 7184 raft_consensus.cc:2781] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.374017 7184 raft_consensus.cc:686] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:11.374298 7184 consensus_queue.cc:237] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.375550 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a11e380b1c87489488dab8b4580b38aa" } new_table_name: "default.Table_07a491f5601a415da804396878fbc6e3" modify_external_catalogs: true
I20260928 10:44:11.376035 7074 raft_consensus.cc:2781] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.376153 7074 raft_consensus.cc:686] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.376375 7074 consensus_queue.cc:237] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.376634 7226 raft_consensus.cc:2781] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.376754 7226 raft_consensus.cc:686] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.376935 7226 consensus_queue.cc:237] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.377759 6275 tablet_bootstrap.cc:654] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:11.377976 6091 leader_election.cc:341] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:11.379487 6271 tablet_bootstrap.cc:654] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.380128 6090 leader_election.cc:302] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.380530 7106 raft_consensus.cc:2781] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.380628 7106 raft_consensus.cc:686] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.380808 7106 consensus_queue.cc:237] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.381122 6976 raft_consensus.cc:504] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.381752 6976 leader_election.cc:288] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.380373 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_550e45812a914de2bf9f3d979383be3e" } new_table_name: "default.Table_fbc9cdd536da4daa901a68955a40c424" modify_external_catalogs: true
I20260928 10:44:11.381934 7205 raft_consensus.cc:482] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.382067 7205 raft_consensus.cc:504] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.382678 7205 leader_election.cc:288] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.382894 6976 raft_consensus.cc:482] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.383011 6976 raft_consensus.cc:504] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.383482 6976 leader_election.cc:288] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.384002 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.384564 5817 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.385720 6091 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c2635c7c47ba4383b6b0f07cd3b42f74
W20260928 10:44:11.385900 6091 leader_election.cc:341] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:11.386667 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2635c7c47ba4383b6b0f07cd3b42f74" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.386921 6020 raft_consensus.cc:2454] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.387198 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d4da5ccb214a4bbc543c67529b59cf" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.387396 6019 raft_consensus.cc:3037] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.390862 6090 leader_election.cc:302] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.392279 7074 raft_consensus.cc:2781] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.392354 7074 raft_consensus.cc:482] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.392409 7074 raft_consensus.cc:3037] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.394747 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.395377 5818 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.395532 5818 leader_election.cc:302] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.395922 7205 raft_consensus.cc:2726] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.402851 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 705) took 4569 ms. Trace:
I20260928 10:44:11.403003 6269 rpcz_store.cc:276] 0928 10:44:06.833181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.833252 (+ 71us) service_pool.cc:227] Handling call
0928 10:44:11.271670 (+4438418us) ts_tablet_manager.cc:1145] Deleting tablet 9afe3c828c9747958a7c558716643007
0928 10:44:11.271680 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.357671 (+ 85991us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.360680 (+ 3009us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.402450 (+ 41770us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4438177}
I20260928 10:44:11.403381 6269 tablet_replica.cc:330] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:11.403493 6019 raft_consensus.cc:2454] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.403601 6269 raft_consensus.cc:2229] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.403749 6269 raft_consensus.cc:2258] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.404080 6090 leader_election.cc:302] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.404359 6269 ts_tablet_manager.cc:1905] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.404733 6976 raft_consensus.cc:2781] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.404856 6976 raft_consensus.cc:686] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.405165 6976 consensus_queue.cc:237] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.406572 7074 raft_consensus.cc:504] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.406985 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9afe3c828c9747958a7c558716643007 (table default.Table_72fa42e53bb14b278e9f91b8c5276960 [id=b9fd4743707c40a9bbfb44b1d14bfe90]) successfully deleted
I20260928 10:44:11.407688 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2635c7c47ba4383b6b0f07cd3b42f74" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.407907 6019 raft_consensus.cc:3037] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.408684 5695 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_7c2b9260216f400fb44101905b2c3c36 [id=1594b568b0ff4e288800f014304d6757] alter complete (version 3)
W20260928 10:44:11.408702 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8389880591441a9c2aabf22d67005f consensus state has no leader
W20260928 10:44:11.409201 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4706d214d3184f4ebcec28f609b00a53 consensus state has no leader
I20260928 10:44:11.410442 7029 raft_consensus.cc:482] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.410640 7029 raft_consensus.cc:504] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.411279 7029 leader_election.cc:288] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:11.411535 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 871fb70fea304b08bebce18c60998209 consensus state has no leader
I20260928 10:44:11.412973 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b6bf7ae81883467095a04ff22fe0c7f8
W20260928 10:44:11.413139 5957 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a25c7f3b94e94cafb3275a2e190be0ed
W20260928 10:44:11.414011 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 977064ff0d5e4186b3e2556367c60805 consensus state has no leader
I20260928 10:44:11.414554 7106 raft_consensus.cc:482] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.414609 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.414690 7106 raft_consensus.cc:504] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.414983 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.415083 6019 raft_consensus.cc:2454] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.415457 6090 leader_election.cc:302] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.415686 7226 raft_consensus.cc:2781] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.415798 7226 raft_consensus.cc:686] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.416030 7106 leader_election.cc:288] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.415984 7226 consensus_queue.cc:237] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.413686 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25c7f3b94e94cafb3275a2e190be0ed" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.417140 6091 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:11.420135 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:11.420253 7074 leader_election.cc:288] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:11.421593 6091 leader_election.cc:341] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c2635c7c47ba4383b6b0f07cd3b42f74
I20260928 10:44:11.421792 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:11.422392 5955 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.422555 5955 leader_election.cc:302] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.423035 7029 raft_consensus.cc:2726] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.423257 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.423365 6269 ts_tablet_manager.cc:1918] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.423462 6269 log.cc:1196] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:11.424950 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bd99e7bdb647ceb9357f88affc45d9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.425218 6018 raft_consensus.cc:2454] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.425382 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet b6bf7ae81883467095a04ff22fe0c7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.425604 6090 leader_election.cc:302] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.425990 7106 raft_consensus.cc:482] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.426107 7106 raft_consensus.cc:504] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.426661 7106 leader_election.cc:288] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.426781 7106 raft_consensus.cc:2781] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.426834 7106 raft_consensus.cc:482] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.426887 7106 raft_consensus.cc:3037] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.428510 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.429447 7106 raft_consensus.cc:504] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.429737 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.430022 7106 leader_election.cc:288] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:11.431579 6091 leader_election.cc:341] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 98bd99e7bdb647ceb9357f88affc45d9
W20260928 10:44:11.431946 6091 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:11.434113 6269 ts_tablet_manager.cc:1939] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.435540 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 706) took 4502 ms. Trace:
I20260928 10:44:11.435564 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.435915 6152 raft_consensus.cc:3037] T 2187fe4785f9466eb7ed729a4e0407f2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.435905 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104a223ec6ef47988d0aa3335a1f81de" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.436167 6019 raft_consensus.cc:2454] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.436532 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.440366 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ef64e1c90a20476a862995f090d61442"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.440771 6090 leader_election.cc:302] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:11.441035 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef64e1c90a20476a862995f090d61442 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.441011 7029 consensus_queue.cc:1035] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.442741 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_94ac43322633474fba62c1a5be97085b" } modify_external_catalogs: true
I20260928 10:44:11.442950 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_94ac43322633474fba62c1a5be97085b" } modify_external_catalogs: true
I20260928 10:44:11.439934 7184 raft_consensus.cc:482] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.438180 6269 rpcz_store.cc:276] 0928 10:44:06.933581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.933649 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:11.403326 (+4469677us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5590c0fd47fdbf44e5217b8d0be6
0928 10:44:11.403339 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.419864 (+ 16525us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.423273 (+ 3409us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.435514 (+ 12241us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4469365}
I20260928 10:44:11.443780 7184 raft_consensus.cc:504] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.444267 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (table default.Table_fb25cc33ccfb474ca51b0db8e1b167f7 [id=620121bbc5c641b792d823560616b120]) successfully deleted
I20260928 10:44:11.444417 7184 leader_election.cc:288] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.444535 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d740f4b774d24747abdc1a2bbf45b43c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.444963 6269 tablet_replica.cc:330] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:11.445106 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d740f4b774d24747abdc1a2bbf45b43c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.445170 6269 raft_consensus.cc:2229] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.445317 6269 raft_consensus.cc:2258] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.447407 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bd99e7bdb647ceb9357f88affc45d9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.447705 6018 raft_consensus.cc:3037] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.447921 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7fef88bbff7b455e8425afae90011244"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.448426 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fef88bbff7b455e8425afae90011244 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.448849 7029 raft_consensus.cc:482] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.449054 6269 ts_tablet_manager.cc:1905] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.448992 7029 raft_consensus.cc:504] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.449613 7029 leader_election.cc:288] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.450214 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_62a7f4dbf79f4e048a37852a9c780a55" } new_table_name: "default.Table_d218864d94134c1f991aea4eda089223" modify_external_catalogs: true
I20260928 10:44:11.450333 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb5eed4318fe482789fee32e24a49bfc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.451329 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fe170946878a4e9abe047ae72c9e95bb" } modify_external_catalogs: true
I20260928 10:44:11.451550 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fe170946878a4e9abe047ae72c9e95bb" } modify_external_catalogs: true
I20260928 10:44:11.452294 6018 raft_consensus.cc:2454] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.452839 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:11.453044 5883 raft_consensus.cc:2454] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:11.453533 5957 leader_election.cc:302] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:11.453858 7029 raft_consensus.cc:2781] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.453967 7029 raft_consensus.cc:482] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.454046 7029 raft_consensus.cc:3037] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:11.455310 5817 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.455969 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e9c596f9cd28453883d0299e698fba31
I20260928 10:44:11.456826 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet e9c596f9cd28453883d0299e698fba31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.456943 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet e9c596f9cd28453883d0299e698fba31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.456945 7029 raft_consensus.cc:504] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.457921 7029 leader_election.cc:288] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.458155 6273 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.458171 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet e9c596f9cd28453883d0299e698fba31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.458288 6273 ts_tablet_manager.cc:1397] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.107s user 0.005s sys 0.000s
I20260928 10:44:11.458418 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:11.458627 5883 raft_consensus.cc:3037] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.461225 5883 raft_consensus.cc:2454] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:11.463768 5957 leader_election.cc:302] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:11.464273 6090 leader_election.cc:302] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.464718 6273 raft_consensus.cc:348] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.464936 6273 raft_consensus.cc:374] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.464977 6273 raft_consensus.cc:729] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.464977 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.465191 6273 consensus_queue.cc:260] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.465620 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:11.468053 7106 raft_consensus.cc:2781] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.468179 7106 raft_consensus.cc:482] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.468261 7106 raft_consensus.cc:3037] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.469149 6273 ts_tablet_manager.cc:1428] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20260928 10:44:11.469128 5955 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.469466 5955 leader_election.cc:341] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.469806 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5d6f388d56f04696940caef30b213ca6 (table default.Table_55bab94bf4ee420aa5635c934e28f9cf [id=3f375f4cb4f34d57a8a5d38d8655325d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5d6f388d56f04696940caef30b213ca6 consensus state has no leader
I20260928 10:44:11.470337 6269 ts_tablet_manager.cc:1918] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.470467 6269 log.cc:1196] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c1e7257c8b114e80853ff0a108d2998a
I20260928 10:44:11.470643 7074 raft_consensus.cc:2781] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.470747 7074 raft_consensus.cc:686] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.470779 6269 ts_tablet_manager.cc:1939] T c1e7257c8b114e80853ff0a108d2998a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.471472 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 720) took 4266 ms. Trace:
I20260928 10:44:11.474843 7029 raft_consensus.cc:2781] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.475167 7029 raft_consensus.cc:686] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:11.475675 7029 consensus_queue.cc:237] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.473822 6273 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.483157 7074 consensus_queue.cc:237] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.483362 6269 rpcz_store.cc:276] 0928 10:44:07.205365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.205416 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:11.444912 (+4239496us) ts_tablet_manager.cc:1145] Deleting tablet c1e7257c8b114e80853ff0a108d2998a
0928 10:44:11.444926 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.454283 (+ 9357us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.470234 (+ 15951us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.471450 (+ 1216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4239286}
I20260928 10:44:11.483798 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb5eed4318fe482789fee32e24a49bfc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.484197 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c1e7257c8b114e80853ff0a108d2998a (table default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]) successfully deleted
I20260928 10:44:11.484623 6269 tablet_replica.cc:330] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:11.484658 5818 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.484776 6273 tablet_bootstrap.cc:654] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.484994 5818 leader_election.cc:302] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.485673 7205 raft_consensus.cc:2726] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.473277 7106 raft_consensus.cc:504] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.488338 7106 leader_election.cc:288] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.488945 6273 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.489087 6273 ts_tablet_manager.cc:1397] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20260928 10:44:11.489253 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104a223ec6ef47988d0aa3335a1f81de" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.489506 6019 raft_consensus.cc:3037] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.489802 6273 raft_consensus.cc:348] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.489995 6273 raft_consensus.cc:374] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.490042 6273 raft_consensus.cc:729] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.490209 6273 consensus_queue.cc:260] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.490885 6273 ts_tablet_manager.cc:1428] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.491132 6273 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:11.492681 6091 leader_election.cc:341] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:11.494551 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d01628428c474d53bd927e62b6c11cb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.495074 6270 ts_tablet_manager.cc:1918] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.495235 6270 log.cc:1196] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d257233e5b934d619e2289a6df55d65a
I20260928 10:44:11.495565 6270 ts_tablet_manager.cc:1939] T d257233e5b934d619e2289a6df55d65a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:11.495792 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d01628428c474d53bd927e62b6c11cb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.496417 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 673) took 5604 ms. Trace:
I20260928 10:44:11.496516 6270 rpcz_store.cc:276] 0928 10:44:05.891731 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.891886 (+ 155us) service_pool.cc:227] Handling call
0928 10:44:11.268618 (+5376732us) ts_tablet_manager.cc:1145] Deleting tablet d257233e5b934d619e2289a6df55d65a
0928 10:44:11.268627 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.363042 (+ 94415us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.494965 (+131923us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.496328 (+ 1363us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5376533}
I20260928 10:44:11.497153 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d257233e5b934d619e2289a6df55d65a (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:11.497423 6273 tablet_bootstrap.cc:654] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.498291 6270 tablet_replica.cc:330] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:11.498540 6270 raft_consensus.cc:2229] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.498754 6270 raft_consensus.cc:2258] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.499354 6270 ts_tablet_manager.cc:1905] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.499197 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f7e51d1848f14067b414b283f4d0b0f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.499805 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7e51d1848f14067b414b283f4d0b0f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.503763 7205 raft_consensus.cc:482] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.503957 7205 raft_consensus.cc:504] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.504608 7205 leader_election.cc:288] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.505292 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.505920 5817 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.506359 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.508493 7168 raft_consensus.cc:482] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.508685 7168 raft_consensus.cc:504] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:11.509029 5818 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.509176 5818 leader_election.cc:302] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.509370 7168 leader_election.cc:288] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.509435 7205 raft_consensus.cc:2726] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.510092 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "122fbbe54c174c4ea9cf38698debcb27" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.510787 5955 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.511085 6273 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.511229 6273 ts_tablet_manager.cc:1397] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.005s
W20260928 10:44:11.511735 5957 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:11.511850 5957 leader_election.cc:302] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.511919 6273 raft_consensus.cc:348] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.512111 6273 raft_consensus.cc:374] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.512233 7168 raft_consensus.cc:2726] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.513062 6273 raft_consensus.cc:729] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:11.513566 6090 consensus_peers.cc:487] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48ccd7551f6a4fc8b41e70e94749e6f1. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:11.515895 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c7cce0e772e4e8aae5b56350834cee2 consensus state has no leader
I20260928 10:44:11.516487 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_20f019efc3ad49f68c52e6044f37f295"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.516712 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_041e55375217446e8377abc4545d30ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.517271 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_041e55375217446e8377abc4545d30ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:11.517280 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20f019efc3ad49f68c52e6044f37f295 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.520347 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8eb54f93fe9642bba738cebf0a9d82bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.521019 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eb54f93fe9642bba738cebf0a9d82bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.523360 6273 consensus_queue.cc:260] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.529573 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:11.530107 6988 raft_consensus.cc:482] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.530308 6988 raft_consensus.cc:504] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.531755 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.532212 7233 log.cc:924] Time spent T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Append to log took a long time: real 0.130s user 0.000s sys 0.001s
I20260928 10:44:11.532346 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84912292d6c34a3991bd0f885de240a8" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:11.532584 5883 raft_consensus.cc:2379] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:11.533223 6988 leader_election.cc:288] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.533447 6988 raft_consensus.cc:482] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.533609 6988 raft_consensus.cc:504] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.534806 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd225da0b4b445c6ac03634d975e8396" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.535082 6018 raft_consensus.cc:2454] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.535575 6090 leader_election.cc:302] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.535975 6091 leader_election.cc:302] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.536208 7238 raft_consensus.cc:2781] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.536275 7238 raft_consensus.cc:482] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.536337 7238 raft_consensus.cc:3037] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.536448 7106 raft_consensus.cc:3037] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.537426 6273 ts_tablet_manager.cc:1428] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260928 10:44:11.537812 6273 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.539366 7106 raft_consensus.cc:2726] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.540784 6988 leader_election.cc:288] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.544456 7250 consensus_queue.cc:1035] T 2187fe4785f9466eb7ed729a4e0407f2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:11.544651 6091 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bd225da0b4b445c6ac03634d975e8396
I20260928 10:44:11.547806 6271 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.548063 6271 ts_tablet_manager.cc:1397] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.218s user 0.004s sys 0.001s
I20260928 10:44:11.549021 6271 raft_consensus.cc:348] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.549377 6271 raft_consensus.cc:374] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.549510 6271 raft_consensus.cc:729] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.549847 6271 consensus_queue.cc:260] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.550624 6271 ts_tablet_manager.cc:1428] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.554453 6273 tablet_bootstrap.cc:654] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.485035 6269 raft_consensus.cc:2229] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:11.556099 6269 pending_rounds.cc:62] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Trying to abort 1 pending ops.
I20260928 10:44:11.558705 7029 consensus_queue.cc:1035] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.559417 6269 pending_rounds.cc:68] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265861631700992 op_type: NO_OP noop_request { }
I20260928 10:44:11.559640 6269 raft_consensus.cc:2866] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:11.559814 6269 raft_consensus.cc:2258] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.562107 6273 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.562278 6273 ts_tablet_manager.cc:1397] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
I20260928 10:44:11.563081 6273 raft_consensus.cc:348] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.563298 6273 raft_consensus.cc:374] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.563355 6273 raft_consensus.cc:729] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.563555 6273 consensus_queue.cc:260] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.563807 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_135c07ef280d4a9b83f7529a30ce29fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.564208 6273 ts_tablet_manager.cc:1428] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.564234 6269 ts_tablet_manager.cc:1905] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:11.564417 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_135c07ef280d4a9b83f7529a30ce29fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.564474 6273 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.566689 6273 tablet_bootstrap.cc:654] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.567016 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_32c97b96f4e9497097370b07f7b9da83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.567651 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32c97b96f4e9497097370b07f7b9da83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.578553 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_94fba3a7181d44e7a0f5fb7e3931745a" } modify_external_catalogs: true
I20260928 10:44:11.578805 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_94fba3a7181d44e7a0f5fb7e3931745a" } modify_external_catalogs: true
I20260928 10:44:11.579870 7168 raft_consensus.cc:482] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.582268 7250 consensus_queue.cc:1035] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.584518 6976 consensus_queue.cc:1035] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.593981 6275 tablet_bootstrap.cc:492] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.594146 6275 ts_tablet_manager.cc:1397] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.223s user 0.002s sys 0.002s
I20260928 10:44:11.594985 6275 raft_consensus.cc:348] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.595216 6275 raft_consensus.cc:374] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.595275 6275 raft_consensus.cc:729] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.595491 6275 consensus_queue.cc:260] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.596232 6275 ts_tablet_manager.cc:1428] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.596503 6275 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.611567 6271 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.612079 7168 raft_consensus.cc:504] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.612819 7168 leader_election.cc:288] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.615036 7238 raft_consensus.cc:504] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.615475 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bf02637fcfba4e05ab5580423e5d0cfd" } new_table_name: "default.Table_9c334bacfa434b9aa29697243bf7364d" modify_external_catalogs: true
I20260928 10:44:11.615823 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5590c0fd47fdbf44e5217b8d0be6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.617184 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51b44c6d9a684eabbcde0c5855980627" } new_table_name: "default.Table_82a5e88072724fecbd1ce7d218831d75" modify_external_catalogs: true
I20260928 10:44:11.621083 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e82fc545ded548edbd67df9c7b88e916" } new_table_name: "default.Table_f749ec31fbb143ada086b86e63b56c08" modify_external_catalogs: true
I20260928 10:44:11.622151 7168 raft_consensus.cc:482] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.622308 7168 raft_consensus.cc:504] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.623023 7168 leader_election.cc:288] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.623930 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f60cfe53d8b48e981774ea02f9b0b63" } modify_external_catalogs: true
I20260928 10:44:11.624164 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9f60cfe53d8b48e981774ea02f9b0b63" } modify_external_catalogs: true
I20260928 10:44:11.627357 6275 tablet_bootstrap.cc:654] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:11.628476 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5eb089481e47455cb7387b0f17eda9fb consensus state has no leader
I20260928 10:44:11.631939 6271 tablet_bootstrap.cc:654] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.632121 7238 leader_election.cc:288] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.632480 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd225da0b4b445c6ac03634d975e8396" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.632692 6018 raft_consensus.cc:3037] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.632951 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54b78fbf508f4e47bd31661e05dcaa16" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.633677 5955 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.633852 5955 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.635608 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_24a55d53ffaa464a96c403e71be3f2e1" } new_table_name: "default.Table_6760d86bc4a84628ab87cad7bfb0731c" modify_external_catalogs: true
I20260928 10:44:11.636212 6018 raft_consensus.cc:2454] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.636936 6090 leader_election.cc:302] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.638286 7238 raft_consensus.cc:2781] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.638582 7238 raft_consensus.cc:686] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.641891 7263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.100.125:37939 every 8 connection(s)
I20260928 10:44:11.639320 7238 consensus_queue.cc:237] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.654585 6019 raft_consensus.cc:2454] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:11.655160 6090 leader_election.cc:302] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.656093 7226 raft_consensus.cc:2781] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.652068 6892 rpc_server.cc:307] RPC server started. Bound to: 127.5.100.125:37939
I20260928 10:44:11.656391 7205 raft_consensus.cc:482] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.656474 7226 raft_consensus.cc:686] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:11.656545 7205 raft_consensus.cc:504] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.656723 7226 consensus_queue.cc:237] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.657193 7205 leader_election.cc:288] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.658102 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.658999 5817 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.659507 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 716) took 4239 ms. Trace:
I20260928 10:44:11.659657 6272 rpcz_store.cc:276] 0928 10:44:07.420400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.420488 (+ 88us) service_pool.cc:227] Handling call
0928 10:44:10.156966 (+2736478us) ts_tablet_manager.cc:1145] Deleting tablet 72a0adec506e4ca9b10989f18d6c0c22
0928 10:44:10.156985 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.026718 (+869733us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.244436 (+217718us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.659489 (+415053us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2736234}
I20260928 10:44:11.660359 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 72a0adec506e4ca9b10989f18d6c0c22 (table default.Table_34437f380f6e451baa642895afcea0d9 [id=489e2ce035cb42c3ad1ed5ced42dcdc8]) successfully deleted
I20260928 10:44:11.660884 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 715) took 4240 ms. Trace:
I20260928 10:44:11.661044 6272 rpcz_store.cc:276] 0928 10:44:07.420266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.420788 (+ 522us) service_pool.cc:227] Handling call
0928 10:44:11.660757 (+4239969us) ts_tablet_manager.cc:1145] Deleting tablet 8d03d764256a4a8d9d8bb17b82fe8bda
0928 10:44:11.660770 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.660867 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4239799}
W20260928 10:44:11.661566 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8d03d764256a4a8d9d8bb17b82fe8bda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d03d764256a4a8d9d8bb17b82fe8bda already in progress: creating tablet
I20260928 10:44:11.661677 6892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-1/data/info.pb
I20260928 10:44:11.662034 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 733) took 4068 ms. Trace:
I20260928 10:44:11.662191 6272 rpcz_store.cc:276] 0928 10:44:07.593744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.593788 (+ 44us) service_pool.cc:227] Handling call
0928 10:44:11.661929 (+4068141us) ts_tablet_manager.cc:1145] Deleting tablet 10c23684385749e98359126cfd04b6f7
0928 10:44:11.661940 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.662018 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4067945}
W20260928 10:44:11.663533 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 10c23684385749e98359126cfd04b6f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c23684385749e98359126cfd04b6f7 already in progress: creating tablet
W20260928 10:44:11.663663 5955 consensus_peers.cc:487] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.664011 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 720) took 4074 ms. Trace:
I20260928 10:44:11.664178 6272 rpcz_store.cc:276] 0928 10:44:07.589906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.602696 (+ 12790us) service_pool.cc:227] Handling call
0928 10:44:11.663894 (+4061198us) ts_tablet_manager.cc:1145] Deleting tablet 0471473cce114d3985f9a8de2de77d39
0928 10:44:11.663905 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.663991 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060945}
W20260928 10:44:11.664669 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0471473cce114d3985f9a8de2de77d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0471473cce114d3985f9a8de2de77d39 already in progress: creating tablet
W20260928 10:44:11.664697 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1b89a8edd5645afa41693f5bca42f8d consensus state has no leader
I20260928 10:44:11.665584 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 736) took 4061 ms. Trace:
I20260928 10:44:11.666656 7205 raft_consensus.cc:482] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.666812 7205 raft_consensus.cc:504] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.667419 7205 leader_election.cc:288] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:11.667477 5957 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 54b78fbf508f4e47bd31661e05dcaa16
I20260928 10:44:11.667608 5957 leader_election.cc:302] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.667981 7029 raft_consensus.cc:2726] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.668159 5521 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu as pid 6892
I20260928 10:44:11.668735 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.669467 5957 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:11.669587 5957 leader_election.cc:302] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.669931 7029 raft_consensus.cc:2726] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:11.672763 5818 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.672880 5818 leader_election.cc:302] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:11.673283 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3d4024e567a4b978bb13dd4b201f440 consensus state has no leader
I20260928 10:44:11.673632 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2a81ff9471704a4ab5ddf72671322155" } modify_external_catalogs: true
I20260928 10:44:11.673823 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2a81ff9471704a4ab5ddf72671322155" } modify_external_catalogs: true
W20260928 10:44:11.674293 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aefce878fd0459c9c6502cfd226e2c7 consensus state has no leader
I20260928 10:44:11.683226 7184 raft_consensus.cc:2726] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.683884 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.688299 6269 ts_tablet_manager.cc:1918] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:11.688427 6269 log.cc:1196] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:11.690910 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ac91e57a79be4d349465805325cedc63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.691561 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac91e57a79be4d349465805325cedc63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.700803 6271 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.700958 6271 ts_tablet_manager.cc:1397] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.150s user 0.004s sys 0.000s
I20260928 10:44:11.701658 6271 raft_consensus.cc:348] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.701879 6271 raft_consensus.cc:374] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.701923 6271 raft_consensus.cc:729] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:11.705297 5818 leader_election.cc:341] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.668038 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.707186 6272 rpcz_store.cc:276] 0928 10:44:07.604352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.604409 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:11.665483 (+4061074us) ts_tablet_manager.cc:1145] Deleting tablet d42e218538814686a6c8308b1bc43949
0928 10:44:11.665493 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.665568 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060796}
W20260928 10:44:11.678314 6090 consensus_peers.cc:487] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d257233e5b934d619e2289a6df55d65a. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:11.678550 6091 leader_election.cc:341] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bd225da0b4b445c6ac03634d975e8396
W20260928 10:44:11.707690 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d42e218538814686a6c8308b1bc43949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d42e218538814686a6c8308b1bc43949 already in progress: creating tablet
I20260928 10:44:11.692723 6275 tablet_bootstrap.cc:492] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:11.707888 6091 consensus_peers.cc:487] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97401498df144cc689066ea3033d68ef. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.708003 6275 ts_tablet_manager.cc:1397] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.112s user 0.001s sys 0.003s
I20260928 10:44:11.708740 6275 raft_consensus.cc:348] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.708938 6275 raft_consensus.cc:374] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.708984 6275 raft_consensus.cc:729] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.709223 6275 consensus_queue.cc:260] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.709779 6275 ts_tablet_manager.cc:1428] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:11.710042 6275 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:11.710179 5817 leader_election.cc:341] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.710300 5817 leader_election.cc:302] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.710886 6269 ts_tablet_manager.cc:1939] T 440a50034c6b4110b74b1531a6b7790d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.711267 7205 raft_consensus.cc:2726] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.711642 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 738) took 4107 ms. Trace:
I20260928 10:44:11.711736 6272 rpcz_store.cc:276] 0928 10:44:07.604564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.604704 (+ 140us) service_pool.cc:227] Handling call
0928 10:44:11.711508 (+4106804us) ts_tablet_manager.cc:1145] Deleting tablet 6f317439c55e4575a0d72ef282c467d5
0928 10:44:11.711520 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.711621 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4095202}
W20260928 10:44:11.712214 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6f317439c55e4575a0d72ef282c467d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f317439c55e4575a0d72ef282c467d5 already in progress: creating tablet
I20260928 10:44:11.712354 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet f799021aca384269bfcd67829f3a7db5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.713697 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 723) took 4507 ms. Trace:
I20260928 10:44:11.714036 6271 consensus_queue.cc:260] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.714836 6271 ts_tablet_manager.cc:1428] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260928 10:44:11.715714 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:11.713165 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 743) took 3983 ms. Trace:
I20260928 10:44:11.716125 6272 rpcz_store.cc:276] 0928 10:44:07.729144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.915532 (+186388us) service_pool.cc:227] Handling call
0928 10:44:11.712010 (+3796478us) ts_tablet_manager.cc:1145] Deleting tablet e89d3b5d65454b2982e625dd4f909bfb
0928 10:44:11.712700 (+ 690us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.712801 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3796122}
I20260928 10:44:11.716524 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 748) took 3935 ms. Trace:
I20260928 10:44:11.716598 6272 rpcz_store.cc:276] 0928 10:44:07.781063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.928748 (+147685us) service_pool.cc:227] Handling call
0928 10:44:11.716405 (+3787657us) ts_tablet_manager.cc:1145] Deleting tablet 58b58d0c904a423f9801a883a2a2dfc1
0928 10:44:11.716415 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.716509 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3784158}
W20260928 10:44:11.717049 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e89d3b5d65454b2982e625dd4f909bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89d3b5d65454b2982e625dd4f909bfb already in progress: creating tablet
W20260928 10:44:11.717334 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 58b58d0c904a423f9801a883a2a2dfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b58d0c904a423f9801a883a2a2dfc1 already in progress: creating tablet
I20260928 10:44:11.723388 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:11.724582 7266 sys_catalog.cc:263] Verifying existing consensus state
I20260928 10:44:11.720077 6269 rpcz_store.cc:276] 0928 10:44:07.205718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.205757 (+ 39us) service_pool.cc:227] Handling call
0928 10:44:11.484576 (+4278819us) ts_tablet_manager.cc:1145] Deleting tablet 440a50034c6b4110b74b1531a6b7790d
0928 10:44:11.484587 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.600759 (+116172us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.688186 (+ 87427us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.713674 (+ 25488us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1883,"tablet-delete.queue_time_us":4278609}
I20260928 10:44:11.725840 6269 tablet_replica.cc:330] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:11.726058 6269 raft_consensus.cc:2229] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.726243 6269 raft_consensus.cc:2258] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.726783 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 440a50034c6b4110b74b1531a6b7790d (table default.Table_dadadc27cb47481fac861cc24bd236c0 [id=9f353ac79b55463da1daedc2523f6cd1]) successfully deleted
I20260928 10:44:11.727900 6275 tablet_bootstrap.cc:654] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.728770 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 751) took 3907 ms. Trace:
I20260928 10:44:11.728845 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:11.728942 6272 rpcz_store.cc:276] 0928 10:44:07.809622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.943380 (+133758us) service_pool.cc:227] Handling call
0928 10:44:11.716790 (+3773410us) ts_tablet_manager.cc:1145] Deleting tablet fe768adf9a1b4631b63151f8cf3cc3ba
0928 10:44:11.716799 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.716863 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3712638}
I20260928 10:44:11.729403 6272 tablet_replica.cc:330] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:11.729635 6272 raft_consensus.cc:2229] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:11.730017 6272 pending_rounds.cc:62] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:11.730129 6272 pending_rounds.cc:68] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265850567647232 op_type: NO_OP noop_request { }
I20260928 10:44:11.730332 6272 raft_consensus.cc:2866] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:11.730491 6272 raft_consensus.cc:2258] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:11.731212 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet fe768adf9a1b4631b63151f8cf3cc3ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe768adf9a1b4631b63151f8cf3cc3ba already in progress: creating tablet
I20260928 10:44:11.731666 6272 ts_tablet_manager.cc:1905] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.732579 7266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Bootstrap starting.
I20260928 10:44:11.738081 6272 ts_tablet_manager.cc:1918] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:11.738242 6272 log.cc:1196] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:11.738587 6271 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.739544 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_767ffc9c94824b23bb8020515c96aa8a" } new_table_name: "default.Table_53aa173b737349c8a4113b62208d8fd4" modify_external_catalogs: true
I20260928 10:44:11.740278 6271 tablet_bootstrap.cc:654] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.741614 6269 ts_tablet_manager.cc:1905] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.741926 7205 raft_consensus.cc:482] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.742077 7205 raft_consensus.cc:504] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.742774 7205 leader_election.cc:288] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.743399 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.743485 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.744036 5817 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.744191 5818 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.744319 5818 leader_election.cc:302] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.744747 7205 raft_consensus.cc:2726] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.755434 6275 tablet_bootstrap.cc:492] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.755600 6275 ts_tablet_manager.cc:1397] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
W20260928 10:44:11.756067 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8e3d92709bb4893973e5d24736bafcf consensus state has no leader
I20260928 10:44:11.756628 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7a2b5c5e039641bb84f974157bcc8b1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.756935 6275 raft_consensus.cc:348] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.757170 6275 raft_consensus.cc:374] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.757229 6275 raft_consensus.cc:729] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:11.757628 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a2b5c5e039641bb84f974157bcc8b1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.757436 6275 consensus_queue.cc:260] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.768563 6275 ts_tablet_manager.cc:1428] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20260928 10:44:11.768910 6275 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.771476 6269 ts_tablet_manager.cc:1918] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.771620 6269 log.cc:1196] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:44:11.771867 6269 ts_tablet_manager.cc:1939] T 39cbecd1c19541f28bd32b7c46f2df61 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.772495 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 721) took 4567 ms. Trace:
I20260928 10:44:11.772571 6269 rpcz_store.cc:276] 0928 10:44:07.205493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.205905 (+ 412us) service_pool.cc:227] Handling call
0928 10:44:11.725783 (+4519878us) ts_tablet_manager.cc:1145] Deleting tablet 39cbecd1c19541f28bd32b7c46f2df61
0928 10:44:11.725797 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.767651 (+ 41854us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.771374 (+ 3723us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.772474 (+ 1100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4519720}
I20260928 10:44:11.772974 6269 tablet_replica.cc:330] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:11.773641 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 39cbecd1c19541f28bd32b7c46f2df61 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:11.779627 6271 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.779846 6271 ts_tablet_manager.cc:1397] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.002s
I20260928 10:44:11.782734 6271 raft_consensus.cc:348] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.782935 6271 raft_consensus.cc:374] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.783020 6271 raft_consensus.cc:729] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.783248 6271 consensus_queue.cc:260] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.783818 6271 ts_tablet_manager.cc:1428] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:11.784310 6271 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.785791 6271 tablet_bootstrap.cc:654] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.786659 6275 tablet_bootstrap.cc:654] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.789556 6272 ts_tablet_manager.cc:1939] T dbd5d1ccd2e54f3884af3af327bb892e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:11.789860 6269 raft_consensus.cc:2229] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.790560 7238 raft_consensus.cc:482] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.790679 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 752) took 3752 ms. Trace:
I20260928 10:44:11.780887 7205 raft_consensus.cc:482] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.790774 7238 raft_consensus.cc:504] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.790894 7205 raft_consensus.cc:504] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.791471 7205 leader_election.cc:288] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.792100 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd65a860b00d4a7ba8ae92dde5818212" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.792299 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:11.792747 5817 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.792708 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd65a860b00d4a7ba8ae92dde5818212" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.790913 6269 raft_consensus.cc:2258] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.793028 7238 leader_election.cc:288] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:11.793282 5818 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.793375 5818 leader_election.cc:302] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.793469 6269 ts_tablet_manager.cc:1905] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.793690 7205 raft_consensus.cc:2726] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.794241 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f3f3bff84a416494431a19887bb88d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.795341 6090 leader_election.cc:302] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.796006 7238 raft_consensus.cc:2726] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.796833 7238 raft_consensus.cc:482] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.797031 7238 raft_consensus.cc:504] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.790787 6272 rpcz_store.cc:276] 0928 10:44:08.038469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.038532 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:11.729360 (+3690828us) ts_tablet_manager.cc:1145] Deleting tablet dbd5d1ccd2e54f3884af3af327bb892e
0928 10:44:11.729369 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.735081 (+ 5712us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.737972 (+ 2891us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.790658 (+ 52686us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3681978}
W20260928 10:44:11.798699 6091 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8b21a965426145c9b678ae80869be833
I20260928 10:44:11.798815 7238 leader_election.cc:288] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.799233 6272 tablet_replica.cc:330] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:11.799163 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet dbd5d1ccd2e54f3884af3af327bb892e (table default.Table_dd487bf423e44aa3b7c72ea54b5f2283 [id=e00c83d4870444d3ab8051f21ece4c22]) successfully deleted
I20260928 10:44:11.799557 6272 raft_consensus.cc:2229] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.799839 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b21a965426145c9b678ae80869be833" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.800040 6019 raft_consensus.cc:2454] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:11.800454 6090 leader_election.cc:302] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:11.802734 7238 raft_consensus.cc:2781] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.802959 6273 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.803090 6273 ts_tablet_manager.cc:1397] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.239s user 0.032s sys 0.050s
I20260928 10:44:11.803081 7238 raft_consensus.cc:482] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.803918 6273 raft_consensus.cc:348] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.804129 6273 raft_consensus.cc:374] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.804180 6273 raft_consensus.cc:729] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.804291 7238 raft_consensus.cc:3037] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.802950 6272 raft_consensus.cc:2258] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.804386 6273 consensus_queue.cc:260] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.804979 6273 ts_tablet_manager.cc:1428] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:11.805301 6272 ts_tablet_manager.cc:1905] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.805526 6273 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.807029 6273 tablet_bootstrap.cc:654] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.807140 6275 tablet_bootstrap.cc:492] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.807314 6275 ts_tablet_manager.cc:1397] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260928 10:44:11.808035 6275 raft_consensus.cc:348] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.808317 6275 raft_consensus.cc:374] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.808416 6275 raft_consensus.cc:729] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.808722 6275 consensus_queue.cc:260] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.812255 6275 ts_tablet_manager.cc:1428] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:11.812629 6275 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.814349 6275 tablet_bootstrap.cc:654] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.815824 6270 ts_tablet_manager.cc:1918] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:11.817703 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3926c98ab5364e61af330f941b3d63bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:11.818902 6270 log.cc:1196] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:11.819411 6270 ts_tablet_manager.cc:1939] T 87d5dd4e5b544262938b1822510d8b9f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:11.821125 7205 raft_consensus.cc:482] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.821300 7205 raft_consensus.cc:504] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.821959 7205 leader_election.cc:288] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.822618 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.820779 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 674) took 5846 ms. Trace:
W20260928 10:44:11.823253 5818 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.823316 6270 rpcz_store.cc:276] 0928 10:44:05.974197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:05.974252 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:11.497472 (+5523220us) ts_tablet_manager.cc:1145] Deleting tablet 87d5dd4e5b544262938b1822510d8b9f
0928 10:44:11.497486 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.776818 (+279332us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.815670 (+ 38852us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.820753 (+ 5083us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5522956}
I20260928 10:44:11.823892 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 87d5dd4e5b544262938b1822510d8b9f (table default.Table_d8361cd920f64394b922d3f17c2ae915 [id=76c248943ab94632a32893e69fce2205]) successfully deleted
I20260928 10:44:11.823915 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.824416 6270 tablet_replica.cc:330] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:11.824536 5817 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.824643 6270 raft_consensus.cc:2229] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.824644 5817 leader_election.cc:302] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.824798 6270 raft_consensus.cc:2258] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.825105 7205 raft_consensus.cc:2726] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.825299 6270 ts_tablet_manager.cc:1905] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:11.826599 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3926c98ab5364e61af330f941b3d63bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.828795 6269 ts_tablet_manager.cc:1918] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.829635 5698 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 04b947da50894cdba0f49d0738f60187 (table default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916]). Expected version 2 got 0
I20260928 10:44:11.831314 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 29b6d18cf0304edc8b3ca1d4d106decb from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.831569 6269 log.cc:1196] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:11.831351 6273 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.833659 6273 ts_tablet_manager.cc:1397] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20260928 10:44:11.829416 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:11.834425 6273 raft_consensus.cc:348] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.834682 6273 raft_consensus.cc:374] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.834750 6273 raft_consensus.cc:729] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.834936 6273 consensus_queue.cc:260] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.835439 6273 ts_tablet_manager.cc:1428] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.835705 6273 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.836045 6269 ts_tablet_manager.cc:1939] T 95e1f8a63fed4c82ac95c2fbb7bc633d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.837190 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:11.838622 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet b217b6d4ad9a495795fe2b923144e8d3 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.839527 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ee1ee04831c7467caabc0039a916deea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.840178 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee1ee04831c7467caabc0039a916deea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.840656 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet dbd5d1ccd2e54f3884af3af327bb892e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.840909 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 86b16eb36c034591ac1603ab84fd9342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.837294 6273 tablet_bootstrap.cc:654] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.840945 6275 tablet_bootstrap.cc:492] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.842084 6275 ts_tablet_manager.cc:1397] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260928 10:44:11.842510 6271 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.842715 6271 ts_tablet_manager.cc:1397] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260928 10:44:11.842836 6275 raft_consensus.cc:348] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.843101 6275 raft_consensus.cc:374] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.843163 6275 raft_consensus.cc:729] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.843400 6275 consensus_queue.cc:260] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.843907 6271 raft_consensus.cc:348] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.844192 6271 raft_consensus.cc:374] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.844285 6271 raft_consensus.cc:729] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.845824 6275 ts_tablet_manager.cc:1428] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:11.846102 6275 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:11.846114 6091 consensus_peers.cc:487] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.848794 6275 tablet_bootstrap.cc:654] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.849478 6271 consensus_queue.cc:260] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.849632 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 722) took 4644 ms. Trace:
I20260928 10:44:11.852494 6271 ts_tablet_manager.cc:1428] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 10:44:11.849735 6269 rpcz_store.cc:276] 0928 10:44:07.205604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.206082 (+ 478us) service_pool.cc:227] Handling call
0928 10:44:11.772916 (+4566834us) ts_tablet_manager.cc:1145] Deleting tablet 95e1f8a63fed4c82ac95c2fbb7bc633d
0928 10:44:11.772927 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.796348 (+ 23421us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.828679 (+ 32331us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.849606 (+ 20927us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4566712}
I20260928 10:44:11.853142 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:11.853519 6272 ts_tablet_manager.cc:1918] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:11.853737 6271 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.853849 6269 tablet_replica.cc:330] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:11.855465 6272 log.cc:1196] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/362ef9f9aa8641cca11c0a154882e1d4
I20260928 10:44:11.854101 6269 raft_consensus.cc:2229] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.855721 6269 raft_consensus.cc:2258] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.856196 6272 ts_tablet_manager.cc:1939] T 362ef9f9aa8641cca11c0a154882e1d4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:11.858773 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 00b7e26971914613a2372476b348b702
I20260928 10:44:11.859256 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 761) took 3311 ms. Trace:
I20260928 10:44:11.857142 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:11.859998 6269 ts_tablet_manager.cc:1905] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.859541 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.860879 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.861037 6272 rpcz_store.cc:276] 0928 10:44:08.548146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.548468 (+ 322us) service_pool.cc:227] Handling call
0928 10:44:11.799181 (+3250713us) ts_tablet_manager.cc:1145] Deleting tablet 362ef9f9aa8641cca11c0a154882e1d4
0928 10:44:11.799195 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.825801 (+ 26606us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.853400 (+ 27599us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.859236 (+ 5836us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3246711}
W20260928 10:44:11.862188 6091 consensus_peers.cc:487] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d257233e5b934d619e2289a6df55d65a. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.865422 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]) successfully deleted
I20260928 10:44:11.866642 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 758) took 3318 ms. Trace:
I20260928 10:44:11.866858 6272 rpcz_store.cc:276] 0928 10:44:08.547857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.550621 (+ 2764us) service_pool.cc:227] Handling call
0928 10:44:11.866501 (+3315880us) ts_tablet_manager.cc:1145] Deleting tablet 29f07262a710456ea0837dc5af3eaebb
0928 10:44:11.866514 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.866622 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3313892}
W20260928 10:44:11.867605 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 29f07262a710456ea0837dc5af3eaebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29f07262a710456ea0837dc5af3eaebb already in progress: creating tablet
I20260928 10:44:11.868083 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 757) took 3320 ms. Trace:
I20260928 10:44:11.869360 6272 rpcz_store.cc:276] 0928 10:44:08.547730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.548317 (+ 587us) service_pool.cc:227] Handling call
0928 10:44:11.867967 (+3319650us) ts_tablet_manager.cc:1145] Deleting tablet 7e5bec611c95429ab309957f74b70eea
0928 10:44:11.867978 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.868064 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3309152}
W20260928 10:44:11.869971 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7e5bec611c95429ab309957f74b70eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e5bec611c95429ab309957f74b70eea already in progress: creating tablet
I20260928 10:44:11.870298 6272 tablet_replica.cc:330] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:11.870582 6272 raft_consensus.cc:2229] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.870800 6272 raft_consensus.cc:2258] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.871543 6272 ts_tablet_manager.cc:1905] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.873023 5697 catalog_manager.cc:5495] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:11.873854 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:11.874174 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:11.874504 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:11.879802 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 19f68e9f9bf44cf09fc87f102de60f28
I20260928 10:44:11.881263 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.882447 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:11.883100 7238 raft_consensus.cc:504] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.883970 6275 tablet_bootstrap.cc:492] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:11.884099 6275 ts_tablet_manager.cc:1397] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260928 10:44:11.884855 6275 raft_consensus.cc:348] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.885035 6275 raft_consensus.cc:374] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.885082 6275 raft_consensus.cc:729] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.885281 6275 consensus_queue.cc:260] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.885732 6275 ts_tablet_manager.cc:1428] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.887746 6269 ts_tablet_manager.cc:1918] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.887953 6269 log.cc:1196] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/efa178fc1e344069b086003d39f1b848
I20260928 10:44:11.888305 6269 ts_tablet_manager.cc:1939] T efa178fc1e344069b086003d39f1b848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:11.860610 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.869268 6270 ts_tablet_manager.cc:1918] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.881987 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f68e9f9bf44cf09fc87f102de60f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:11.891256 6270 log.cc:1196] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/cd13e6a9d8f04fa3abb8d22a80932dae
I20260928 10:44:11.891597 6270 ts_tablet_manager.cc:1939] T cd13e6a9d8f04fa3abb8d22a80932dae P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:11.891937 7226 consensus_queue.cc:1035] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:11.892408 6275 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:11.894407 6275 tablet_bootstrap.cc:654] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.896147 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 724) took 4690 ms. Trace:
I20260928 10:44:11.898166 7205 raft_consensus.cc:482] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.899096 6269 rpcz_store.cc:276] 0928 10:44:07.205844 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.206224 (+ 380us) service_pool.cc:227] Handling call
0928 10:44:11.853778 (+4647554us) ts_tablet_manager.cc:1145] Deleting tablet efa178fc1e344069b086003d39f1b848
0928 10:44:11.853805 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.864141 (+ 10336us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.879290 (+ 15149us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.896122 (+ 16832us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4647367}
I20260928 10:44:11.899176 7205 raft_consensus.cc:504] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.899873 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet efa178fc1e344069b086003d39f1b848 (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:11.899955 7205 leader_election.cc:288] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.900485 6269 tablet_replica.cc:330] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:11.900538 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.901537 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:11.902204 5817 leader_election.cc:341] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:11.902927 5818 leader_election.cc:341] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:11.903038 5818 leader_election.cc:302] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.903407 7205 raft_consensus.cc:2726] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:11.903895 6269 raft_consensus.cc:2229] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:11.904137 6269 raft_consensus.cc:2258] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:11.906078 6269 ts_tablet_manager.cc:1905] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.906899 6272 ts_tablet_manager.cc:1918] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:11.908012 6271 tablet_bootstrap.cc:654] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.910033 7205 raft_consensus.cc:482] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.910179 7205 raft_consensus.cc:504] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:11.910849 7205 leader_election.cc:288] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.911348 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:11.912415 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 9c05f19efcff41c882092c940e0567e2 (DEFAULT_TABLE table=default.Table_5cada558676a41b2b81abaae00369c39 [id=ed3d96690aee4bbba787d38d569c723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.914127 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 0c42035571654826a6030f15b2816992 (DEFAULT_TABLE table=default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314 [id=e0197ac37d924f1d841e18392911b7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.915442 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:11.915853 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 9c05f19efcff41c882092c940e0567e2 (DEFAULT_TABLE table=default.Table_5cada558676a41b2b81abaae00369c39 [id=ed3d96690aee4bbba787d38d569c723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.916234 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c05f19efcff41c882092c940e0567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.916623 5992 tablet_service.cc:1467] Processing CreateTablet for tablet cab9bc67c7474cb681566118af1bbf07 (DEFAULT_TABLE table=default.Table_ca398b35ea764963925612fa671ebaef [id=6961655b24444ca0bc824cd82276f77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.917527 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2503ffadb38744319552aeb37c818626 (DEFAULT_TABLE table=default.Table_0c245579875c41028091fc6ace944ffc [id=347f15e6581e4efebb5c716fdcba0fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.918085 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 0c42035571654826a6030f15b2816992 (DEFAULT_TABLE table=default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314 [id=e0197ac37d924f1d841e18392911b7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.918457 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c42035571654826a6030f15b2816992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.929791 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 2503ffadb38744319552aeb37c818626 (DEFAULT_TABLE table=default.Table_0c245579875c41028091fc6ace944ffc [id=347f15e6581e4efebb5c716fdcba0fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.930248 5849 tablet_service.cc:1467] Processing CreateTablet for tablet cab9bc67c7474cb681566118af1bbf07 (DEFAULT_TABLE table=default.Table_ca398b35ea764963925612fa671ebaef [id=6961655b24444ca0bc824cd82276f77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.930734 6273 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.930864 6273 ts_tablet_manager.cc:1397] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.095s user 0.025s sys 0.051s
I20260928 10:44:11.931113 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2503ffadb38744319552aeb37c818626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.931238 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet b257d722a42e44f4ac554b1ebe7d8e31 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:11.931576 6273 raft_consensus.cc:348] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.931826 6273 raft_consensus.cc:374] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.931879 6273 raft_consensus.cc:729] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.932062 6273 consensus_queue.cc:260] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.932441 7184 raft_consensus.cc:482] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.932547 6273 ts_tablet_manager.cc:1428] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:11.932580 7184 raft_consensus.cc:504] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.933058 7184 leader_election.cc:288] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.933439 6271 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:11.933651 6271 ts_tablet_manager.cc:1397] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.000s
I20260928 10:44:11.934442 6271 raft_consensus.cc:348] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.934692 6271 raft_consensus.cc:374] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.934753 6271 raft_consensus.cc:729] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.934970 6271 consensus_queue.cc:260] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.935731 6271 ts_tablet_manager.cc:1428] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.937162 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_892d0c2bd5e241ae9782bea7ba02e421"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:11.937808 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_892d0c2bd5e241ae9782bea7ba02e421 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:11.941604 6273 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.942768 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab9bc67c7474cb681566118af1bbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.943310 6273 tablet_bootstrap.cc:654] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.953022 6273 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.953197 6273 ts_tablet_manager.cc:1397] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260928 10:44:11.954349 6273 raft_consensus.cc:348] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.954612 6273 raft_consensus.cc:374] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.954692 6273 raft_consensus.cc:729] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.954833 7205 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.954892 6273 consensus_queue.cc:260] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.954957 7205 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.955070 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 (DEFAULT_TABLE table=default.Table_d9811c82d1fa4eff8a1065a89a8c5c13 [id=d847ce3681764bb189b9306ebb4bec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.955454 6273 ts_tablet_manager.cc:1428] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.956025 7029 raft_consensus.cc:482] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.956082 6273 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.956156 7029 raft_consensus.cc:504] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.956415 5845 tablet_service.cc:1467] Processing CreateTablet for tablet ce8668f4d6dc45e5876a3e6e415523a2 (DEFAULT_TABLE table=default.Table_d725bb48e71f48e2beb23ef4d0b0c7b2 [id=ece4073207d74e0983fe19f1ae038740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.956734 7029 leader_election.cc:288] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.956854 7029 raft_consensus.cc:482] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.956959 7029 raft_consensus.cc:504] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.957156 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5445f0b3ef4132950e18c6bb05b497 (DEFAULT_TABLE table=default.Table_73d7639b37c4419f9c00c915503a0668 [id=aab82ab88b7040dcbe3e85e3c3dd15a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.957399 7029 leader_election.cc:288] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:11.959143 5957 leader_election.cc:341] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: db824b43256640e9bfef44da1ccf8e1a
I20260928 10:44:11.959582 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:11.959800 5882 raft_consensus.cc:2454] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:11.960718 5957 leader_election.cc:302] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:11.961071 7168 raft_consensus.cc:2781] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:11.961139 7168 raft_consensus.cc:482] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:11.961194 7168 raft_consensus.cc:3037] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.963786 7168 raft_consensus.cc:504] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.964120 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 (DEFAULT_TABLE table=default.Table_d9811c82d1fa4eff8a1065a89a8c5c13 [id=d847ce3681764bb189b9306ebb4bec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.964582 5986 tablet_service.cc:1467] Processing CreateTablet for tablet ce8668f4d6dc45e5876a3e6e415523a2 (DEFAULT_TABLE table=default.Table_d725bb48e71f48e2beb23ef4d0b0c7b2 [id=ece4073207d74e0983fe19f1ae038740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.964928 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5445f0b3ef4132950e18c6bb05b497 (DEFAULT_TABLE table=default.Table_73d7639b37c4419f9c00c915503a0668 [id=aab82ab88b7040dcbe3e85e3c3dd15a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.955461 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead8c7aa6364125bd059516cf0413e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.955513 7205 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.966995 6273 tablet_bootstrap.cc:654] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.968461 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:11.968657 5882 raft_consensus.cc:3037] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.970666 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5445f0b3ef4132950e18c6bb05b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.970947 5882 raft_consensus.cc:2454] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:11.971673 5957 leader_election.cc:302] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:11.972078 7029 raft_consensus.cc:2781] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:11.972186 7029 raft_consensus.cc:686] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:11.972404 7029 consensus_queue.cc:237] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.975244 7168 leader_election.cc:288] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:11.975440 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8668f4d6dc45e5876a3e6e415523a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.975987 7205 raft_consensus.cc:482] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.976107 7205 raft_consensus.cc:504] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.976691 7205 leader_election.cc:288] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:11.978238 6273 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.978358 6273 ts_tablet_manager.cc:1397] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.000s
W20260928 10:44:11.979063 5955 consensus_peers.cc:487] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 362ef9f9aa8641cca11c0a154882e1d4. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:11.979086 6273 raft_consensus.cc:348] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.979281 6273 raft_consensus.cc:374] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.979334 6273 raft_consensus.cc:729] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.979496 6273 consensus_queue.cc:260] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:11.980104 6273 ts_tablet_manager.cc:1428] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:11.980347 6273 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.981861 6273 tablet_bootstrap.cc:654] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:11.990688 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 1fab26669af04128871528af607785f9 (DEFAULT_TABLE table=default.Table_18daf257df304b87a04bbf5f584865fb [id=63e7f31e01854e36a744dd6421d59ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.991130 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fab26669af04128871528af607785f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.996276 6273 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:11.996198 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b21a965426145c9b678ae80869be833" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:11.996407 6273 ts_tablet_manager.cc:1397] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.006s
I20260928 10:44:11.996423 6021 raft_consensus.cc:3037] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.997293 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 1fab26669af04128871528af607785f9 (DEFAULT_TABLE table=default.Table_18daf257df304b87a04bbf5f584865fb [id=63e7f31e01854e36a744dd6421d59ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:11.997422 6273 raft_consensus.cc:348] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.997705 6273 raft_consensus.cc:374] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:11.997769 6273 raft_consensus.cc:729] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:11.997956 6273 consensus_queue.cc:260] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:11.998689 6273 ts_tablet_manager.cc:1428] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:11.998731 6016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.998960 6273 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:11.999131 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:11.999368 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.000355 6273 tablet_bootstrap.cc:654] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.000669 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.000893 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8668f4d6dc45e5876a3e6e415523a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:12.001293 5818 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.001502 5818 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.001619 5818 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.001740 5818 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.001701 7266 log.cc:824] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Log is configured to *not* fsync() on all Append() calls
I20260928 10:44:12.002565 6021 raft_consensus.cc:2454] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:12.006301 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c42035571654826a6030f15b2816992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.006583 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab9bc67c7474cb681566118af1bbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.006673 6271 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.008491 6271 tablet_bootstrap.cc:654] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.009714 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2503ffadb38744319552aeb37c818626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.010720 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5445f0b3ef4132950e18c6bb05b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.011302 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fab26669af04128871528af607785f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.011454 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c05f19efcff41c882092c940e0567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.014616 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead8c7aa6364125bd059516cf0413e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.027541 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 678) took 5874 ms. Trace:
I20260928 10:44:12.029883 6271 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.030263 6271 ts_tablet_manager.cc:1397] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260928 10:44:12.031172 6271 raft_consensus.cc:348] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.031399 6271 raft_consensus.cc:374] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.031453 6271 raft_consensus.cc:729] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.031661 6271 consensus_queue.cc:260] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.032191 6271 ts_tablet_manager.cc:1428] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:12.032337 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 (DEFAULT_TABLE table=default.Table_c1af1980a6344ca7b54ded68d92e688f [id=c097fa41cb3f4c81b759f8e9cf7eb27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.032436 6271 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.032774 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 606a9cb61e0f4f558008d09177ded9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.033149 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.033506 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1415cbe9fa15468a91932cdec4612cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.034523 6271 tablet_bootstrap.cc:654] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.030171 6270 rpcz_store.cc:276] 0928 10:44:06.153219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.153291 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:11.824364 (+5671073us) ts_tablet_manager.cc:1145] Deleting tablet cd13e6a9d8f04fa3abb8d22a80932dae
0928 10:44:11.824379 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.838108 (+ 13729us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.869160 (+ 31052us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.027514 (+158354us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5662464}
I20260928 10:44:12.036515 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 679) took 5871 ms. Trace:
I20260928 10:44:12.036597 6270 rpcz_store.cc:276] 0928 10:44:06.165500 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.165554 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:12.036386 (+5870832us) ts_tablet_manager.cc:1145] Deleting tablet 383eb18f1c0c46209ff5b47e468b9950
0928 10:44:12.036396 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.036496 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5870546}
I20260928 10:44:12.037027 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 680) took 5820 ms. Trace:
I20260928 10:44:12.037093 6270 rpcz_store.cc:276] 0928 10:44:06.216394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.216453 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:12.036933 (+5820480us) ts_tablet_manager.cc:1145] Deleting tablet 58c0af95fa58451490947176ec9301e3
0928 10:44:12.036943 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.037015 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5819992}
I20260928 10:44:12.037501 6270 tablet_replica.cc:330] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.037760 6270 raft_consensus.cc:2229] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.037894 6270 raft_consensus.cc:2258] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.038363 6270 ts_tablet_manager.cc:1905] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.041050 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 29b6d18cf0304edc8b3ca1d4d106decb
I20260928 10:44:12.041224 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 25a2f20766024978a16b6bccd366a848
I20260928 10:44:12.042932 7205 raft_consensus.cc:482] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.043062 7205 raft_consensus.cc:504] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.043622 7205 leader_election.cc:288] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.044298 5698 catalog_manager.cc:6565] ReplaceTablet: tablet 29b6d18cf0304edc8b3ca1d4d106decb deleted and replaced by tablet b300d0ea612c4c3993188c8504ce334c
I20260928 10:44:12.047498 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.048173 5818 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.048743 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet cd13e6a9d8f04fa3abb8d22a80932dae (table default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916]) successfully deleted
W20260928 10:44:12.049449 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 58c0af95fa58451490947176ec9301e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c0af95fa58451490947176ec9301e3 already in progress: creating tablet
I20260928 10:44:12.050493 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb with delete_type TABLET_DATA_DELETED (replaced by tablet b300d0ea612c4c3993188c8504ce334c) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.050588 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 25a2f20766024978a16b6bccd366a848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.050828 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.052009 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 (DEFAULT_TABLE table=default.Table_c1af1980a6344ca7b54ded68d92e688f [id=c097fa41cb3f4c81b759f8e9cf7eb27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.052213 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 4f45a52f81e64b13ac52ae74d26d7ea7 (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.052397 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 606a9cb61e0f4f558008d09177ded9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.053020 7205 raft_consensus.cc:482] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.053146 7205 raft_consensus.cc:504] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.053753 7205 leader_election.cc:288] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.053727 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 4f45a52f81e64b13ac52ae74d26d7ea7 (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.054319 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f45a52f81e64b13ac52ae74d26d7ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.054508 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.055260 5818 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.055599 7205 raft_consensus.cc:482] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.055721 7205 raft_consensus.cc:504] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.056305 7205 leader_election.cc:288] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.057075 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.058262 5818 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.058641 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 25a2f20766024978a16b6bccd366a848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.058904 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb with delete_type TABLET_DATA_DELETED (replaced by tablet b300d0ea612c4c3993188c8504ce334c) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.062525 7205 raft_consensus.cc:482] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.062675 7205 raft_consensus.cc:504] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.063248 7205 leader_election.cc:288] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.063395 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1415cbe9fa15468a91932cdec4612cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.064016 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f45a52f81e64b13ac52ae74d26d7ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.065442 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.066043 5818 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.066468 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c61910c227dc41cba5ed9d53e9caad2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:12.072966 7205 raft_consensus.cc:482] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.073105 7205 raft_consensus.cc:504] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.073678 7205 leader_election.cc:288] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:12.074523 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c61910c227dc41cba5ed9d53e9caad2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.074753 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 46490066d50847ceb2362e35dce84f31
I20260928 10:44:12.075691 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 46490066d50847ceb2362e35dce84f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.074437 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.077807 5818 leader_election.cc:341] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.082708 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 9a86dc338bb24b38867d4aa1f45d1dac (DEFAULT_TABLE table=default.Table_5cd9c9a158b7458d83040f7fd15a911c [id=6def6cf7afda4cfaa4c80497885dab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.083101 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a86dc338bb24b38867d4aa1f45d1dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.083761 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_80b098cecf5b43acada53ad76023891a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.084326 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80b098cecf5b43acada53ad76023891a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.091174 6270 ts_tablet_manager.cc:1918] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:12.092079 6270 log.cc:1196] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/86b16eb36c034591ac1603ab84fd9342
I20260928 10:44:12.092561 6270 ts_tablet_manager.cc:1939] T 86b16eb36c034591ac1603ab84fd9342 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:12.093014 7205 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.093165 7029 consensus_queue.cc:1035] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.093159 7205 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.093916 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 682) took 5875 ms. Trace:
I20260928 10:44:12.093997 6270 rpcz_store.cc:276] 0928 10:44:06.218494 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.218550 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:12.037464 (+5818914us) ts_tablet_manager.cc:1145] Deleting tablet 86b16eb36c034591ac1603ab84fd9342
0928 10:44:12.037472 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.086019 (+ 48547us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.091073 (+ 5054us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.093899 (+ 2826us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5818699}
I20260928 10:44:12.094373 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 681) took 5876 ms. Trace:
I20260928 10:44:12.094441 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 86b16eb36c034591ac1603ab84fd9342 (table default.Table_6279d9ee60ce44759d7bc1ae62dd2073 [id=d006fbd87b934957b39ed53725c2eb78]) successfully deleted
I20260928 10:44:12.095484 7205 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.095721 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.094445 6270 rpcz_store.cc:276] 0928 10:44:06.217517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.217568 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:12.094261 (+5876693us) ts_tablet_manager.cc:1145] Deleting tablet 7db49404752e4501a594608fc325ebe9
0928 10:44:12.094272 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.094357 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5875467}
I20260928 10:44:12.095726 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_54e00eb04a924f518130c405bf7576de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:12.096097 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 683) took 5876 ms. Trace:
W20260928 10:44:12.096184 5818 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.096185 6270 rpcz_store.cc:276] 0928 10:44:06.219181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.219220 (+ 39us) service_pool.cc:227] Handling call
0928 10:44:12.095982 (+5876762us) ts_tablet_manager.cc:1145] Deleting tablet 34e41838d44e400f9934ea40a198e606
0928 10:44:12.095993 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.096081 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5876529}
W20260928 10:44:12.096321 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54e00eb04a924f518130c405bf7576de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.096457 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 685) took 5831 ms. Trace:
I20260928 10:44:12.096478 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 46490066d50847ceb2362e35dce84f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.096518 6270 rpcz_store.cc:276] 0928 10:44:06.265445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.265511 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:12.096369 (+5830858us) ts_tablet_manager.cc:1145] Deleting tablet 5a102bf3fe3b4bc8ad60ca76e48928e7
0928 10:44:12.096379 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.096444 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5824745}
I20260928 10:44:12.096766 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 684) took 5839 ms. Trace:
I20260928 10:44:12.096824 6270 rpcz_store.cc:276] 0928 10:44:06.257748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.262831 (+ 5083us) service_pool.cc:227] Handling call
0928 10:44:12.096684 (+5833853us) ts_tablet_manager.cc:1145] Deleting tablet ba28bafb8dea49f6a477927aea223e1d
0928 10:44:12.096692 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.096754 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5824918}
I20260928 10:44:12.097018 6270 tablet_replica.cc:330] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.097240 6270 raft_consensus.cc:2229] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.097383 6270 raft_consensus.cc:2258] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:12.097872 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7db49404752e4501a594608fc325ebe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7db49404752e4501a594608fc325ebe9 already in progress: creating tablet
I20260928 10:44:12.097939 6270 ts_tablet_manager.cc:1905] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:12.098120 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 34e41838d44e400f9934ea40a198e606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34e41838d44e400f9934ea40a198e606 already in progress: creating tablet
W20260928 10:44:12.098294 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a102bf3fe3b4bc8ad60ca76e48928e7 already in progress: creating tablet
W20260928 10:44:12.098495 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ba28bafb8dea49f6a477927aea223e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba28bafb8dea49f6a477927aea223e1d already in progress: creating tablet
I20260928 10:44:12.100739 6271 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.100878 6271 ts_tablet_manager.cc:1397] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.003s
I20260928 10:44:12.101684 6271 raft_consensus.cc:348] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.101882 6271 raft_consensus.cc:374] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.101933 6271 raft_consensus.cc:729] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.104655 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6bfcdaa9d8bf45c98411cf0e6febd294
I20260928 10:44:12.105077 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 6bfcdaa9d8bf45c98411cf0e6febd294 deleted and replaced by tablet 8b152e2cd91948348a2bb5f557c91757
I20260928 10:44:12.105486 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6df2766d782a4f19a05ba2a3f9b69bbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.106089 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6df2766d782a4f19a05ba2a3f9b69bbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.106716 6271 consensus_queue.cc:260] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.107340 6271 ts_tablet_manager.cc:1428] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 10:44:12.108420 6271 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.108681 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b152e2cd91948348a2bb5f557c91757) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.111646 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b152e2cd91948348a2bb5f557c91757) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.112270 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 9a86dc338bb24b38867d4aa1f45d1dac (DEFAULT_TABLE table=default.Table_5cd9c9a158b7458d83040f7fd15a911c [id=6def6cf7afda4cfaa4c80497885dab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.116153 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a86dc338bb24b38867d4aa1f45d1dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.116556 6271 tablet_bootstrap.cc:654] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.116771 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:12.116945 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a3b0ec0cf3bc4a09b0aaa15d18873f70
I20260928 10:44:12.117736 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_016f3ae69c4441799d03955f4520ab88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.118358 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_016f3ae69c4441799d03955f4520ab88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.120934 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.123718 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 (DEFAULT_TABLE table=default.Table_f333b9300b284c31b2f59f434eeb2f48 [id=5f07b8d9c26f4cf1af5e017ab2c851a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.124198 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.121644 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.131740 5853 tablet_service.cc:1467] Processing CreateTablet for tablet f2661873e89c40ac8497bb9f88769754 (DEFAULT_TABLE table=default.Table_f8ca99f63fd244578040776ca622e0c6 [id=c324374242ba4b5da380d8e6a4523f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.132261 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2661873e89c40ac8497bb9f88769754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.136514 6270 ts_tablet_manager.cc:1918] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:12.136818 6273 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:12.137008 6273 ts_tablet_manager.cc:1397] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.138s user 0.027s sys 0.011s
I20260928 10:44:12.143409 6270 log.cc:1196] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/bae5a2038947413f95f134602081c889
I20260928 10:44:12.143821 6270 ts_tablet_manager.cc:1939] T bae5a2038947413f95f134602081c889 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:12.144192 7205 raft_consensus.cc:482] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.144366 7205 raft_consensus.cc:504] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.144409 6273 raft_consensus.cc:348] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.144788 6273 raft_consensus.cc:374] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.137985 5986 tablet_service.cc:1467] Processing CreateTablet for tablet f2661873e89c40ac8497bb9f88769754 (DEFAULT_TABLE table=default.Table_f8ca99f63fd244578040776ca622e0c6 [id=c324374242ba4b5da380d8e6a4523f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.143249 6271 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.145095 6271 ts_tablet_manager.cc:1397] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260928 10:44:12.145277 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 686) took 5760 ms. Trace:
I20260928 10:44:12.144953 7205 leader_election.cc:288] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.145550 6273 raft_consensus.cc:729] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.145941 6273 consensus_queue.cc:260] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.145891 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0584d6b80e43eb913c3932256cd89e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.146589 6271 raft_consensus.cc:348] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.146792 6271 raft_consensus.cc:374] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:12.146761 5818 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.146844 6271 raft_consensus.cc:729] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.147007 6270 rpcz_store.cc:276] 0928 10:44:06.385215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.385479 (+ 264us) service_pool.cc:227] Handling call
0928 10:44:12.096981 (+5711502us) ts_tablet_manager.cc:1145] Deleting tablet bae5a2038947413f95f134602081c889
0928 10:44:12.096990 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.101101 (+ 4111us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.136411 (+ 35310us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.145255 (+ 8844us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5661900}
I20260928 10:44:12.147744 6273 ts_tablet_manager.cc:1428] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 10:44:12.148307 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet bae5a2038947413f95f134602081c889 (table default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]) successfully deleted
I20260928 10:44:12.147156 6271 consensus_queue.cc:260] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.149047 6271 ts_tablet_manager.cc:1428] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:12.148218 7205 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.149420 7205 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.150030 7205 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.150777 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.151337 5818 leader_election.cc:341] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.151762 6271 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.152359 6273 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:12.152036 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 700) took 5525 ms. Trace:
I20260928 10:44:12.152580 6270 rpcz_store.cc:276] 0928 10:44:06.626252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.626959 (+ 707us) service_pool.cc:227] Handling call
0928 10:44:12.149324 (+5522365us) ts_tablet_manager.cc:1145] Deleting tablet 946188e312c6424f81926465667b5e11
0928 10:44:12.151894 (+ 2570us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.152019 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5522027}
I20260928 10:44:12.155891 5852 tablet_service.cc:1467] Processing CreateTablet for tablet da06864105a64b42a1c9701c07a241b8 (DEFAULT_TABLE table=default.Table_246184c33447431eaeb718fe8ce2708d [id=593c83175526474a82856f4fbc6a6432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.157984 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da06864105a64b42a1c9701c07a241b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:12.158355 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 946188e312c6424f81926465667b5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946188e312c6424f81926465667b5e11 already in progress: creating tablet
I20260928 10:44:12.156525 5984 tablet_service.cc:1467] Processing CreateTablet for tablet da06864105a64b42a1c9701c07a241b8 (DEFAULT_TABLE table=default.Table_246184c33447431eaeb718fe8ce2708d [id=593c83175526474a82856f4fbc6a6432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.159047 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 701) took 5532 ms. Trace:
I20260928 10:44:12.147680 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2661873e89c40ac8497bb9f88769754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.167987 6271 tablet_bootstrap.cc:654] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.172554 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_72490291db794957ac8bb15acbf51562" } new_table_name: "default.Table_f46a81b5d00a440f8139ef39c5f912c6" modify_external_catalogs: true
I20260928 10:44:12.171460 5694 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:12.174091 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.174307 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.174628 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da06864105a64b42a1c9701c07a241b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.175491 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a4e91262b8494ef28c172b832589e2c1" } new_table_name: "default.Table_1b3195c057364cf88c8d671a40606b49" modify_external_catalogs: true
I20260928 10:44:12.177481 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 84912292d6c34a3991bd0f885de240a8 (table default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813]). Expected version 3 got 0
I20260928 10:44:12.177747 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:12.159153 6270 rpcz_store.cc:276] 0928 10:44:06.626370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.627348 (+ 978us) service_pool.cc:227] Handling call
0928 10:44:12.158909 (+5531561us) ts_tablet_manager.cc:1145] Deleting tablet bc7aa301bfbb4097b386a0d23cfa91e1
0928 10:44:12.158918 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.159029 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5531393}
I20260928 10:44:12.178936 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 702) took 5547 ms. Trace:
W20260928 10:44:12.179004 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bc7aa301bfbb4097b386a0d23cfa91e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7aa301bfbb4097b386a0d23cfa91e1 already in progress: creating tablet
I20260928 10:44:12.179658 6273 tablet_bootstrap.cc:654] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.180302 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_28104b0777be477eaacef13fc493ef23" } new_table_name: "default.Table_47744c9c8cd3486c9ea17f775eec8f76" modify_external_catalogs: true
I20260928 10:44:12.180737 7205 raft_consensus.cc:482] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.180860 7205 raft_consensus.cc:504] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.181433 7205 leader_election.cc:288] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.182008 6271 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.180567 6270 rpcz_store.cc:276] 0928 10:44:06.631085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.631191 (+ 106us) service_pool.cc:227] Handling call
0928 10:44:12.178797 (+5547606us) ts_tablet_manager.cc:1145] Deleting tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4
0928 10:44:12.178809 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.178918 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5547266}
I20260928 10:44:12.182047 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.182636 5818 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.182654 6271 ts_tablet_manager.cc:1397] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20260928 10:44:12.183818 6270 tablet_replica.cc:330] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.184001 6270 raft_consensus.cc:2229] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.184342 6270 raft_consensus.cc:2258] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.185062 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.185238 6270 ts_tablet_manager.cc:1905] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.190045 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 (DEFAULT_TABLE table=default.Table_f333b9300b284c31b2f59f434eeb2f48 [id=5f07b8d9c26f4cf1af5e017ab2c851a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.190202 6271 raft_consensus.cc:348] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.191512 6271 raft_consensus.cc:374] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.191989 6271 raft_consensus.cc:729] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.193436 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.197697 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e19b8189894e91a8be5a150f54cb6b with delete_type TABLET_DATA_DELETED (replaced by tablet c22cc964ceb741febfd3d1322ae05289) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.201989 6270 ts_tablet_manager.cc:1918] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.202164 6270 log.cc:1196] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/734c3196929d4814b77bce7938bf598e
I20260928 10:44:12.193120 6271 consensus_queue.cc:260] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.208268 6271 ts_tablet_manager.cc:1428] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.025s user 0.000s sys 0.003s
I20260928 10:44:12.209764 6270 ts_tablet_manager.cc:1939] T 734c3196929d4814b77bce7938bf598e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:12.210620 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 703) took 5571 ms. Trace:
I20260928 10:44:12.210732 6270 rpcz_store.cc:276] 0928 10:44:06.639167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.639245 (+ 78us) service_pool.cc:227] Handling call
0928 10:44:12.182855 (+5543610us) ts_tablet_manager.cc:1145] Deleting tablet 734c3196929d4814b77bce7938bf598e
0928 10:44:12.183780 (+ 925us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.188269 (+ 4489us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.201150 (+ 12881us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.210596 (+ 9446us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5543241}
I20260928 10:44:12.211170 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 699) took 5585 ms. Trace:
I20260928 10:44:12.211256 6270 rpcz_store.cc:276] 0928 10:44:06.626088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.739479 (+113391us) service_pool.cc:227] Handling call
0928 10:44:12.211030 (+5471551us) ts_tablet_manager.cc:1145] Deleting tablet 474e9ca2deb1478a87c978d1e119fa5f
0928 10:44:12.211041 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.211154 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5469725}
I20260928 10:44:12.211645 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 734c3196929d4814b77bce7938bf598e (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
W20260928 10:44:12.212428 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 474e9ca2deb1478a87c978d1e119fa5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e9ca2deb1478a87c978d1e119fa5f already in progress: creating tablet
I20260928 10:44:12.214250 6271 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:11.909720 6155 raft_consensus.cc:3037] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.211575 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 705) took 5404 ms. Trace:
I20260928 10:44:12.225063 6270 rpcz_store.cc:276] 0928 10:44:06.806936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.835793 (+ 28857us) service_pool.cc:227] Handling call
0928 10:44:12.211475 (+5375682us) ts_tablet_manager.cc:1145] Deleting tablet ab5abdd2484f41d7bd244db14d2b1916
0928 10:44:12.211484 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.211560 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5373715}
W20260928 10:44:12.225701 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ab5abdd2484f41d7bd244db14d2b1916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5abdd2484f41d7bd244db14d2b1916 already in progress: creating tablet
I20260928 10:44:12.226752 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 704) took 5423 ms. Trace:
I20260928 10:44:11.914124 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 9c05f19efcff41c882092c940e0567e2 (DEFAULT_TABLE table=default.Table_5cada558676a41b2b81abaae00369c39 [id=ed3d96690aee4bbba787d38d569c723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.226852 6270 rpcz_store.cc:276] 0928 10:44:06.803253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.847774 (+ 44521us) service_pool.cc:227] Handling call
0928 10:44:12.226599 (+5378825us) ts_tablet_manager.cc:1145] Deleting tablet 7ef1b939f9aa4f988180d5ea0a4a8a15
0928 10:44:12.226611 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.226729 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5378542}
I20260928 10:44:12.227913 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c05f19efcff41c882092c940e0567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.228106 6271 tablet_bootstrap.cc:654] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:12.228310 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef1b939f9aa4f988180d5ea0a4a8a15 already in progress: creating tablet
I20260928 10:44:12.232343 7205 raft_consensus.cc:482] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.914459 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 0c42035571654826a6030f15b2816992 (DEFAULT_TABLE table=default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314 [id=e0197ac37d924f1d841e18392911b7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.232496 7205 raft_consensus.cc:504] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.232906 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c42035571654826a6030f15b2816992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.233173 7205 leader_election.cc:288] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.233983 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.234589 5818 leader_election.cc:341] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.234930 6270 tablet_replica.cc:330] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.235102 6270 raft_consensus.cc:2229] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.235280 6270 raft_consensus.cc:2258] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.235821 6270 ts_tablet_manager.cc:1905] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:11.924644 7238 leader_election.cc:288] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:11.927903 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 2503ffadb38744319552aeb37c818626 (DEFAULT_TABLE table=default.Table_0c245579875c41028091fc6ace944ffc [id=347f15e6581e4efebb5c716fdcba0fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.236712 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2503ffadb38744319552aeb37c818626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.927920 6117 tablet_service.cc:1467] Processing CreateTablet for tablet cab9bc67c7474cb681566118af1bbf07 (DEFAULT_TABLE table=default.Table_ca398b35ea764963925612fa671ebaef [id=6961655b24444ca0bc824cd82276f77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.238812 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab9bc67c7474cb681566118af1bbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:11.929247 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.939839 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:11.941123 6091 leader_election.cc:341] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 8b21a965426145c9b678ae80869be833
W20260928 10:44:12.242888 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 301751us
I20260928 10:44:12.243963 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.244380 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.948112 7106 raft_consensus.cc:482] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:11.949035 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 (DEFAULT_TABLE table=default.Table_d9811c82d1fa4eff8a1065a89a8c5c13 [id=d847ce3681764bb189b9306ebb4bec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.244802 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.245007 7106 raft_consensus.cc:504] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.245268 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead8c7aa6364125bd059516cf0413e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.245632 7106 leader_election.cc:288] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.245566 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.245965 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.246609 5817 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.246642 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.246747 5817 leader_election.cc:302] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:12.247098 5817 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.247189 5817 leader_election.cc:302] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:12.247458 5817 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.247431 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.247534 5817 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:11.954228 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5445f0b3ef4132950e18c6bb05b497 (DEFAULT_TABLE table=default.Table_73d7639b37c4419f9c00c915503a0668 [id=aab82ab88b7040dcbe3e85e3c3dd15a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.250314 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.250546 7205 raft_consensus.cc:2726] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.250733 7205 raft_consensus.cc:2726] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.250762 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5445f0b3ef4132950e18c6bb05b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.250842 7205 raft_consensus.cc:2726] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.250860 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.251322 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.251793 6144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0584d6b80e43eb913c3932256cd89e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.252238 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.253787 6090 leader_election.cc:302] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:12.254106 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 240990us
I20260928 10:44:11.955770 6124 tablet_service.cc:1467] Processing CreateTablet for tablet ce8668f4d6dc45e5876a3e6e415523a2 (DEFAULT_TABLE table=default.Table_d725bb48e71f48e2beb23ef4d0b0c7b2 [id=ece4073207d74e0983fe19f1ae038740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.254503 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8668f4d6dc45e5876a3e6e415523a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.254617 7238 raft_consensus.cc:2781] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:12.254720 7238 raft_consensus.cc:686] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:12.254935 7238 consensus_queue.cc:237] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.255638 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd9b4092b1242b8a60974c445a2789a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.255856 7074 raft_consensus.cc:482] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.255880 6017 raft_consensus.cc:2454] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:12.255956 7074 raft_consensus.cc:504] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.256476 7074 leader_election.cc:288] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.257324 6090 leader_election.cc:302] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:11.956092 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 1fab26669af04128871528af607785f9 (DEFAULT_TABLE table=default.Table_18daf257df304b87a04bbf5f584865fb [id=63e7f31e01854e36a744dd6421d59ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.257747 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fab26669af04128871528af607785f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.258219 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "122fbbe54c174c4ea9cf38698debcb27" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.258587 7106 raft_consensus.cc:2781] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.258666 7106 raft_consensus.cc:482] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.258723 7106 raft_consensus.cc:3037] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.258431 6017 raft_consensus.cc:2454] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:12.260399 6090 leader_election.cc:302] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.260673 7074 raft_consensus.cc:2781] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.260736 7074 raft_consensus.cc:482] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.260787 7074 raft_consensus.cc:3037] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:11.976711 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:11.976890 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db824b43256640e9bfef44da1ccf8e1a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:11.976670 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b947da50894cdba0f49d0738f60187" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.032096 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 (DEFAULT_TABLE table=default.Table_c1af1980a6344ca7b54ded68d92e688f [id=c097fa41cb3f4c81b759f8e9cf7eb27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.261739 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 606a9cb61e0f4f558008d09177ded9f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:12.262327 6091 consensus_peers.cc:487] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23d4da5ccb214a4bbc543c67529b59cf. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.042623 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b6d18cf0304edc8b3ca1d4d106decb with delete_type TABLET_DATA_DELETED (replaced by tablet b300d0ea612c4c3993188c8504ce334c) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.265148 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b4deb353974c8aae4bb8148869758d with delete_type TABLET_DATA_DELETED (replaced by tablet 502d275d161945ce86626594ab0d89b3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.265301 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b21a965426145c9b678ae80869be833 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.265408 6125 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.042634 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 25a2f20766024978a16b6bccd366a848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.050186 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.071511 6275 tablet_bootstrap.cc:492] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.265874 6275 ts_tablet_manager.cc:1397] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.374s user 0.002s sys 0.002s
I20260928 10:44:12.265990 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1415cbe9fa15468a91932cdec4612cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.266587 6275 raft_consensus.cc:348] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.266769 6275 raft_consensus.cc:374] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.266813 6275 raft_consensus.cc:729] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:12.266862 5955 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.266978 6275 consensus_queue.cc:260] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:12.267257 5955 leader_election.cc:341] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.267334 5955 leader_election.cc:302] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.267454 6275 ts_tablet_manager.cc:1428] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260928 10:44:12.267622 5955 leader_election.cc:341] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.267673 6275 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.267937 7168 raft_consensus.cc:2726] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.268173 7168 raft_consensus.cc:482] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.268265 7168 raft_consensus.cc:504] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.268781 7168 leader_election.cc:288] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.075855 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 46490066d50847ceb2362e35dce84f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.269052 6275 tablet_bootstrap.cc:654] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:12.269599 5957 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: efa178fc1e344069b086003d39f1b848
I20260928 10:44:12.080442 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 4f45a52f81e64b13ac52ae74d26d7ea7 (DEFAULT_TABLE table=default.Table_c280f2cddea249448f42d09bbbdba884 [id=bb6038a71cc940bfb18d0622ae03931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.082212 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 9a86dc338bb24b38867d4aa1f45d1dac (DEFAULT_TABLE table=default.Table_5cd9c9a158b7458d83040f7fd15a911c [id=6def6cf7afda4cfaa4c80497885dab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.114360 6131 tablet_service.cc:1467] Processing CreateTablet for tablet f2661873e89c40ac8497bb9f88769754 (DEFAULT_TABLE table=default.Table_f8ca99f63fd244578040776ca622e0c6 [id=c324374242ba4b5da380d8e6a4523f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.270045 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f45a52f81e64b13ac52ae74d26d7ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.270253 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2661873e89c40ac8497bb9f88769754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.270183 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.115963 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b152e2cd91948348a2bb5f557c91757) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.123553 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.124056 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 (DEFAULT_TABLE table=default.Table_f333b9300b284c31b2f59f434eeb2f48 [id=5f07b8d9c26f4cf1af5e017ab2c851a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.271459 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.137581 6988 raft_consensus.cc:482] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.274436 6988 raft_consensus.cc:504] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.275024 6988 leader_election.cc:288] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.154094 6129 tablet_service.cc:1467] Processing CreateTablet for tablet da06864105a64b42a1c9701c07a241b8 (DEFAULT_TABLE table=default.Table_246184c33447431eaeb718fe8ce2708d [id=593c83175526474a82856f4fbc6a6432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:12.275309 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da06864105a64b42a1c9701c07a241b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.279011 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a86dc338bb24b38867d4aa1f45d1dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:12.280082 7106 raft_consensus.cc:504] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.280607 7106 leader_election.cc:288] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.288658 7074 raft_consensus.cc:504] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.289269 7074 leader_election.cc:288] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:12.290447 5955 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.290594 5955 leader_election.cc:302] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.291240 7250 raft_consensus.cc:2726] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.291740 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 44278.1us
W20260928 10:44:12.291980 5817 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.292073 5817 leader_election.cc:302] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:12.292373 5817 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.292452 5817 leader_election.cc:302] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.292646 7184 raft_consensus.cc:2726] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.292768 7184 raft_consensus.cc:2726] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.293437 5817 leader_election.cc:341] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.293522 5817 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.293754 7205 raft_consensus.cc:2726] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.293853 5817 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.293929 5817 leader_election.cc:302] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.294088 7205 raft_consensus.cc:2726] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.294188 5817 leader_election.cc:341] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.294260 5817 leader_election.cc:302] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.294417 7205 raft_consensus.cc:2726] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.298066 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "122fbbe54c174c4ea9cf38698debcb27" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:12.298285 6019 raft_consensus.cc:3037] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.300976 6019 raft_consensus.cc:2454] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:12.301877 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfd9b4092b1242b8a60974c445a2789a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:12.302074 6021 raft_consensus.cc:3037] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.305099 6090 leader_election.cc:302] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.305377 6976 raft_consensus.cc:482] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.305505 6976 raft_consensus.cc:504] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.306143 6976 leader_election.cc:288] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.306293 6976 raft_consensus.cc:2781] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:12.306459 6272 log.cc:1196] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a6b418bbb3364006b097e3a78edf5f55
W20260928 10:44:12.306717 6090 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: bae5a2038947413f95f134602081c889
I20260928 10:44:12.306427 6976 raft_consensus.cc:686] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:12.307255 6976 consensus_queue.cc:237] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.307380 6272 ts_tablet_manager.cc:1939] T a6b418bbb3364006b097e3a78edf5f55 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:12.308223 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 756) took 3760 ms. Trace:
I20260928 10:44:12.316341 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b257d722a42e44f4ac554b1ebe7d8e31
W20260928 10:44:12.316991 6091 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:12.317278 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 with delete_type TABLET_DATA_DELETED (replaced by tablet c2f0c7eabf66422c82d7201ea72514e3) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:12.317458 6091 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:12.317816 5695 catalog_manager.cc:6565] ReplaceTablet: tablet b257d722a42e44f4ac554b1ebe7d8e31 deleted and replaced by tablet c2f0c7eabf66422c82d7201ea72514e3
I20260928 10:44:12.320628 7168 consensus_queue.cc:1035] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.321050 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 with delete_type TABLET_DATA_DELETED (replaced by tablet c2f0c7eabf66422c82d7201ea72514e3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.308476 6272 rpcz_store.cc:276] 0928 10:44:08.547570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.550657 (+ 3087us) service_pool.cc:227] Handling call
0928 10:44:11.870254 (+3319597us) ts_tablet_manager.cc:1145] Deleting tablet a6b418bbb3364006b097e3a78edf5f55
0928 10:44:11.870264 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:11.886349 (+ 16085us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:11.906766 (+ 20417us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.308096 (+401330us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3270803}
I20260928 10:44:12.321848 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a6b418bbb3364006b097e3a78edf5f55 (table default.Table_534373dcfd75430c9608190a3979421a [id=5557e0d93f67480ca44cf2cd28b92e2e]) successfully deleted
I20260928 10:44:12.324880 6273 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:12.325133 6273 ts_tablet_manager.cc:1397] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.173s user 0.012s sys 0.008s
I20260928 10:44:12.324986 6270 ts_tablet_manager.cc:1918] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.325697 6270 log.cc:1196] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1631d396362a4cffa1dec06d00894c63
I20260928 10:44:12.325827 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 with delete_type TABLET_DATA_DELETED (replaced by tablet c2f0c7eabf66422c82d7201ea72514e3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.326093 6273 raft_consensus.cc:348] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.326304 6273 raft_consensus.cc:374] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.326362 6273 raft_consensus.cc:729] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.326714 6273 consensus_queue.cc:260] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.328126 6270 ts_tablet_manager.cc:1939] T 1631d396362a4cffa1dec06d00894c63 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:12.329532 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5cd4c574cbc049038d93b2c1b85f0ceb" } new_table_name: "default.Table_360ffaceac464cdfb9ca8278f925d9fc" modify_external_catalogs: true
W20260928 10:44:12.332479 5817 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.333019 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_db8191bd52844ecd8c92c336e8d687fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:12.333212 5817 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.333562 7184 raft_consensus.cc:2726] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.333972 5817 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.334095 5817 leader_election.cc:302] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.334420 7184 raft_consensus.cc:2726] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.334796 5817 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.334941 5817 leader_election.cc:302] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.335162 7184 raft_consensus.cc:2726] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.334612 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 707) took 5484 ms. Trace:
W20260928 10:44:12.335496 5817 leader_election.cc:341] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.335650 5817 leader_election.cc:302] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.335879 7184 raft_consensus.cc:2726] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.336179 5817 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.335942 5700 catalog_manager.cc:5495] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:12.336318 5817 leader_election.cc:302] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.336504 7184 raft_consensus.cc:2726] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.336582 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 04b947da50894cdba0f49d0738f60187 (table default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916]). Expected version 2 got 0
I20260928 10:44:12.335407 6270 rpcz_store.cc:276] 0928 10:44:06.855807 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.898114 (+ 42307us) service_pool.cc:227] Handling call
0928 10:44:12.234880 (+5336766us) ts_tablet_manager.cc:1145] Deleting tablet 1631d396362a4cffa1dec06d00894c63
0928 10:44:12.234892 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.292189 (+ 57297us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.324503 (+ 32314us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.334416 (+ 9913us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5336322}
W20260928 10:44:12.336874 5817 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.337541 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1631d396362a4cffa1dec06d00894c63 (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
W20260928 10:44:12.338536 6090 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 86b16eb36c034591ac1603ab84fd9342
W20260928 10:44:12.338692 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db8191bd52844ecd8c92c336e8d687fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.338899 6270 tablet_replica.cc:330] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.340482 6270 raft_consensus.cc:2229] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.341881 6270 raft_consensus.cc:2258] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.346593 6270 ts_tablet_manager.cc:1905] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.348964 6021 raft_consensus.cc:2454] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:12.353492 6273 ts_tablet_manager.cc:1428] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.028s user 0.000s sys 0.002s
I20260928 10:44:12.356751 5817 leader_election.cc:302] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.357041 6273 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:12.357136 7184 raft_consensus.cc:2726] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.358949 6271 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.358982 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6d4a32d90f93464e8962fdc09b63dd1d" } new_table_name: "default.Table_87665cb7b0024a158f2d2ae70a096c5e" modify_external_catalogs: true
I20260928 10:44:12.359338 6271 ts_tablet_manager.cc:1397] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.147s user 0.006s sys 0.012s
I20260928 10:44:12.360142 6271 raft_consensus.cc:348] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.360481 6271 raft_consensus.cc:374] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.360625 6271 raft_consensus.cc:729] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.360988 6271 consensus_queue.cc:260] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.360486 6273 tablet_bootstrap.cc:654] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.369032 7250 raft_consensus.cc:482] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.369182 7250 raft_consensus.cc:504] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.369732 7250 leader_election.cc:288] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.370738 6271 ts_tablet_manager.cc:1428] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260928 10:44:12.372133 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 760) took 3774 ms. Trace:
I20260928 10:44:12.372784 6271 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.374534 7302 raft_consensus.cc:482] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.374692 7302 raft_consensus.cc:504] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.375247 7302 leader_election.cc:288] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.376739 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:12.376865 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.377053 5883 raft_consensus.cc:2454] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:12.377502 5957 leader_election.cc:302] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:12.377805 7250 raft_consensus.cc:2781] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.377885 7250 raft_consensus.cc:482] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.377940 7250 raft_consensus.cc:3037] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.380560 7250 raft_consensus.cc:504] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.381134 7250 leader_election.cc:288] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:12.381736 5818 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.384011 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9b454e35f83d493eb2b483872f5ad81c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.384665 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b454e35f83d493eb2b483872f5ad81c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.385398 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:12.385556 5883 raft_consensus.cc:3037] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.388546 6271 tablet_bootstrap.cc:654] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.388733 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 122fbbe54c174c4ea9cf38698debcb27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.389046 6272 rpcz_store.cc:276] 0928 10:44:08.548050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.548379 (+ 329us) service_pool.cc:227] Handling call
0928 10:44:12.322182 (+3773803us) ts_tablet_manager.cc:1145] Deleting tablet 0e4594eae7b840ff980f67da8ed82e01
0928 10:44:12.322194 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.322294 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3675459}
W20260928 10:44:12.389530 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0e4594eae7b840ff980f67da8ed82e01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4594eae7b840ff980f67da8ed82e01 already in progress: creating tablet
I20260928 10:44:12.398687 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet a6b418bbb3364006b097e3a78edf5f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:12.400833 6091 consensus_peers.cc:487] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98bd99e7bdb647ceb9357f88affc45d9. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.401023 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 759) took 3842 ms. Trace:
W20260928 10:44:12.401110 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 56766.2us
I20260928 10:44:12.401157 6272 rpcz_store.cc:276] 0928 10:44:08.547960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.548359 (+ 399us) service_pool.cc:227] Handling call
0928 10:44:12.389817 (+3841458us) ts_tablet_manager.cc:1145] Deleting tablet 7834a54e59114a77b4e54e9190049a47
0928 10:44:12.389829 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.389931 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3742470}
W20260928 10:44:12.401391 6091 leader_election.cc:341] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: dfd9b4092b1242b8a60974c445a2789a
W20260928 10:44:12.401608 6091 leader_election.cc:341] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 86b16eb36c034591ac1603ab84fd9342
I20260928 10:44:12.401649 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 780) took 3828 ms. Trace:
I20260928 10:44:12.401834 6091 leader_election.cc:302] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.401762 6272 rpcz_store.cc:276] 0928 10:44:08.573019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.684984 (+111965us) service_pool.cc:227] Handling call
0928 10:44:12.401449 (+3716465us) ts_tablet_manager.cc:1145] Deleting tablet 73c8f859a3ac4a4b89f1bb2929aa3c92
0928 10:44:12.401461 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.401566 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3716266}
I20260928 10:44:12.402208 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 781) took 3829 ms. Trace:
I20260928 10:44:12.402318 6272 rpcz_store.cc:276] 0928 10:44:08.573113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.685210 (+112097us) service_pool.cc:227] Handling call
0928 10:44:12.402020 (+3716810us) ts_tablet_manager.cc:1145] Deleting tablet bc8b8b3a518c42ad9e3c76c9743e361b
0928 10:44:12.402039 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.402130 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3715939}
W20260928 10:44:12.402578 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7834a54e59114a77b4e54e9190049a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7834a54e59114a77b4e54e9190049a47 already in progress: creating tablet
I20260928 10:44:12.402714 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 783) took 3829 ms. Trace:
I20260928 10:44:12.402808 6272 rpcz_store.cc:276] 0928 10:44:08.573257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.692336 (+119079us) service_pool.cc:227] Handling call
0928 10:44:12.402567 (+3710231us) ts_tablet_manager.cc:1145] Deleting tablet c90c3e290377422385a15e23a0e7dd9a
0928 10:44:12.402577 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.402652 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3709988}
W20260928 10:44:12.402935 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 already in progress: creating tablet
I20260928 10:44:12.403162 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 785) took 3829 ms. Trace:
I20260928 10:44:12.403267 6272 rpcz_store.cc:276] 0928 10:44:08.573409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.696662 (+123253us) service_pool.cc:227] Handling call
0928 10:44:12.403011 (+3706349us) ts_tablet_manager.cc:1145] Deleting tablet 9a94c95e55fa46d2a8badd9229f55cf7
0928 10:44:12.403020 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.403085 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3703887}
I20260928 10:44:12.403616 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 788) took 3829 ms. Trace:
I20260928 10:44:12.403713 6272 rpcz_store.cc:276] 0928 10:44:08.573620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.702682 (+129062us) service_pool.cc:227] Handling call
0928 10:44:12.403489 (+3700807us) ts_tablet_manager.cc:1145] Deleting tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d
0928 10:44:12.403497 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.403561 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3691688}
I20260928 10:44:12.403980 6272 tablet_replica.cc:330] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:12.404152 5883 raft_consensus.cc:2454] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:12.404191 6272 raft_consensus.cc:2229] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:12.404585 6272 raft_consensus.cc:2258] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.404554 5957 leader_election.cc:302] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:12.404950 7250 raft_consensus.cc:2781] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:12.405157 7250 raft_consensus.cc:686] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:12.405216 6272 ts_tablet_manager.cc:1905] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.405381 7250 consensus_queue.cc:237] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:12.405886 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bc8b8b3a518c42ad9e3c76c9743e361b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8b8b3a518c42ad9e3c76c9743e361b already in progress: creating tablet
W20260928 10:44:12.406170 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c90c3e290377422385a15e23a0e7dd9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90c3e290377422385a15e23a0e7dd9a already in progress: creating tablet
W20260928 10:44:12.406383 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9a94c95e55fa46d2a8badd9229f55cf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a94c95e55fa46d2a8badd9229f55cf7 already in progress: creating tablet
I20260928 10:44:12.406603 7302 raft_consensus.cc:482] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:12.406670 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d already in progress: creating tablet
I20260928 10:44:12.406756 7302 raft_consensus.cc:504] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:12.407284 6091 leader_election.cc:341] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 122fbbe54c174c4ea9cf38698debcb27
W20260928 10:44:12.407603 6091 leader_election.cc:341] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bae5a2038947413f95f134602081c889
I20260928 10:44:12.407718 6091 leader_election.cc:302] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.407986 7074 raft_consensus.cc:2726] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.408178 7074 raft_consensus.cc:2726] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.408252 6091 consensus_peers.cc:487] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d5b422c70a84cc0bc9f8a686f4e2c82. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.400873 6090 consensus_peers.cc:487] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87d5dd4e5b544262938b1822510d8b9f. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.408702 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 63274.2us
I20260928 10:44:12.409065 7302 leader_election.cc:288] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.409575 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.410187 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.410746 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:12.411098 6090 leader_election.cc:302] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.411403 7074 raft_consensus.cc:2781] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:12.411849 6988 consensus_queue.cc:1035] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.412249 7074 raft_consensus.cc:686] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
W20260928 10:44:12.412294 6090 consensus_peers.cc:487] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1631d396362a4cffa1dec06d00894c63. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.412515 7074 consensus_queue.cc:237] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:12.413729 5955 consensus_peers.cc:487] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.413928 5955 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.414184 5955 leader_election.cc:341] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.414723 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.410629 5818 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.415536 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.420092 5817 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.420334 5817 leader_election.cc:302] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.420598 7184 raft_consensus.cc:482] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.420763 7184 raft_consensus.cc:504] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.421478 7184 leader_election.cc:288] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.421654 7184 raft_consensus.cc:2726] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.422338 5817 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.422557 5817 leader_election.cc:302] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.422880 7184 raft_consensus.cc:2726] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.423889 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.424307 6272 ts_tablet_manager.cc:1918] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 10:44:12.424719 5818 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.425096 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d44a54bafba54a7695918e49e2da9dec" } modify_external_catalogs: true
I20260928 10:44:12.425369 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d44a54bafba54a7695918e49e2da9dec" } modify_external_catalogs: true
I20260928 10:44:12.427603 6270 ts_tablet_manager.cc:1918] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.434587 6269 ts_tablet_manager.cc:1918] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:12.434887 6272 log.cc:1196] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/48ccd7551f6a4fc8b41e70e94749e6f1
I20260928 10:44:12.435420 6272 ts_tablet_manager.cc:1939] T 48ccd7551f6a4fc8b41e70e94749e6f1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:12.435854 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 789) took 3862 ms. Trace:
I20260928 10:44:12.436057 6272 rpcz_store.cc:276] 0928 10:44:08.573771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.709481 (+135710us) service_pool.cc:227] Handling call
0928 10:44:12.403901 (+3694420us) ts_tablet_manager.cc:1145] Deleting tablet 48ccd7551f6a4fc8b41e70e94749e6f1
0928 10:44:12.403909 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.417091 (+ 13182us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.424129 (+ 7038us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.435816 (+ 11687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3655665}
I20260928 10:44:12.436585 6988 consensus_queue.cc:1035] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.436653 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 48ccd7551f6a4fc8b41e70e94749e6f1 (table default.Table_97cfcb43afbc4ecf879d65d4b6d55a60 [id=713ed1d32e434e9ba802149b82f80e67]) successfully deleted
I20260928 10:44:12.437027 6272 tablet_replica.cc:330] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:12.437340 6272 raft_consensus.cc:2229] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:12.437739 6272 raft_consensus.cc:2258] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.427424 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.440464 6270 log.cc:1196] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/0e9583b5637a428db383320d98a7a280
I20260928 10:44:12.430774 7238 consensus_queue.cc:1035] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.431449 6275 tablet_bootstrap.cc:492] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.432895 7226 consensus_queue.cc:1035] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.441380 6275 ts_tablet_manager.cc:1397] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.174s user 0.002s sys 0.008s
I20260928 10:44:12.443311 6270 ts_tablet_manager.cc:1939] T 0e9583b5637a428db383320d98a7a280 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:12.444196 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d85cb2a30f8342ed946f7d773bf8227e consensus state has no leader
I20260928 10:44:12.445079 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 706) took 5596 ms. Trace:
I20260928 10:44:12.445716 6270 rpcz_store.cc:276] 0928 10:44:06.849026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.921517 (+ 72491us) service_pool.cc:227] Handling call
0928 10:44:12.338431 (+5416914us) ts_tablet_manager.cc:1145] Deleting tablet 0e9583b5637a428db383320d98a7a280
0928 10:44:12.338447 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.387216 (+ 48769us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.427480 (+ 40264us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.445054 (+ 17574us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5416159}
W20260928 10:44:12.427299 6091 consensus_peers.cc:487] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82b3afe074194023ba788094a2a6b81c. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.447574 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 0e9583b5637a428db383320d98a7a280 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:12.448633 6275 raft_consensus.cc:348] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.448776 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_91be0f66e619422c865c1ec44ab5e9ff" } modify_external_catalogs: true
I20260928 10:44:12.448908 6275 raft_consensus.cc:374] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.448978 6275 raft_consensus.cc:729] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.448966 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_91be0f66e619422c865c1ec44ab5e9ff" } modify_external_catalogs: true
I20260928 10:44:12.449213 6275 consensus_queue.cc:260] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.449218 6270 tablet_replica.cc:330] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.449751 6275 ts_tablet_manager.cc:1428] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:44:12.450064 6275 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.450840 6270 raft_consensus.cc:2229] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.452126 6275 tablet_bootstrap.cc:654] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.452147 6270 raft_consensus.cc:2258] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.457888 6270 ts_tablet_manager.cc:1905] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:12.459908 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cac941c364584322ae85798731680a6e consensus state has no leader
W20260928 10:44:12.464124 6091 consensus_peers.cc:487] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2635c7c47ba4383b6b0f07cd3b42f74. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.464030 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_75ed8b29e5124e269ae766667d19c71c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.464721 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ed8b29e5124e269ae766667d19c71c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.469537 7238 raft_consensus.cc:482] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.469758 7238 raft_consensus.cc:504] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.470702 7238 leader_election.cc:288] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.474987 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b4deb353974c8aae4bb8148869758d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.475224 6022 raft_consensus.cc:2454] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:12.475963 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d39e1e4d18d6450580e28614ae4c2895 consensus state has no leader
I20260928 10:44:12.476717 6090 leader_election.cc:302] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.476960 7226 raft_consensus.cc:2781] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.477025 7226 raft_consensus.cc:482] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.477077 7226 raft_consensus.cc:3037] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.479991 7226 raft_consensus.cc:504] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.480127 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_22e1516105d24daaa1e7b491ce777916" } modify_external_catalogs: true
I20260928 10:44:12.480362 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_22e1516105d24daaa1e7b491ce777916" } modify_external_catalogs: true
I20260928 10:44:12.480647 7226 leader_election.cc:288] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.480952 6275 tablet_bootstrap.cc:492] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.481067 6275 ts_tablet_manager.cc:1397] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260928 10:44:12.481339 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b4deb353974c8aae4bb8148869758d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
W20260928 10:44:12.481457 6091 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 21b4deb353974c8aae4bb8148869758d
I20260928 10:44:12.481523 6022 raft_consensus.cc:3037] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:12.482208 6091 leader_election.cc:341] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 21b4deb353974c8aae4bb8148869758d
I20260928 10:44:12.482983 6272 ts_tablet_manager.cc:1905] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.484141 6022 raft_consensus.cc:2454] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
W20260928 10:44:12.487370 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet d85cb2a30f8342ed946f7d773bf8227e (table default.Table_f46a81b5d00a440f8139ef39c5f912c6 [id=07f036aa3d1d4510b8008431fcb58935], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d85cb2a30f8342ed946f7d773bf8227e consensus state has no leader
W20260928 10:44:12.490540 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9da796356b8f45248a331412588136fc has no consensus state
I20260928 10:44:12.493950 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d1a47118727d4efdb0ceec0575bbeda8" } modify_external_catalogs: true
I20260928 10:44:12.494161 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d1a47118727d4efdb0ceec0575bbeda8" } modify_external_catalogs: true
I20260928 10:44:12.484543 6090 leader_election.cc:302] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.495749 6275 raft_consensus.cc:348] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.501627 7226 raft_consensus.cc:2781] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 10:44:12.448079 5817 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.501754 6275 raft_consensus.cc:374] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.501844 6275 raft_consensus.cc:729] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.501883 7226 raft_consensus.cc:686] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:12.501991 5817 leader_election.cc:302] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.502102 6275 consensus_queue.cc:260] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.502362 7184 raft_consensus.cc:2726] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.502180 7226 consensus_queue.cc:237] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.502694 6275 ts_tablet_manager.cc:1428] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
W20260928 10:44:12.502905 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 54793.4us
I20260928 10:44:12.503058 6275 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.448256 7302 raft_consensus.cc:482] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.503834 7302 raft_consensus.cc:504] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.503852 6271 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.504693 7302 leader_election.cc:288] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.505651 6269 log.cc:1196] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:12.505541 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.505517 6271 ts_tablet_manager.cc:1397] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.133s user 0.014s sys 0.000s
W20260928 10:44:12.506211 5818 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.506757 6269 ts_tablet_manager.cc:1939] T bb5eed4318fe482789fee32e24a49bfc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:12.508179 6275 tablet_bootstrap.cc:654] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:12.508304 6091 consensus_peers.cc:487] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 104a223ec6ef47988d0aa3335a1f81de. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.508528 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 725) took 5300 ms. Trace:
I20260928 10:44:12.508656 6269 rpcz_store.cc:276] 0928 10:44:07.207776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.207825 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:11.900429 (+4692604us) ts_tablet_manager.cc:1145] Deleting tablet bb5eed4318fe482789fee32e24a49bfc
0928 10:44:11.900443 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.375711 (+475268us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.434375 (+ 58664us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.508490 (+ 74115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4692416}
I20260928 10:44:12.508800 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.509208 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet bb5eed4318fe482789fee32e24a49bfc (table default.Table_c08de4d3d9ce4f20bed63a830c987c35 [id=42b8d28c18164d34bbad1117d30d8289]) successfully deleted
I20260928 10:44:12.509753 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 726) took 5280 ms. Trace:
I20260928 10:44:12.509938 6269 rpcz_store.cc:276] 0928 10:44:07.229552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.229609 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:12.509582 (+5279973us) ts_tablet_manager.cc:1145] Deleting tablet f63312cb046844dc8eddbb76f614029b
0928 10:44:12.509595 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.509694 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5279711}
I20260928 10:44:12.507591 7302 raft_consensus.cc:482] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.510370 7302 raft_consensus.cc:504] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.510648 6988 consensus_queue.cc:1035] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.511060 7302 leader_election.cc:288] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.511723 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.513640 5817 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.513873 5817 leader_election.cc:302] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.513952 6271 raft_consensus.cc:348] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.514176 6271 raft_consensus.cc:374] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.514240 6271 raft_consensus.cc:729] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.514536 7302 raft_consensus.cc:2726] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.516328 6271 consensus_queue.cc:260] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.518170 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.518905 5817 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.520716 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_2357f1366fe443be8c84b81b162dc35a [id=6677562fe2604addb84af531539cbebd]). Expected version 4 got 0
I20260928 10:44:12.520895 6271 ts_tablet_manager.cc:1428] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260928 10:44:12.523054 6271 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.526502 7029 raft_consensus.cc:482] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.526679 7029 raft_consensus.cc:504] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.527309 7029 leader_election.cc:288] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.531999 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.532262 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 734c3196929d4814b77bce7938bf598e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.532401 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.532518 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.532640 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.533481 7029 raft_consensus.cc:482] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.533634 7029 raft_consensus.cc:504] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.534198 7029 leader_election.cc:288] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.534857 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.535427 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.549804 6271 tablet_bootstrap.cc:654] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.550197 6270 ts_tablet_manager.cc:1918] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.552038 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:12.553244 5818 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.553455 5818 leader_election.cc:302] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.553740 7302 raft_consensus.cc:2726] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.555079 6090 consensus_peers.cc:487] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e9583b5637a428db383320d98a7a280. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.554697 5957 leader_election.cc:341] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:44:12.553278 6270 log.cc:1196] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/97401498df144cc689066ea3033d68ef
I20260928 10:44:12.556056 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39cbecd1c19541f28bd32b7c46f2df61" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.556900 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847b18c212474456ac9b40eee055dbd0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.555416 6976 consensus_queue.cc:1035] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.564513 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
W20260928 10:44:12.565907 6091 consensus_peers.cc:487] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd225da0b4b445c6ac03634d975e8396. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.566581 6270 ts_tablet_manager.cc:1939] T 97401498df144cc689066ea3033d68ef P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:12.566668 6091 consensus_peers.cc:487] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecb1d807c9f04fe4b02e3343f0c6511c. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.566711 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f42d5aef2424b3aacc8564d98cd3b67 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e4594eae7b840ff980f67da8ed82e01) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.568136 6275 tablet_bootstrap.cc:492] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.568280 6275 ts_tablet_manager.cc:1397] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.065s user 0.005s sys 0.003s
I20260928 10:44:12.568962 6275 raft_consensus.cc:348] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.571623 6275 raft_consensus.cc:374] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.571682 6275 raft_consensus.cc:729] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.571682 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7e753a6df4ff4d8ab22c7b18b6004f9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:12.571853 6275 consensus_queue.cc:260] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:12.572355 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e753a6df4ff4d8ab22c7b18b6004f9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.572422 6275 ts_tablet_manager.cc:1428] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:12.572666 6275 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.575706 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 708) took 5648 ms. Trace:
I20260928 10:44:12.576164 6270 rpcz_store.cc:276] 0928 10:44:06.927439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:06.927516 (+ 77us) service_pool.cc:227] Handling call
0928 10:44:12.448843 (+5521327us) ts_tablet_manager.cc:1145] Deleting tablet 97401498df144cc689066ea3033d68ef
0928 10:44:12.449005 (+ 162us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.511738 (+ 62733us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.549218 (+ 37480us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.575686 (+ 26468us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5520561}
I20260928 10:44:12.577847 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 97401498df144cc689066ea3033d68ef (table default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]) successfully deleted
I20260928 10:44:12.578326 6275 tablet_bootstrap.cc:654] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.578739 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 722) took 5371 ms. Trace:
I20260928 10:44:12.579167 6270 rpcz_store.cc:276] 0928 10:44:07.207714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.207797 (+ 83us) service_pool.cc:227] Handling call
0928 10:44:12.578079 (+5370282us) ts_tablet_manager.cc:1145] Deleting tablet bb5eed4318fe482789fee32e24a49bfc
0928 10:44:12.578091 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.578720 (+ 629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5369908}
W20260928 10:44:12.580540 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bb5eed4318fe482789fee32e24a49bfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb5eed4318fe482789fee32e24a49bfc already in progress: creating tablet
I20260928 10:44:12.581180 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 723) took 5351 ms. Trace:
W20260928 10:44:12.582501 5957 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 847b18c212474456ac9b40eee055dbd0
I20260928 10:44:12.582628 5882 raft_consensus.cc:1261] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Refusing update from remote peer 2f6ffbf4f0534383bf89d15aa37e3027: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 10:44:12.583287 7250 consensus_queue.cc:1035] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.581831 6270 rpcz_store.cc:276] 0928 10:44:07.230075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.230130 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:12.580585 (+5350455us) ts_tablet_manager.cc:1145] Deleting tablet f63312cb046844dc8eddbb76f614029b
0928 10:44:12.580594 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.581161 (+ 567us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5350241}
W20260928 10:44:12.584858 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f63312cb046844dc8eddbb76f614029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f63312cb046844dc8eddbb76f614029b already in progress: creating tablet
I20260928 10:44:12.584997 6275 tablet_bootstrap.cc:492] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.585110 6275 ts_tablet_manager.cc:1397] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260928 10:44:12.586844 6275 raft_consensus.cc:348] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.587064 6275 raft_consensus.cc:374] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.587118 6275 raft_consensus.cc:729] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.587846 6275 consensus_queue.cc:260] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.588330 6275 ts_tablet_manager.cc:1428] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:12.588562 6275 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.589833 6275 tablet_bootstrap.cc:654] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.595003 6275 tablet_bootstrap.cc:492] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.595132 6275 ts_tablet_manager.cc:1397] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:44:12.595331 6270 tablet_replica.cc:330] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:12.596369 6270 raft_consensus.cc:2229] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.596540 6275 raft_consensus.cc:348] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.596736 6275 raft_consensus.cc:374] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.596810 6275 raft_consensus.cc:729] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.597641 6270 raft_consensus.cc:2258] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.597872 6275 consensus_queue.cc:260] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.598413 6275 ts_tablet_manager.cc:1428] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:12.599449 6275 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.600737 7205 raft_consensus.cc:482] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.600813 6275 tablet_bootstrap.cc:654] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.602838 6270 ts_tablet_manager.cc:1905] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.605764 7302 raft_consensus.cc:482] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.605989 7302 raft_consensus.cc:504] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.606622 7184 raft_consensus.cc:482] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.606767 7184 raft_consensus.cc:504] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.606923 6275 tablet_bootstrap.cc:492] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.607048 6275 ts_tablet_manager.cc:1397] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260928 10:44:12.607323 7184 leader_election.cc:288] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.607467 7205 raft_consensus.cc:504] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.607760 6275 raft_consensus.cc:348] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.608021 7205 leader_election.cc:288] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.608081 6275 raft_consensus.cc:374] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.608134 6275 raft_consensus.cc:729] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.608589 7302 leader_election.cc:288] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.609637 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.610880 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.612282 6275 consensus_queue.cc:260] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.612874 6275 ts_tablet_manager.cc:1428] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:44:12.613538 6275 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.613507 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.614439 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.614964 6275 tablet_bootstrap.cc:654] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.615273 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.615989 5817 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.616285 5817 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.616562 5817 leader_election.cc:341] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.621470 6273 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:12.621680 6273 ts_tablet_manager.cc:1397] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.265s user 0.023s sys 0.033s
I20260928 10:44:12.622504 6273 raft_consensus.cc:348] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.622751 6273 raft_consensus.cc:374] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.622825 6273 raft_consensus.cc:729] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.623095 6273 consensus_queue.cc:260] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.623656 6273 ts_tablet_manager.cc:1428] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:12.623968 6273 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:12.624907 7074 raft_consensus.cc:482] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.625126 7250 raft_consensus.cc:482] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.625051 7074 raft_consensus.cc:504] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.625301 7250 raft_consensus.cc:504] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.625674 7074 leader_election.cc:288] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.626719 7250 leader_election.cc:288] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.627698 6273 tablet_bootstrap.cc:654] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.631485 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.632148 7250 raft_consensus.cc:482] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.632357 7250 raft_consensus.cc:504] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.632741 7302 raft_consensus.cc:482] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.632937 7302 raft_consensus.cc:504] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.633330 7250 leader_election.cc:288] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.633526 7302 leader_election.cc:288] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.634497 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75539c390965493eaa69a0d1215fa922" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.635988 5818 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.639653 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75539c390965493eaa69a0d1215fa922" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.640548 6275 tablet_bootstrap.cc:492] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:12.640692 6275 ts_tablet_manager.cc:1397] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.007s
W20260928 10:44:12.640905 5955 leader_election.cc:341] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.641048 5955 leader_election.cc:302] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.641490 6275 raft_consensus.cc:348] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.641701 6275 raft_consensus.cc:374] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.641759 6275 raft_consensus.cc:729] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:12.641780 5955 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.641889 5955 leader_election.cc:302] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.642315 7029 raft_consensus.cc:2726] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.642504 7029 raft_consensus.cc:2726] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.643781 6275 consensus_queue.cc:260] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.644935 6275 ts_tablet_manager.cc:1428] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 10:44:12.645745 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:12.646282 6275 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:12.648277 6275 tablet_bootstrap.cc:654] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.658223 7250 raft_consensus.cc:482] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.658557 7250 raft_consensus.cc:504] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.659844 5818 leader_election.cc:302] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.659574 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b77c90bc2ecc4fc29a4786152cb977bd" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.662000 6018 raft_consensus.cc:2454] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:12.640461 5817 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.660116 6273 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:12.663870 6273 ts_tablet_manager.cc:1397] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.009s
I20260928 10:44:12.665365 7302 raft_consensus.cc:2726] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.665591 6273 raft_consensus.cc:348] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.665925 6273 raft_consensus.cc:374] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.666029 6273 raft_consensus.cc:729] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.666273 6273 consensus_queue.cc:260] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.666923 6273 ts_tablet_manager.cc:1428] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:12.667273 6273 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:12.669812 6273 tablet_bootstrap.cc:654] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.675922 6270 ts_tablet_manager.cc:1918] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.677577 6270 log.cc:1196] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:12.681661 6270 ts_tablet_manager.cc:1939] T f9a0d63c6cbc4eebaf42dc7f969f243c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:12.685515 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.686040 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e1f8a63fed4c82ac95c2fbb7bc633d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.687143 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.688472 6090 leader_election.cc:302] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.688539 7106 consensus_queue.cc:1035] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.688648 6976 consensus_queue.cc:1035] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:12.689013 6976 raft_consensus.cc:2781] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.689078 6976 raft_consensus.cc:482] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.689152 6976 raft_consensus.cc:3037] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.691663 6976 raft_consensus.cc:504] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.692209 6976 leader_election.cc:288] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:12.693710 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a78458ef1bd44c5acb9ae98f123089f consensus state has no leader
I20260928 10:44:12.694846 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:12.696105 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bbb6a08018174f08998a7eab84a49785" } modify_external_catalogs: true
I20260928 10:44:12.696343 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bbb6a08018174f08998a7eab84a49785" } modify_external_catalogs: true
I20260928 10:44:12.696795 7302 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.696981 7302 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.697597 7302 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:12.702653 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.702937 7250 leader_election.cc:288] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:12.703748 5817 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.665591 5818 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.706192 5818 leader_election.cc:302] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.706564 7302 raft_consensus.cc:2726] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.707077 5818 leader_election.cc:341] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.707321 5818 leader_election.cc:302] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.707619 7302 raft_consensus.cc:2726] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.708171 5818 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.708392 5818 leader_election.cc:302] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.708716 7302 raft_consensus.cc:2726] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.709755 6091 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: b77c90bc2ecc4fc29a4786152cb977bd
W20260928 10:44:12.711086 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f63312cb046844dc8eddbb76f614029b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f63312cb046844dc8eddbb76f614029b already in progress: creating tablet
I20260928 10:44:12.711751 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 727) took 5464 ms. Trace:
I20260928 10:44:12.712011 6269 rpcz_store.cc:276] 0928 10:44:07.247225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.248195 (+ 970us) service_pool.cc:227] Handling call
0928 10:44:12.711520 (+5463325us) ts_tablet_manager.cc:1145] Deleting tablet 9aeb55c2547e417090fd36664cbe69f6
0928 10:44:12.711538 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.711702 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5463060}
W20260928 10:44:12.712744 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9aeb55c2547e417090fd36664cbe69f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb55c2547e417090fd36664cbe69f6 already in progress: creating tablet
I20260928 10:44:12.713280 6269 tablet_replica.cc:330] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:12.713639 6269 raft_consensus.cc:2229] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:12.713912 6269 raft_consensus.cc:2258] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:12.714798 6269 ts_tablet_manager.cc:1905] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:12.726675 5957 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1e7257c8b114e80853ff0a108d2998a
W20260928 10:44:12.727367 5957 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:12.727747 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.732172 7226 raft_consensus.cc:482] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.732412 7226 raft_consensus.cc:504] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.732892 7302 raft_consensus.cc:482] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.733073 7302 raft_consensus.cc:504] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.733310 7226 leader_election.cc:288] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.733486 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 724) took 5451 ms. Trace:
I20260928 10:44:12.733703 7302 leader_election.cc:288] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.733631 6270 rpcz_store.cc:276] 0928 10:44:07.236119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.236175 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:12.585460 (+5349285us) ts_tablet_manager.cc:1145] Deleting tablet f9a0d63c6cbc4eebaf42dc7f969f243c
0928 10:44:12.594985 (+ 9525us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.643269 (+ 48284us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.674931 (+ 31662us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.687782 (+ 12851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5348993}
I20260928 10:44:12.734097 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f9a0d63c6cbc4eebaf42dc7f969f243c (table default.Table_60251724bf62411b81c9c535aaf6a52e [id=52bab93af95a4a3a8daa8e675154d7d3]) successfully deleted
I20260928 10:44:12.734292 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 725) took 5487 ms. Trace:
I20260928 10:44:12.734603 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.734386 6270 rpcz_store.cc:276] 0928 10:44:07.246676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.247870 (+ 1194us) service_pool.cc:227] Handling call
0928 10:44:12.734086 (+5486216us) ts_tablet_manager.cc:1145] Deleting tablet 9aeb55c2547e417090fd36664cbe69f6
0928 10:44:12.734101 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.734231 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5485996}
W20260928 10:44:12.737018 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9aeb55c2547e417090fd36664cbe69f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb55c2547e417090fd36664cbe69f6 already in progress: creating tablet
I20260928 10:44:12.737146 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 726) took 5487 ms. Trace:
I20260928 10:44:12.737243 6270 rpcz_store.cc:276] 0928 10:44:07.250083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.250136 (+ 53us) service_pool.cc:227] Handling call
0928 10:44:12.736962 (+5486826us) ts_tablet_manager.cc:1145] Deleting tablet 75539c390965493eaa69a0d1215fa922
0928 10:44:12.736976 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.737071 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5486601}
W20260928 10:44:12.737442 5817 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.737742 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 75539c390965493eaa69a0d1215fa922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75539c390965493eaa69a0d1215fa922 already in progress: creating tablet
I20260928 10:44:12.742656 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 727) took 5451 ms. Trace:
I20260928 10:44:12.742808 6270 rpcz_store.cc:276] 0928 10:44:07.291220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.291879 (+ 659us) service_pool.cc:227] Handling call
0928 10:44:12.739517 (+5447638us) ts_tablet_manager.cc:1145] Deleting tablet 8d03d764256a4a8d9d8bb17b82fe8bda
0928 10:44:12.740052 (+ 535us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.742579 (+ 2527us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5440274}
I20260928 10:44:12.743304 6270 tablet_replica.cc:330] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:12.743280 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8d03d764256a4a8d9d8bb17b82fe8bda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d03d764256a4a8d9d8bb17b82fe8bda already in progress: creating tablet
I20260928 10:44:12.743567 6270 raft_consensus.cc:2229] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:12.743815 6270 raft_consensus.cc:2258] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:12.747224 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 58764.2us
W20260928 10:44:12.751259 5955 consensus_peers.cc:487] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.751652 5955 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.751813 5955 leader_election.cc:302] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.752123 7335 raft_consensus.cc:2726] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.752386 5955 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.752522 5955 leader_election.cc:302] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.752767 7335 raft_consensus.cc:2726] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.753031 5955 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.754822 7226 raft_consensus.cc:482] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.755025 7226 raft_consensus.cc:504] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.756181 7226 leader_election.cc:288] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.762310 6273 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:12.763094 6273 ts_tablet_manager.cc:1397] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.006s
I20260928 10:44:12.765296 6273 raft_consensus.cc:348] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.770408 6271 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.770711 6271 ts_tablet_manager.cc:1397] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.248s user 0.014s sys 0.014s
I20260928 10:44:12.771694 6271 raft_consensus.cc:348] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.772106 6271 raft_consensus.cc:374] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.772240 6271 raft_consensus.cc:729] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.772564 6271 consensus_queue.cc:260] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.773343 6271 ts_tablet_manager.cc:1428] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:12.773738 6271 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:12.775578 6271 tablet_bootstrap.cc:654] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.777051 7226 raft_consensus.cc:482] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.777197 7226 raft_consensus.cc:504] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.777750 7226 leader_election.cc:288] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.781162 5699 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b681ab5038d34138a1293eae230f09f0
I20260928 10:44:12.781191 6272 ts_tablet_manager.cc:1918] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:12.781453 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 8b167fd6cdbd4b829d962ebafeee0272 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:12.789310 7302 raft_consensus.cc:482] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.793658 7302 raft_consensus.cc:504] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.794314 7302 leader_election.cc:288] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.794741 5697 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 435cabedc6044894b67a7847d9cf5ea5
I20260928 10:44:12.794730 6273 raft_consensus.cc:374] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.794807 6273 raft_consensus.cc:729] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.795156 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e1a2578af95a49e28e3277e77cc7621b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.795799 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1a2578af95a49e28e3277e77cc7621b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.778291 6270 ts_tablet_manager.cc:1905] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:12.797046 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b77c90bc2ecc4fc29a4786152cb977bd" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:12.798553 6017 raft_consensus.cc:3037] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.799993 6273 consensus_queue.cc:260] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.800997 6273 ts_tablet_manager.cc:1428] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260928 10:44:12.801296 6273 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:12.801342 6017 raft_consensus.cc:2454] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:12.804199 6273 tablet_bootstrap.cc:654] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:12.805066 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:12.805331 5883 raft_consensus.cc:2379] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:12.806188 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:12.806882 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:12.807068 5883 raft_consensus.cc:2454] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:12.808063 7302 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.808189 7302 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.808799 7302 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.816001 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.825809 7335 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.826002 7335 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.826673 7335 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.828027 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a973a1d20e3437c87ad889c723e7ebc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.829367 6021 raft_consensus.cc:2454] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:12.839609 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.840786 6271 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:12.840986 6271 ts_tablet_manager.cc:1397] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.003s
I20260928 10:44:12.841832 6271 raft_consensus.cc:348] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.842133 6271 raft_consensus.cc:374] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:12.842263 6271 raft_consensus.cc:729] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:12.842555 6271 consensus_queue.cc:260] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.843384 6271 ts_tablet_manager.cc:1428] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:12.781315 6272 log.cc:1196] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/87d5dd4e5b544262938b1822510d8b9f
I20260928 10:44:12.810408 7226 raft_consensus.cc:482] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.809763 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.850404 7226 raft_consensus.cc:504] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:12.841885 6091 leader_election.cc:341] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:12.850744 6272 ts_tablet_manager.cc:1939] T 87d5dd4e5b544262938b1822510d8b9f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:12.850934 6091 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:12.851012 7226 leader_election.cc:288] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.797787 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:12.851495 5817 leader_election.cc:341] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.851701 5817 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.851683 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 795) took 3779 ms. Trace:
I20260928 10:44:12.851806 6272 rpcz_store.cc:276] 0928 10:44:09.071958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.074420 (+ 2462us) service_pool.cc:227] Handling call
0928 10:44:12.436950 (+3362530us) ts_tablet_manager.cc:1145] Deleting tablet 87d5dd4e5b544262938b1822510d8b9f
0928 10:44:12.436962 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.499570 (+ 62608us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.781065 (+281495us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:12.851660 (+ 70595us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3353476}
I20260928 10:44:12.852645 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 87d5dd4e5b544262938b1822510d8b9f (table default.Table_d8361cd920f64394b922d3f17c2ae915 [id=76c248943ab94632a32893e69fce2205]) successfully deleted
I20260928 10:44:12.853132 6272 tablet_replica.cc:330] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:12.853411 6272 raft_consensus.cc:2229] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:12.853904 6272 pending_rounds.cc:62] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:12.854203 6272 pending_rounds.cc:68] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265859440046080 op_type: NO_OP noop_request { }
I20260928 10:44:12.854408 6272 raft_consensus.cc:2866] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:12.854586 6272 raft_consensus.cc:2258] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:12.855875 5818 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.856082 5818 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.856377 7302 raft_consensus.cc:2726] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.857082 5818 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.857256 5818 leader_election.cc:302] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.857473 7302 raft_consensus.cc:2726] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.857909 5818 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.858067 5818 leader_election.cc:302] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:12.858659 7302 raft_consensus.cc:2726] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:12.862046 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_30d19d5fb4aa4c15831b572b721e1ce0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.863111 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30d19d5fb4aa4c15831b572b721e1ce0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.877537 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet daf7a87b82424e25ae47d3f61c2ddb7f
I20260928 10:44:12.878376 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d84bf40eb66a46179460ac24c87e2688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.879112 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d84bf40eb66a46179460ac24c87e2688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.882840 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.891366 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a36ae00e0f664d4da444a6a4a17bcbca
I20260928 10:44:12.893378 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.911280 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_98dc7959ac2f478fa8b34078b11d9adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.912096 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98dc7959ac2f478fa8b34078b11d9adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.923491 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a071f4e45b5c41ab934a5244ae781050"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:12.924245 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a071f4e45b5c41ab934a5244ae781050 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:12.931591 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8b167fd6cdbd4b829d962ebafeee0272
I20260928 10:44:12.932097 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 8b167fd6cdbd4b829d962ebafeee0272 deleted and replaced by tablet 9e190bf45c9148d5bfce5bd32210812d
I20260928 10:44:12.933473 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e190bf45c9148d5bfce5bd32210812d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:12.855474 5957 leader_election.cc:302] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:12.938187 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 82764.6us
I20260928 10:44:12.863785 7250 raft_consensus.cc:482] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.939388 7250 raft_consensus.cc:504] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.940181 7250 leader_election.cc:288] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.940344 7250 raft_consensus.cc:2781] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.940405 7250 raft_consensus.cc:482] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.940465 7250 raft_consensus.cc:3037] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.943148 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.883795 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.884583 7168 raft_consensus.cc:482] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.944039 7168 raft_consensus.cc:504] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:12.944700 7168 leader_election.cc:288] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.894213 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.895228 7344 tablet.cc:1722] T 04b947da50894cdba0f49d0738f60187 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:12.906993 7335 raft_consensus.cc:482] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.944960 7335 raft_consensus.cc:504] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.945438 7335 leader_election.cc:288] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.934453 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e190bf45c9148d5bfce5bd32210812d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:12.946630 7250 raft_consensus.cc:504] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.948944 7250 leader_election.cc:288] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.956364 6271 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:12.855106 6091 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 54b78fbf508f4e47bd31661e05dcaa16
W20260928 10:44:12.958092 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 102976us
I20260928 10:44:12.880264 6090 leader_election.cc:302] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:12.961484 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 81246.4us
I20260928 10:44:12.961910 6090 leader_election.cc:302] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.963519 7238 raft_consensus.cc:2781] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:12.963635 7238 raft_consensus.cc:686] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:12.963573 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.963809 6156 raft_consensus.cc:2454] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:12.963838 7238 consensus_queue.cc:237] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.964283 7074 raft_consensus.cc:2781] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.964356 7074 raft_consensus.cc:482] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.964411 7074 raft_consensus.cc:3037] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.964811 6988 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.964915 6988 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.965395 6988 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.967742 6016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a50034c6b4110b74b1531a6b7790d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.882630 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.968031 6016 raft_consensus.cc:2379] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:12.968159 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.968484 6144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.968775 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:12.969030 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:12.969503 6017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54b78fbf508f4e47bd31661e05dcaa16" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.969707 6017 raft_consensus.cc:2454] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:12.969702 6090 consensus_peers.cc:487] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9a0d63c6cbc4eebaf42dc7f969f243c. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.893385 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet a36ae00e0f664d4da444a6a4a17bcbca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.898900 7106 raft_consensus.cc:482] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:12.970727 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.970965 6012 raft_consensus.cc:2454] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:12.970890 7106 raft_consensus.cc:504] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.971416 7106 leader_election.cc:288] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.932987 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b167fd6cdbd4b829d962ebafeee0272 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e190bf45c9148d5bfce5bd32210812d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:12.972187 5955 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:12.972446 5955 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.972572 7168 raft_consensus.cc:2781] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.972671 7168 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.972733 7168 raft_consensus.cc:3037] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.973243 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25c7f3b94e94cafb3275a2e190be0ed" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:12.973397 6012 raft_consensus.cc:2454] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:12.973538 6090 leader_election.cc:302] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.974069 7106 raft_consensus.cc:2781] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.974130 7106 raft_consensus.cc:482] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.974181 7106 raft_consensus.cc:3037] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.974246 7074 raft_consensus.cc:504] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:12.974726 7074 leader_election.cc:288] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:12.972738 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef1e7125d4e42f5b30f33bfa588511c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:12.972589 5955 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.975389 5955 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:12.975508 5955 leader_election.cc:341] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:12.976832 7168 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.976970 7106 raft_consensus.cc:504] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.977711 7106 leader_election.cc:288] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.977782 7168 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:12.978257 6090 consensus_peers.cc:487] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97401498df144cc689066ea3033d68ef. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:12.978796 6090 consensus_peers.cc:487] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:12.979233 6090 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.979851 6090 leader_election.cc:302] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:12.980530 6090 leader_election.cc:302] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.980700 7074 raft_consensus.cc:2781] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.981118 7074 raft_consensus.cc:482] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.981252 7074 raft_consensus.cc:3037] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.983932 7074 raft_consensus.cc:504] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.985049 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a973a1d20e3437c87ad889c723e7ebc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:12.985263 6021 raft_consensus.cc:3037] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.988027 6021 raft_consensus.cc:2454] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:12.989141 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54b78fbf508f4e47bd31661e05dcaa16" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:12.989387 6021 raft_consensus.cc:3037] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.980070 7106 raft_consensus.cc:2781] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:12.984313 6976 raft_consensus.cc:3037] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.996415 6976 raft_consensus.cc:2726] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:12.996946 6091 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:12.997067 6091 leader_election.cc:302] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:12.997349 7238 raft_consensus.cc:3037] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:12.997643 7106 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:12.997835 7106 raft_consensus.cc:3037] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.000357 7238 raft_consensus.cc:2726] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.000322 6021 raft_consensus.cc:2454] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:13.000720 7106 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:12.992717 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:12.992969 6090 leader_election.cc:302] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.002686 6090 leader_election.cc:302] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.002990 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25c7f3b94e94cafb3275a2e190be0ed" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:13.000996 7074 leader_election.cc:288] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.003381 6148 raft_consensus.cc:2379] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:44:13.004283 6021 raft_consensus.cc:3037] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.004506 6976 raft_consensus.cc:2781] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.004660 7338 raft_consensus.cc:2781] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.004738 7338 raft_consensus.cc:686] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.004938 7338 consensus_queue.cc:237] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.005941 6275 tablet_bootstrap.cc:492] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.006057 6275 ts_tablet_manager.cc:1397] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.360s user 0.104s sys 0.131s
I20260928 10:44:13.006052 6976 raft_consensus.cc:686] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.006498 6976 consensus_queue.cc:237] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.006871 6275 raft_consensus.cc:348] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.008597 6275 raft_consensus.cc:374] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.008673 6275 raft_consensus.cc:729] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.008859 6275 consensus_queue.cc:260] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.009423 6275 ts_tablet_manager.cc:1428] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:13.009703 6275 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:13.012180 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f42d5aef2424b3aacc8564d98cd3b67" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:13.012482 6019 raft_consensus.cc:2379] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:13.012646 6275 tablet_bootstrap.cc:654] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.013967 7106 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:12.984663 6272 ts_tablet_manager.cc:1905] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.017841 6021 raft_consensus.cc:2454] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:13.018528 6090 leader_election.cc:302] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.018996 7106 raft_consensus.cc:2781] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.020442 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e7aea1e0968d41238ad1618262f7c374"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.020820 7106 raft_consensus.cc:686] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.021085 7106 consensus_queue.cc:237] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:13.019137 6091 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
W20260928 10:44:13.021838 6091 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a25c7f3b94e94cafb3275a2e190be0ed
W20260928 10:44:13.022078 6091 leader_election.cc:341] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
W20260928 10:44:13.022274 6091 leader_election.cc:341] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 54b78fbf508f4e47bd31661e05dcaa16
W20260928 10:44:13.022825 6091 leader_election.cc:341] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a25c7f3b94e94cafb3275a2e190be0ed
W20260928 10:44:13.023082 6091 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:13.023159 6091 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:13.023782 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7aea1e0968d41238ad1618262f7c374 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.025264 6976 raft_consensus.cc:2726] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.032557 6272 ts_tablet_manager.cc:1918] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.032712 6272 log.cc:1196] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d257233e5b934d619e2289a6df55d65a
I20260928 10:44:13.032656 5697 master_service.cc:946] ReplaceTablet: received request to replace tablet f7d762e03b384d85b4e04be8331474a4 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.033092 6272 ts_tablet_manager.cc:1939] T d257233e5b934d619e2289a6df55d65a P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.033442 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 804) took 3815 ms. Trace:
I20260928 10:44:13.033535 6272 rpcz_store.cc:276] 0928 10:44:09.217991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.218367 (+ 376us) service_pool.cc:227] Handling call
0928 10:44:12.853071 (+3634704us) ts_tablet_manager.cc:1145] Deleting tablet d257233e5b934d619e2289a6df55d65a
0928 10:44:12.853086 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.024783 (+171697us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.032424 (+ 7641us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.033422 (+ 998us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3634386}
I20260928 10:44:13.033918 6272 tablet_replica.cc:330] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.034101 6272 raft_consensus.cc:2229] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.034139 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d257233e5b934d619e2289a6df55d65a (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:13.034422 6272 pending_rounds.cc:62] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:13.035948 6272 pending_rounds.cc:68] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265855748628480 op_type: NO_OP noop_request { }
I20260928 10:44:13.036132 6272 raft_consensus.cc:2866] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:13.036233 6272 raft_consensus.cc:2258] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.036899 6272 ts_tablet_manager.cc:1905] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.037923 7250 raft_consensus.cc:482] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.038064 7250 raft_consensus.cc:504] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.038916 7250 leader_election.cc:288] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.039513 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.040062 5955 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.040699 6271 tablet_bootstrap.cc:654] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.043488 6272 ts_tablet_manager.cc:1918] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.043610 6272 log.cc:1196] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/e2d38c0ed54b45a89f8e1daefd5b67a1
I20260928 10:44:13.043952 6272 ts_tablet_manager.cc:1939] T e2d38c0ed54b45a89f8e1daefd5b67a1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.044276 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 803) took 3838 ms. Trace:
I20260928 10:44:13.044361 6272 rpcz_store.cc:276] 0928 10:44:09.206089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.206249 (+ 160us) service_pool.cc:227] Handling call
0928 10:44:13.033868 (+3827619us) ts_tablet_manager.cc:1145] Deleting tablet e2d38c0ed54b45a89f8e1daefd5b67a1
0928 10:44:13.033879 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.040466 (+ 6587us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.043383 (+ 2917us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.044258 (+ 875us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3810696}
I20260928 10:44:13.044750 6272 tablet_replica.cc:330] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.044938 6272 raft_consensus.cc:2229] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.044970 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet e2d38c0ed54b45a89f8e1daefd5b67a1 (table default.Table_8cafdf332e5d48c4a1f719cef76f2d70 [id=04e6b47783874188afebf9820aaf195a]) successfully deleted
I20260928 10:44:13.045110 6272 raft_consensus.cc:2258] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.045676 6272 ts_tablet_manager.cc:1905] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.045912 7353 tablet.cc:1722] T 04b947da50894cdba0f49d0738f60187 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 10:44:13.049912 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 110872us
W20260928 10:44:13.051425 5957 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:13.053941 6272 ts_tablet_manager.cc:1918] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.054162 6272 log.cc:1196] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/15931372e469401ab22422677bd90d1f
I20260928 10:44:13.054600 6272 ts_tablet_manager.cc:1939] T 15931372e469401ab22422677bd90d1f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.055022 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 805) took 3836 ms. Trace:
I20260928 10:44:13.055172 6272 rpcz_store.cc:276] 0928 10:44:09.218153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.218728 (+ 575us) service_pool.cc:227] Handling call
0928 10:44:13.044703 (+3825975us) ts_tablet_manager.cc:1145] Deleting tablet 15931372e469401ab22422677bd90d1f
0928 10:44:13.044715 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.050250 (+ 5535us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.053826 (+ 3576us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.055002 (+ 1176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813674}
I20260928 10:44:13.055727 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 15931372e469401ab22422677bd90d1f (table default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]) successfully deleted
I20260928 10:44:13.056609 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 806) took 3643 ms. Trace:
I20260928 10:44:13.056770 6272 rpcz_store.cc:276] 0928 10:44:09.412895 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.412961 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:13.055761 (+3642800us) ts_tablet_manager.cc:1145] Deleting tablet cd65a860b00d4a7ba8ae92dde5818212
0928 10:44:13.055774 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.056590 (+ 816us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3642500}
I20260928 10:44:13.057374 6272 tablet_replica.cc:330] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:13.057338 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cd65a860b00d4a7ba8ae92dde5818212 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd65a860b00d4a7ba8ae92dde5818212 already in progress: creating tablet
I20260928 10:44:13.057649 6272 raft_consensus.cc:2229] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.058058 6272 raft_consensus.cc:2258] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.060658 6272 ts_tablet_manager.cc:1905] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.063716 6269 ts_tablet_manager.cc:1918] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:13.063869 6269 log.cc:1196] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/75539c390965493eaa69a0d1215fa922
I20260928 10:44:13.064198 6269 ts_tablet_manager.cc:1939] T 75539c390965493eaa69a0d1215fa922 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:13.064694 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 728) took 5814 ms. Trace:
I20260928 10:44:13.064790 6269 rpcz_store.cc:276] 0928 10:44:07.250378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.250533 (+ 155us) service_pool.cc:227] Handling call
0928 10:44:12.713178 (+5462645us) ts_tablet_manager.cc:1145] Deleting tablet 75539c390965493eaa69a0d1215fa922
0928 10:44:12.713195 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.897371 (+184176us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.063551 (+166180us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.064676 (+ 1125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5462422}
I20260928 10:44:13.065296 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 75539c390965493eaa69a0d1215fa922 (table default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]) successfully deleted
I20260928 10:44:13.065701 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 729) took 5806 ms. Trace:
I20260928 10:44:13.065784 6269 rpcz_store.cc:276] 0928 10:44:07.258991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.259054 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:13.065568 (+5806514us) ts_tablet_manager.cc:1145] Deleting tablet 8d03d764256a4a8d9d8bb17b82fe8bda
0928 10:44:13.065579 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.065684 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5806103}
W20260928 10:44:13.066191 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8d03d764256a4a8d9d8bb17b82fe8bda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d03d764256a4a8d9d8bb17b82fe8bda already in progress: creating tablet
I20260928 10:44:13.066468 6269 tablet_replica.cc:330] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:13.066944 6269 raft_consensus.cc:2229] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.067108 6269 raft_consensus.cc:2258] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.067629 6269 ts_tablet_manager.cc:1905] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.069253 6272 ts_tablet_manager.cc:1918] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.069413 6272 log.cc:1196] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1631d396362a4cffa1dec06d00894c63
I20260928 10:44:13.069815 6272 ts_tablet_manager.cc:1939] T 1631d396362a4cffa1dec06d00894c63 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.070153 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 808) took 3649 ms. Trace:
I20260928 10:44:13.070281 6272 rpcz_store.cc:276] 0928 10:44:09.420842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.420891 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:13.057323 (+3636432us) ts_tablet_manager.cc:1145] Deleting tablet 1631d396362a4cffa1dec06d00894c63
0928 10:44:13.057336 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.064852 (+ 7516us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.069154 (+ 4302us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.070136 (+ 982us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636202}
I20260928 10:44:13.004285 6270 ts_tablet_manager.cc:1918] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:13.070770 6270 log.cc:1196] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/72a0adec506e4ca9b10989f18d6c0c22
I20260928 10:44:13.070978 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1631d396362a4cffa1dec06d00894c63 (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:13.071092 6270 ts_tablet_manager.cc:1939] T 72a0adec506e4ca9b10989f18d6c0c22 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:13.071341 6976 raft_consensus.cc:482] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.071467 6976 raft_consensus.cc:504] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.071858 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 728) took 5780 ms. Trace:
I20260928 10:44:13.072028 6976 leader_election.cc:288] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.071940 6270 rpcz_store.cc:276] 0928 10:44:07.291427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.291909 (+ 482us) service_pool.cc:227] Handling call
0928 10:44:12.743211 (+5451302us) ts_tablet_manager.cc:1145] Deleting tablet 72a0adec506e4ca9b10989f18d6c0c22
0928 10:44:12.743223 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:12.813833 (+ 70610us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.004171 (+190338us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.071838 (+ 67667us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5442305}
I20260928 10:44:13.072314 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 732) took 5725 ms. Trace:
I20260928 10:44:13.072415 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 72a0adec506e4ca9b10989f18d6c0c22 (table default.Table_34437f380f6e451baa642895afcea0d9 [id=489e2ce035cb42c3ad1ed5ced42dcdc8]) successfully deleted
I20260928 10:44:13.072381 6270 rpcz_store.cc:276] 0928 10:44:07.347070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.347131 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:13.072200 (+5725069us) ts_tablet_manager.cc:1145] Deleting tablet 0471473cce114d3985f9a8de2de77d39
0928 10:44:13.072210 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.072300 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5601421}
W20260928 10:44:13.072937 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0471473cce114d3985f9a8de2de77d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0471473cce114d3985f9a8de2de77d39 already in progress: creating tablet
I20260928 10:44:13.073263 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 746) took 5577 ms. Trace:
I20260928 10:44:13.073335 6270 rpcz_store.cc:276] 0928 10:44:07.495557 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.643506 (+147949us) service_pool.cc:227] Handling call
0928 10:44:13.073164 (+5429658us) ts_tablet_manager.cc:1145] Deleting tablet 10c23684385749e98359126cfd04b6f7
0928 10:44:13.073174 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.073248 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5429368}
W20260928 10:44:13.073721 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 10c23684385749e98359126cfd04b6f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c23684385749e98359126cfd04b6f7 already in progress: creating tablet
I20260928 10:44:13.074016 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 749) took 5577 ms. Trace:
I20260928 10:44:13.074081 6270 rpcz_store.cc:276] 0928 10:44:07.496890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.675545 (+178655us) service_pool.cc:227] Handling call
0928 10:44:13.073922 (+5398377us) ts_tablet_manager.cc:1145] Deleting tablet d42e218538814686a6c8308b1bc43949
0928 10:44:13.073932 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.074001 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5398103}
I20260928 10:44:13.075393 6272 tablet_replica.cc:330] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.075573 6272 raft_consensus.cc:2229] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.075860 6272 raft_consensus.cc:2258] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.076360 6272 ts_tablet_manager.cc:1905] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.082542 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.083149 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.083339 5883 raft_consensus.cc:2454] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.084687 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:13.084854 5883 raft_consensus.cc:3037] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.086066 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.086238 5879 raft_consensus.cc:2454] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.087020 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1a4ef15990d04df2b9e997c08557de9a" } new_table_name: "default.Table_a0f812973876461c988cf62a823a75dd" modify_external_catalogs: true
I20260928 10:44:13.090610 6272 ts_tablet_manager.cc:1918] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.091557 6272 log.cc:1196] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f9a0d63c6cbc4eebaf42dc7f969f243c
I20260928 10:44:13.092092 6272 ts_tablet_manager.cc:1939] T f9a0d63c6cbc4eebaf42dc7f969f243c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.093261 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 807) took 3672 ms. Trace:
I20260928 10:44:13.094202 6272 rpcz_store.cc:276] 0928 10:44:09.420715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.421157 (+ 442us) service_pool.cc:227] Handling call
0928 10:44:13.075349 (+3654192us) ts_tablet_manager.cc:1145] Deleting tablet f9a0d63c6cbc4eebaf42dc7f969f243c
0928 10:44:13.075361 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.079236 (+ 3875us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.090440 (+ 11204us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.093242 (+ 2802us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3654083}
I20260928 10:44:13.094619 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7dc3ea8faa1d4bcfa298da5c427d5cfb" } new_table_name: "default.Table_5f47609a7d8c45fbafeaba4deb440ae2" modify_external_catalogs: true
I20260928 10:44:13.094941 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f9a0d63c6cbc4eebaf42dc7f969f243c (table default.Table_60251724bf62411b81c9c535aaf6a52e [id=52bab93af95a4a3a8daa8e675154d7d3]) successfully deleted
I20260928 10:44:13.095191 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 810) took 3651 ms. Trace:
I20260928 10:44:13.095630 6272 rpcz_store.cc:276] 0928 10:44:09.443696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.443753 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:13.095062 (+3651309us) ts_tablet_manager.cc:1145] Deleting tablet f799021aca384269bfcd67829f3a7db5
0928 10:44:13.095074 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.095175 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3651089}
I20260928 10:44:13.096236 5883 raft_consensus.cc:2454] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:13.096338 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f799021aca384269bfcd67829f3a7db5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799021aca384269bfcd67829f3a7db5 already in progress: creating tablet
I20260928 10:44:13.096489 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 809) took 3653 ms. Trace:
I20260928 10:44:13.096920 6272 rpcz_store.cc:276] 0928 10:44:09.443542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.444012 (+ 470us) service_pool.cc:227] Handling call
0928 10:44:13.096377 (+3652365us) ts_tablet_manager.cc:1145] Deleting tablet 85f90d3cbc724e289f525c2a89296ce4
0928 10:44:13.096387 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.096474 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3652252}
I20260928 10:44:13.097054 6273 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:13.097270 6273 ts_tablet_manager.cc:1397] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.296s user 0.006s sys 0.000s
W20260928 10:44:13.097508 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 85f90d3cbc724e289f525c2a89296ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f90d3cbc724e289f525c2a89296ce4 already in progress: creating tablet
I20260928 10:44:13.097563 6272 tablet_replica.cc:330] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.098011 6272 raft_consensus.cc:2229] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.098050 6273 raft_consensus.cc:348] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.098377 6273 raft_consensus.cc:374] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.098498 6273 raft_consensus.cc:729] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.098806 6273 consensus_queue.cc:260] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.098951 6272 raft_consensus.cc:2258] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.099479 6273 ts_tablet_manager.cc:1428] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:13.099509 6272 ts_tablet_manager.cc:1905] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.100234 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d01628428c474d53bd927e62b6c11cb1" } new_table_name: "default.Table_bc46ac584c6242c0b72817d527d292c0" modify_external_catalogs: true
I20260928 10:44:13.100993 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_99610979832a4035a4a742164395bb0f" } new_table_name: "default.Table_1c2cd972fcc04c95a28df116512095ea" modify_external_catalogs: true
I20260928 10:44:13.103093 6273 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:13.105926 7106 raft_consensus.cc:482] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.106447 7106 raft_consensus.cc:504] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.107554 7106 leader_election.cc:288] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.110348 6272 ts_tablet_manager.cc:1918] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.110626 6272 log.cc:1196] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/734c3196929d4814b77bce7938bf598e
I20260928 10:44:13.111110 6272 ts_tablet_manager.cc:1939] T 734c3196929d4814b77bce7938bf598e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.112112 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 812) took 3423 ms. Trace:
I20260928 10:44:13.112326 6272 rpcz_store.cc:276] 0928 10:44:09.688252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.688335 (+ 83us) service_pool.cc:227] Handling call
0928 10:44:13.097518 (+3409183us) ts_tablet_manager.cc:1145] Deleting tablet 734c3196929d4814b77bce7938bf598e
0928 10:44:13.097529 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.106439 (+ 8910us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.110125 (+ 3686us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.112080 (+ 1955us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3408914}
I20260928 10:44:13.112989 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 734c3196929d4814b77bce7938bf598e (table default.Table_8dc2417a516c4b5684c3b3a640c11014 [id=b548e2f3285a4f14a88ce8372b1c1ccd]) successfully deleted
I20260928 10:44:13.113125 6272 tablet_replica.cc:330] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.113368 6272 raft_consensus.cc:2229] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.113973 6272 raft_consensus.cc:2258] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.114936 6272 ts_tablet_manager.cc:1905] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.123509 6272 ts_tablet_manager.cc:1918] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.123801 6272 log.cc:1196] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/0e9583b5637a428db383320d98a7a280
I20260928 10:44:13.124301 6272 ts_tablet_manager.cc:1939] T 0e9583b5637a428db383320d98a7a280 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.125262 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 811) took 3437 ms. Trace:
I20260928 10:44:13.125502 6272 rpcz_store.cc:276] 0928 10:44:09.688117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.689498 (+ 1381us) service_pool.cc:227] Handling call
0928 10:44:13.113004 (+3423506us) ts_tablet_manager.cc:1145] Deleting tablet 0e9583b5637a428db383320d98a7a280
0928 10:44:13.113017 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.119042 (+ 6025us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.123318 (+ 4276us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.125193 (+ 1875us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3423281}
I20260928 10:44:13.126130 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 0e9583b5637a428db383320d98a7a280 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:13.126411 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 817) took 3239 ms. Trace:
I20260928 10:44:13.126631 6272 rpcz_store.cc:276] 0928 10:44:09.887252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.887600 (+ 348us) service_pool.cc:227] Handling call
0928 10:44:13.126130 (+3238530us) ts_tablet_manager.cc:1145] Deleting tablet 2a359f1585924866be13588125db2dc4
0928 10:44:13.126145 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.126358 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3238281}
W20260928 10:44:13.127187 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2a359f1585924866be13588125db2dc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a359f1585924866be13588125db2dc4 already in progress: creating tablet
I20260928 10:44:13.127276 6272 tablet_replica.cc:330] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.127676 6272 raft_consensus.cc:2229] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.128132 6272 raft_consensus.cc:2258] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.129107 6272 ts_tablet_manager.cc:1905] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.074652 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e05cdd590894adcb987ef3ac78bf416" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.079226 6271 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.133227 6013 raft_consensus.cc:2454] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:13.133257 6271 ts_tablet_manager.cc:1397] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.177s user 0.002s sys 0.001s
I20260928 10:44:13.107247 7344 tablet.cc:1722] T 84912292d6c34a3991bd0f885de240a8 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:13.133397 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d42e218538814686a6c8308b1bc43949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d42e218538814686a6c8308b1bc43949 already in progress: creating tablet
I20260928 10:44:13.108194 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.133867 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 750) took 5636 ms. Trace:
I20260928 10:44:13.133955 6270 rpcz_store.cc:276] 0928 10:44:07.496968 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.675839 (+178871us) service_pool.cc:227] Handling call
0928 10:44:13.133744 (+5457905us) ts_tablet_manager.cc:1145] Deleting tablet 6f317439c55e4575a0d72ef282c467d5
0928 10:44:13.133756 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.133848 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5457744}
I20260928 10:44:13.134059 6090 leader_election.cc:302] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.134096 6271 raft_consensus.cc:348] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.134281 6271 raft_consensus.cc:374] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.134307 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 756) took 5584 ms. Trace:
I20260928 10:44:13.134411 7106 raft_consensus.cc:2781] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.134333 6271 raft_consensus.cc:729] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.134395 6270 rpcz_store.cc:276] 0928 10:44:07.549822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.688599 (+138777us) service_pool.cc:227] Handling call
0928 10:44:13.134200 (+5445601us) ts_tablet_manager.cc:1145] Deleting tablet e89d3b5d65454b2982e625dd4f909bfb
0928 10:44:13.134210 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.134294 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5372528}
I20260928 10:44:13.134613 7106 raft_consensus.cc:482] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.134737 7106 raft_consensus.cc:3037] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.134690 6271 consensus_queue.cc:260] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.135238 6271 ts_tablet_manager.cc:1428] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:13.135483 6271 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.136837 6271 tablet_bootstrap.cc:654] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.137392 7106 raft_consensus.cc:504] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.139068 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e05cdd590894adcb987ef3ac78bf416" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
W20260928 10:44:13.139129 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6f317439c55e4575a0d72ef282c467d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f317439c55e4575a0d72ef282c467d5 already in progress: creating tablet
I20260928 10:44:13.139288 6021 raft_consensus.cc:3037] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:13.139408 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e89d3b5d65454b2982e625dd4f909bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89d3b5d65454b2982e625dd4f909bfb already in progress: creating tablet
I20260928 10:44:13.139947 7106 leader_election.cc:288] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.141848 6021 raft_consensus.cc:2454] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:13.142758 6090 leader_election.cc:302] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.143432 7106 raft_consensus.cc:2781] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.143628 7106 raft_consensus.cc:686] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.143904 7106 consensus_queue.cc:237] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.148366 6273 tablet_bootstrap.cc:654] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:13.107820 5818 leader_election.cc:341] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.127065 7184 raft_consensus.cc:482] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.149242 7184 raft_consensus.cc:504] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.150068 7184 leader_election.cc:288] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:13.151352 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.152053 5817 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.142763 6272 ts_tablet_manager.cc:1918] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.154067 6272 log.cc:1196] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/97401498df144cc689066ea3033d68ef
I20260928 10:44:13.154767 6272 ts_tablet_manager.cc:1939] T 97401498df144cc689066ea3033d68ef P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.155720 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 818) took 3268 ms. Trace:
I20260928 10:44:13.156371 6272 rpcz_store.cc:276] 0928 10:44:09.887364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.887882 (+ 518us) service_pool.cc:227] Handling call
0928 10:44:13.127183 (+3239301us) ts_tablet_manager.cc:1145] Deleting tablet 97401498df144cc689066ea3033d68ef
0928 10:44:13.127196 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.132620 (+ 5424us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.142624 (+ 10004us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.155657 (+ 13033us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3239169}
I20260928 10:44:13.157263 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 97401498df144cc689066ea3033d68ef (table default.Table_43fb3b30d5f74e2b94775478beb88474 [id=ada8ed2049f4465cacdef4370c1cbadf]) successfully deleted
I20260928 10:44:13.157457 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 819) took 3269 ms. Trace:
I20260928 10:44:13.157570 6272 rpcz_store.cc:276] 0928 10:44:09.887444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.888030 (+ 586us) service_pool.cc:227] Handling call
0928 10:44:13.157248 (+3269218us) ts_tablet_manager.cc:1145] Deleting tablet 51df1f1107e14996bb1b4787819de64f
0928 10:44:13.157262 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.157381 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3269066}
I20260928 10:44:13.157651 5818 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.157948 7184 raft_consensus.cc:2726] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.158160 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 51df1f1107e14996bb1b4787819de64f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51df1f1107e14996bb1b4787819de64f already in progress: creating tablet
W20260928 10:44:13.158267 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 50456.3us
W20260928 10:44:13.158720 6091 consensus_peers.cc:487] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b21a965426145c9b678ae80869be833. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:13.159884 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 820) took 3272 ms. Trace:
W20260928 10:44:13.172987 6091 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9e05cdd590894adcb987ef3ac78bf416
I20260928 10:44:13.177546 6272 rpcz_store.cc:276] 0928 10:44:09.887549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.888194 (+ 645us) service_pool.cc:227] Handling call
0928 10:44:13.159670 (+3271476us) ts_tablet_manager.cc:1145] Deleting tablet 01bd3593f7ac421cbed8ac5797e068fa
0928 10:44:13.159685 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.159820 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3271348}
W20260928 10:44:13.178180 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 01bd3593f7ac421cbed8ac5797e068fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01bd3593f7ac421cbed8ac5797e068fa already in progress: creating tablet
I20260928 10:44:13.178730 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 821) took 3209 ms. Trace:
I20260928 10:44:13.179188 6272 rpcz_store.cc:276] 0928 10:44:09.969623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.970744 (+ 1121us) service_pool.cc:227] Handling call
0928 10:44:13.178552 (+3207808us) ts_tablet_manager.cc:1145] Deleting tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670
0928 10:44:13.178564 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.178662 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3207573}
I20260928 10:44:13.134676 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 761) took 5531 ms. Trace:
I20260928 10:44:13.179454 6270 rpcz_store.cc:276] 0928 10:44:07.603421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.774072 (+170651us) service_pool.cc:227] Handling call
0928 10:44:13.134589 (+5360517us) ts_tablet_manager.cc:1145] Deleting tablet 58b58d0c904a423f9801a883a2a2dfc1
0928 10:44:13.134597 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.134663 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5311639}
W20260928 10:44:13.179589 5957 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Illegal state: Tablet not RUNNING: STOPPED
I20260928 10:44:13.179636 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.179703 5957 leader_election.cc:302] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:13.179735 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 already in progress: creating tablet
I20260928 10:44:13.179867 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 764) took 5482 ms. Trace:
I20260928 10:44:13.179934 6270 rpcz_store.cc:276] 0928 10:44:07.697358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.824184 (+126826us) service_pool.cc:227] Handling call
0928 10:44:13.179770 (+5355586us) ts_tablet_manager.cc:1145] Deleting tablet fe768adf9a1b4631b63151f8cf3cc3ba
0928 10:44:13.179781 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.179849 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5318504}
I20260928 10:44:13.180069 5957 leader_election.cc:302] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.180181 6270 tablet_replica.cc:330] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:13.180156 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 58b58d0c904a423f9801a883a2a2dfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b58d0c904a423f9801a883a2a2dfc1 already in progress: creating tablet
I20260928 10:44:13.180320 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 822) took 3209 ms. Trace:
I20260928 10:44:13.180362 6270 raft_consensus.cc:2229] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.180408 6272 rpcz_store.cc:276] 0928 10:44:09.971205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.972010 (+ 805us) service_pool.cc:227] Handling call
0928 10:44:13.180166 (+3208156us) ts_tablet_manager.cc:1145] Deleting tablet 3e15b3cc46734ed5b8f0aef2f50025dd
0928 10:44:13.180177 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.180267 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3207969}
I20260928 10:44:13.180365 7029 raft_consensus.cc:2726] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.180655 6270 raft_consensus.cc:2258] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.180685 7250 raft_consensus.cc:2781] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 10:44:13.180722 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet fe768adf9a1b4631b63151f8cf3cc3ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe768adf9a1b4631b63151f8cf3cc3ba already in progress: creating tablet
I20260928 10:44:13.180768 7250 raft_consensus.cc:482] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.180828 7250 raft_consensus.cc:3037] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:13.180842 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3e15b3cc46734ed5b8f0aef2f50025dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e15b3cc46734ed5b8f0aef2f50025dd already in progress: creating tablet
W20260928 10:44:13.180371 5957 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9afe3c828c9747958a7c558716643007
I20260928 10:44:13.180965 5957 leader_election.cc:302] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:13.181201 6270 ts_tablet_manager.cc:1905] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.181209 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 823) took 3131 ms. Trace:
W20260928 10:44:13.181284 5957 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:13.181299 6272 rpcz_store.cc:276] 0928 10:44:10.049630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.049686 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:13.181083 (+3131397us) ts_tablet_manager.cc:1145] Deleting tablet 9956318fe8ef4d1cbc92eda9caa98602
0928 10:44:13.181092 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.181161 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3131147}
I20260928 10:44:13.181357 5957 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:13.181634 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9956318fe8ef4d1cbc92eda9caa98602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9956318fe8ef4d1cbc92eda9caa98602 already in progress: creating tablet
I20260928 10:44:13.181710 5957 leader_election.cc:302] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.181946 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 834) took 2512 ms. Trace:
I20260928 10:44:13.181960 5957 leader_election.cc:302] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.182019 6272 rpcz_store.cc:276] 0928 10:44:10.669395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.669440 (+ 45us) service_pool.cc:227] Handling call
0928 10:44:13.181825 (+2512385us) ts_tablet_manager.cc:1145] Deleting tablet 349d67ee0d3840ef813f241ac13968fe
0928 10:44:13.181834 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.181897 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2512059}
I20260928 10:44:13.182235 7168 raft_consensus.cc:2726] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.182348 7168 raft_consensus.cc:2726] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.182412 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 349d67ee0d3840ef813f241ac13968fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349d67ee0d3840ef813f241ac13968fe already in progress: creating tablet
I20260928 10:44:13.182624 7168 raft_consensus.cc:2781] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.182686 7168 raft_consensus.cc:482] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.182739 7168 raft_consensus.cc:3037] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.182757 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 835) took 2512 ms. Trace:
I20260928 10:44:13.182843 6272 rpcz_store.cc:276] 0928 10:44:10.669779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.669837 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:13.182630 (+2512793us) ts_tablet_manager.cc:1145] Deleting tablet 9ecd8d56d7a945a0afbd9541048f232b
0928 10:44:13.182639 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.182708 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2512631}
W20260928 10:44:13.183192 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9ecd8d56d7a945a0afbd9541048f232b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ecd8d56d7a945a0afbd9541048f232b already in progress: creating tablet
I20260928 10:44:13.183586 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 836) took 2513 ms. Trace:
I20260928 10:44:13.183665 6272 rpcz_store.cc:276] 0928 10:44:10.669982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.670032 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:13.183464 (+2513432us) ts_tablet_manager.cc:1145] Deleting tablet 733ac3eb76f74468a4811c5d642d53f0
0928 10:44:13.183473 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.183537 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2513269}
I20260928 10:44:13.183763 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c957158dbd949e88554e70fe6146089" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:13.184034 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 733ac3eb76f74468a4811c5d642d53f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ac3eb76f74468a4811c5d642d53f0 already in progress: creating tablet
I20260928 10:44:13.184322 6272 tablet_replica.cc:330] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.184527 6272 raft_consensus.cc:2229] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.184852 6272 raft_consensus.cc:2258] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.185086 7168 raft_consensus.cc:504] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.185590 7168 leader_election.cc:288] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.185701 6272 ts_tablet_manager.cc:1905] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.185724 7168 raft_consensus.cc:2781] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.185802 7168 raft_consensus.cc:686] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.185985 7168 consensus_queue.cc:237] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.187141 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:13.187441 7250 raft_consensus.cc:504] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:13.187749 5955 leader_election.cc:341] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.187948 7250 leader_election.cc:288] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.191953 6272 ts_tablet_manager.cc:1918] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.192158 6272 log.cc:1196] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:13.192670 6272 ts_tablet_manager.cc:1939] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.193168 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 837) took 2522 ms. Trace:
I20260928 10:44:13.193384 6272 rpcz_store.cc:276] 0928 10:44:10.670436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.670579 (+ 143us) service_pool.cc:227] Handling call
0928 10:44:13.184250 (+2513671us) ts_tablet_manager.cc:1145] Deleting tablet 3d5b422c70a84cc0bc9f8a686f4e2c82
0928 10:44:13.184259 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.188688 (+ 4429us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.191811 (+ 3123us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.193128 (+ 1317us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2513482}
I20260928 10:44:13.193797 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 791e310f4af14569aca647cca4cf9dc3 (DEFAULT_TABLE table=default.Table_7a2b5c5e039641bb84f974157bcc8b1a [id=26875f18e4c04633b4caba4d8943156e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.194209 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e310f4af14569aca647cca4cf9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.194868 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet bae5a2038947413f95f134602081c889 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.195338 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 263b9844bdf6465fa7894ddcf2809f24 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.195833 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e86b6b68c6a04f92af21d32ddd66e7c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.196419 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e86b6b68c6a04f92af21d32ddd66e7c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.198468 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:13.199388 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_19576f3ea75745b09af525ae5b30f0a2" } new_table_name: "default.Table_bd415a38e4344ac0a4f2bfb479d01b58" modify_external_catalogs: true
I20260928 10:44:13.199592 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 3992d55edd794520a8f810a4568f351a (DEFAULT_TABLE table=default.Table_ac91e57a79be4d349465805325cedc63 [id=1e24abd3cc374f11bb31779aa2f0b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.199983 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3992d55edd794520a8f810a4568f351a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.201045 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:13.201295 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:13.201484 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:13.201697 5701 catalog_manager.cc:5495] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:13.202144 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:13.202803 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 431a0b93966a44deab9758db213d97c8 (DEFAULT_TABLE table=default.Table_8eb54f93fe9642bba738cebf0a9d82bd [id=e40396bb40cc42669007316fc93993e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.203210 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 431a0b93966a44deab9758db213d97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.204312 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (table default.Table_de468dcafe554bba9d4279813098e5d5 [id=92f40b0873ca472db40650520fdfa06a]) successfully deleted
I20260928 10:44:13.194094 6272 tablet_replica.cc:330] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.204736 6272 raft_consensus.cc:2229] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.205232 6272 raft_consensus.cc:2258] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.205550 5863 tablet_service.cc:1467] Processing CreateTablet for tablet bb4590c83aa24745af278fcac0a9d518 (DEFAULT_TABLE table=default.Table_135c07ef280d4a9b83f7529a30ce29fd [id=ce0ad87b86834425b2dfaace5a293393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.205920 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb4590c83aa24745af278fcac0a9d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.209534 7205 raft_consensus.cc:482] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.209679 7205 raft_consensus.cc:504] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.210103 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 3992d55edd794520a8f810a4568f351a (DEFAULT_TABLE table=default.Table_ac91e57a79be4d349465805325cedc63 [id=1e24abd3cc374f11bb31779aa2f0b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.210285 7205 leader_election.cc:288] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.210400 7205 raft_consensus.cc:482] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.210494 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3992d55edd794520a8f810a4568f351a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.210510 7205 raft_consensus.cc:504] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.210772 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 431a0b93966a44deab9758db213d97c8 (DEFAULT_TABLE table=default.Table_8eb54f93fe9642bba738cebf0a9d82bd [id=e40396bb40cc42669007316fc93993e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.211037 7205 leader_election.cc:288] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.211073 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 431a0b93966a44deab9758db213d97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.210052 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 791e310f4af14569aca647cca4cf9dc3 (DEFAULT_TABLE table=default.Table_7a2b5c5e039641bb84f974157bcc8b1a [id=26875f18e4c04633b4caba4d8943156e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.213889 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e310f4af14569aca647cca4cf9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.214649 6144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:13.215071 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.215293 5955 leader_election.cc:341] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.210412 6127 tablet_service.cc:1467] Processing CreateTablet for tablet bb4590c83aa24745af278fcac0a9d518 (DEFAULT_TABLE table=default.Table_135c07ef280d4a9b83f7529a30ce29fd [id=ce0ad87b86834425b2dfaace5a293393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.215879 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb4590c83aa24745af278fcac0a9d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.217130 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 791e310f4af14569aca647cca4cf9dc3 (DEFAULT_TABLE table=default.Table_7a2b5c5e039641bb84f974157bcc8b1a [id=26875f18e4c04633b4caba4d8943156e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.217562 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e310f4af14569aca647cca4cf9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.219942 5817 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.220414 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 3992d55edd794520a8f810a4568f351a (DEFAULT_TABLE table=default.Table_ac91e57a79be4d349465805325cedc63 [id=1e24abd3cc374f11bb31779aa2f0b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.220781 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3992d55edd794520a8f810a4568f351a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.222770 5986 tablet_service.cc:1467] Processing CreateTablet for tablet bb4590c83aa24745af278fcac0a9d518 (DEFAULT_TABLE table=default.Table_135c07ef280d4a9b83f7529a30ce29fd [id=ce0ad87b86834425b2dfaace5a293393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.223124 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb4590c83aa24745af278fcac0a9d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.223856 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.224014 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72d616250b7f495fb0fff79ece1a77b1 consensus state has no leader
I20260928 10:44:13.224411 6091 leader_election.cc:302] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:13.224797 6091 leader_election.cc:341] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9e05cdd590894adcb987ef3ac78bf416
W20260928 10:44:13.225288 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 355c5b2e54cb4136b27eec3d65aeab55 consensus state has no leader
I20260928 10:44:13.225281 6976 raft_consensus.cc:2726] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.225521 5817 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:13.225852 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24bf23a7d7be4a0897a3fd96941bb83b consensus state has no leader
I20260928 10:44:13.226081 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet b1cdff9f01974354a81179dd9bd5a26e from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.206597 6272 ts_tablet_manager.cc:1905] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.226778 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 431a0b93966a44deab9758db213d97c8 (DEFAULT_TABLE table=default.Table_8eb54f93fe9642bba738cebf0a9d82bd [id=e40396bb40cc42669007316fc93993e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.227121 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 431a0b93966a44deab9758db213d97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.232116 6272 ts_tablet_manager.cc:1918] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.236550 6272 log.cc:1196] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/82b3afe074194023ba788094a2a6b81c
I20260928 10:44:13.236585 7184 raft_consensus.cc:482] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.236465 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_92f37c565b2747c09867652241d7ec6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.236749 7184 raft_consensus.cc:504] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:13.237170 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92f37c565b2747c09867652241d7ec6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.237375 7184 leader_election.cc:288] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.237877 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.238531 5817 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.240511 6271 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.240649 6271 ts_tablet_manager.cc:1397] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.005s
I20260928 10:44:13.240962 6272 ts_tablet_manager.cc:1939] T 82b3afe074194023ba788094a2a6b81c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.241406 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 838) took 2570 ms. Trace:
I20260928 10:44:13.241401 6271 raft_consensus.cc:348] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.241607 6271 raft_consensus.cc:374] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.241669 6271 raft_consensus.cc:729] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.241914 6271 consensus_queue.cc:260] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.242432 6271 ts_tablet_manager.cc:1428] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:13.242761 6271 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.242619 6272 rpcz_store.cc:276] 0928 10:44:10.670693 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.670736 (+ 43us) service_pool.cc:227] Handling call
0928 10:44:13.194024 (+2523288us) ts_tablet_manager.cc:1145] Deleting tablet 82b3afe074194023ba788094a2a6b81c
0928 10:44:13.194034 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.229163 (+ 35129us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.231995 (+ 2832us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.241351 (+ 9356us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2523089}
I20260928 10:44:13.243273 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 82b3afe074194023ba788094a2a6b81c (table default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]) successfully deleted
I20260928 10:44:13.243706 6272 tablet_replica.cc:330] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.244331 6271 tablet_bootstrap.cc:654] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.243834 7106 consensus_queue.cc:1035] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:13.251075 6091 consensus_peers.cc:487] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 122fbbe54c174c4ea9cf38698debcb27. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:13.251551 6272 raft_consensus.cc:2229] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.252558 6272 raft_consensus.cc:2258] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.252760 6273 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:13.252969 6273 ts_tablet_manager.cc:1397] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.000s
I20260928 10:44:13.253654 6273 raft_consensus.cc:348] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.253939 6273 raft_consensus.cc:374] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.254033 6273 raft_consensus.cc:729] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.254297 6273 consensus_queue.cc:260] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.255015 6273 ts_tablet_manager.cc:1428] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:13.255316 6273 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:13.256316 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cffc63bccf448a7a59e311640567e4a consensus state has no leader
I20260928 10:44:13.256533 5850 tablet_service.cc:1467] Processing CreateTablet for tablet b2df6190ccb54faa9c8a2282854663d8 (DEFAULT_TABLE table=default.Table_20f019efc3ad49f68c52e6044f37f295 [id=c65946ead9c441f780f5aa49a66be11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.256675 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_82a5e88072724fecbd1ce7d218831d75" } modify_external_catalogs: true
I20260928 10:44:13.256917 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2df6190ccb54faa9c8a2282854663d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.256917 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_82a5e88072724fecbd1ce7d218831d75" } modify_external_catalogs: true
I20260928 10:44:13.257923 5993 tablet_service.cc:1467] Processing CreateTablet for tablet b2df6190ccb54faa9c8a2282854663d8 (DEFAULT_TABLE table=default.Table_20f019efc3ad49f68c52e6044f37f295 [id=c65946ead9c441f780f5aa49a66be11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.258311 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2df6190ccb54faa9c8a2282854663d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.258457 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 24bf23a7d7be4a0897a3fd96941bb83b (DEFAULT_TABLE table=default.Table_bc46ac584c6242c0b72817d527d292c0 [id=466f2e8f097b455e893d7b01209db86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.258785 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24bf23a7d7be4a0897a3fd96941bb83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.259421 6272 ts_tablet_manager.cc:1905] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.259665 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 24bf23a7d7be4a0897a3fd96941bb83b (DEFAULT_TABLE table=default.Table_bc46ac584c6242c0b72817d527d292c0 [id=466f2e8f097b455e893d7b01209db86a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:13.267006 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 85042.1us
I20260928 10:44:13.268062 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.268580 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.269182 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.270604 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24bf23a7d7be4a0897a3fd96941bb83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.270841 7361 tablet.cc:1722] T 84912292d6c34a3991bd0f885de240a8 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:13.272148 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:13.272202 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:13.272346 5883 raft_consensus.cc:3037] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.272378 5879 raft_consensus.cc:3037] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.274369 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 57c925616df64d1eb141ea85b43c3887 (DEFAULT_TABLE table=default.Table_f7e51d1848f14067b414b283f4d0b0f6 [id=1b75efcce347496f8da7802c81d3f001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.274811 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c925616df64d1eb141ea85b43c3887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.275027 5883 raft_consensus.cc:2454] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:13.275130 5879 raft_consensus.cc:2454] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:13.277629 5818 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.277841 5818 leader_election.cc:302] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.278132 7184 raft_consensus.cc:2726] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.278462 5818 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.278683 5818 leader_election.cc:302] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.278920 7184 raft_consensus.cc:2726] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.279234 5818 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.279376 5818 leader_election.cc:302] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.279580 7184 raft_consensus.cc:2726] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.280085 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 57c925616df64d1eb141ea85b43c3887 (DEFAULT_TABLE table=default.Table_f7e51d1848f14067b414b283f4d0b0f6 [id=1b75efcce347496f8da7802c81d3f001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.280495 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c925616df64d1eb141ea85b43c3887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.280666 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 0c3df3e383564f51a1e2f06deebcbcff (DEFAULT_TABLE table=default.Table_ef64e1c90a20476a862995f090d61442 [id=def9208cb2d4472fbc8b12810a5e4e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.281006 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c3df3e383564f51a1e2f06deebcbcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.282395 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 148a0e6334424831abbb6c19d6b39baa (DEFAULT_TABLE table=default.Table_7fef88bbff7b455e8425afae90011244 [id=2bc11b1516a445fbbb1d97f05bf679d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.282775 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148a0e6334424831abbb6c19d6b39baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.285007 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 0c3df3e383564f51a1e2f06deebcbcff (DEFAULT_TABLE table=default.Table_ef64e1c90a20476a862995f090d61442 [id=def9208cb2d4472fbc8b12810a5e4e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.285382 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c3df3e383564f51a1e2f06deebcbcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.290390 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 0c3df3e383564f51a1e2f06deebcbcff (DEFAULT_TABLE table=default.Table_ef64e1c90a20476a862995f090d61442 [id=def9208cb2d4472fbc8b12810a5e4e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.290776 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c3df3e383564f51a1e2f06deebcbcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.296133 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 148a0e6334424831abbb6c19d6b39baa (DEFAULT_TABLE table=default.Table_7fef88bbff7b455e8425afae90011244 [id=2bc11b1516a445fbbb1d97f05bf679d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.296481 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 57c925616df64d1eb141ea85b43c3887 (DEFAULT_TABLE table=default.Table_f7e51d1848f14067b414b283f4d0b0f6 [id=1b75efcce347496f8da7802c81d3f001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.296615 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148a0e6334424831abbb6c19d6b39baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.296869 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c925616df64d1eb141ea85b43c3887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.297535 6128 tablet_service.cc:1467] Processing CreateTablet for tablet b2df6190ccb54faa9c8a2282854663d8 (DEFAULT_TABLE table=default.Table_20f019efc3ad49f68c52e6044f37f295 [id=c65946ead9c441f780f5aa49a66be11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.297917 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2df6190ccb54faa9c8a2282854663d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.300216 6127 tablet_service.cc:1467] Processing CreateTablet for tablet bb8ab7af40f045a287ce91e15a59d579 (DEFAULT_TABLE table=default.Table_4d8ef7a42dd64e22b5231719906319db [id=7f8055b8f5f44d3aac31d4130984a0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.300335 6000 tablet_service.cc:1467] Processing CreateTablet for tablet bb8ab7af40f045a287ce91e15a59d579 (DEFAULT_TABLE table=default.Table_4d8ef7a42dd64e22b5231719906319db [id=7f8055b8f5f44d3aac31d4130984a0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.300820 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb8ab7af40f045a287ce91e15a59d579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.301543 6275 tablet_bootstrap.cc:492] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.301693 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb8ab7af40f045a287ce91e15a59d579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.301927 6275 ts_tablet_manager.cc:1397] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.292s user 0.042s sys 0.052s
I20260928 10:44:13.304440 6275 raft_consensus.cc:348] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.304886 6275 raft_consensus.cc:374] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.305022 6275 raft_consensus.cc:729] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.305357 6275 consensus_queue.cc:260] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.306517 6130 tablet_service.cc:1467] Processing CreateTablet for tablet f6176d1218844218a958d1dd1ef78b8e (DEFAULT_TABLE table=default.Table_cb9f9c6d2a964f2591f62a0693cef5c5 [id=06ce51d163ad42329cccd534ad37b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.306463 5863 tablet_service.cc:1467] Processing CreateTablet for tablet bb8ab7af40f045a287ce91e15a59d579 (DEFAULT_TABLE table=default.Table_4d8ef7a42dd64e22b5231719906319db [id=7f8055b8f5f44d3aac31d4130984a0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.307017 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb8ab7af40f045a287ce91e15a59d579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.311921 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:13.312165 6269 ts_tablet_manager.cc:1918] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:13.314301 5984 tablet_service.cc:1467] Processing CreateTablet for tablet f6176d1218844218a958d1dd1ef78b8e (DEFAULT_TABLE table=default.Table_cb9f9c6d2a964f2591f62a0693cef5c5 [id=06ce51d163ad42329cccd534ad37b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.315477 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6176d1218844218a958d1dd1ef78b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.322646 6275 ts_tablet_manager.cc:1428] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260928 10:44:13.324122 6275 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:13.325954 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 (DEFAULT_TABLE table=default.Table_6ca7a0abc0e848c0884ef93ec7363e84 [id=38f361090c514d229628c6fc7d2e80b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.331073 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 (DEFAULT_TABLE table=default.Table_6ca7a0abc0e848c0884ef93ec7363e84 [id=38f361090c514d229628c6fc7d2e80b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.331614 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adcdfdbeb074696a1081d7eb5d96926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.335620 6275 tablet_bootstrap.cc:654] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.337792 6270 ts_tablet_manager.cc:1918] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.341012 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6176d1218844218a958d1dd1ef78b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.315757 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 24bf23a7d7be4a0897a3fd96941bb83b (DEFAULT_TABLE table=default.Table_bc46ac584c6242c0b72817d527d292c0 [id=466f2e8f097b455e893d7b01209db86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.342087 6269 log.cc:1196] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:13.343182 6269 ts_tablet_manager.cc:1939] T 44bc6831f9354ddb81212bc107efdf68 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:13.345588 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 9da796356b8f45248a331412588136fc (DEFAULT_TABLE table=default.Table_360ffaceac464cdfb9ca8278f925d9fc [id=2b57666df33544908a3b2887cd832673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.358412 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1c7131f9259a404382e86ad06c52b584
I20260928 10:44:13.358881 5696 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1087) took 1036 ms. Trace:
W20260928 10:44:13.359057 5701 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 154) took 789 ms (client timeout 1000 ms). Trace:
W20260928 10:44:13.359329 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 consensus state has no leader
I20260928 10:44:13.359802 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:13.360010 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
W20260928 10:44:13.361265 5693 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.67:50395 (request call id 155) took 782 ms (client timeout 1000 ms). Trace:
W20260928 10:44:13.361378 5693 rpcz_store.cc:269] 0928 10:44:12.579108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.693922 (+114814us) service_pool.cc:227] Handling call
0928 10:44:13.361231 (+667309us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":7}
I20260928 10:44:13.362530 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3b2cabf659dc48028605b39c92e1e451 (table default.Table_7718e29c75cb41aa8192e35389ac9259 [id=3daf4c7bcf784fb0948e743ecec939ed]). Expected version 1 got 0
I20260928 10:44:13.362753 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:13.358989 5696 rpcz_store.cc:276] 0928 10:44:12.322091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.695955 (+373864us) service_pool.cc:227] Handling call
0928 10:44:12.696446 (+ 491us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:12.696591 (+ 145us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:12.696664 (+ 73us) catalog_manager.cc:2761] Locking tablets
0928 10:44:13.197547 (+500883us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:13.358231 (+160684us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:13.358309 (+ 78us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:13.358351 (+ 42us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:13.358820 (+ 469us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:13.313213 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:13.313308 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:13.313314 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:13.313316 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:13.313437 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:13.313447 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:13.313450 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:13.313548 (+ 98us) tablet.cc:699] Row locks acquired
0928 10:44:13.313551 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:13.313604 (+ 53us) write_op.cc:270] Start()
0928 10:44:13.313637 (+ 33us) write_op.cc:276] Timestamp: P: 1790592253313575 usec, L: 0
0928 10:44:13.313640 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:13.313802 (+ 162us) log.cc:842] Serialized 728 byte log entry
0928 10:44:13.355089 (+ 41287us) op_driver.cc:444] REPLICATION: finished
0928 10:44:13.356629 (+ 1540us) write_op.cc:301] APPLY: starting
0928 10:44:13.356639 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:13.356671 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:13.356712 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:13.356765 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:13.356790 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:13.356795 (+ 5us) write_op.cc:312] APPLY: finished
0928 10:44:13.356852 (+ 57us) log.cc:842] Serialized 29 byte log entry
0928 10:44:13.356905 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.356919 (+ 14us) write_op.cc:454] Released schema lock
0928 10:44:13.356924 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:13.356972 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.356975 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1512,"apply.run_cpu_time_us":387,"apply.run_wall_time_us":386,"num_ops":2,"prepare.queue_time_us":115075,"prepare.run_cpu_time_us":657,"prepare.run_wall_time_us":656,"replication_time_us":41433}]]}
I20260928 10:44:13.346807 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adcdfdbeb074696a1081d7eb5d96926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.357685 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf2bc530af64cd2be249d7b62488589 (DEFAULT_TABLE table=default.Table_48d4da09446e4cfa882d3a941745fcd2 [id=a86af677accb4761a99fd25d315db9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.366278 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da796356b8f45248a331412588136fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.366519 6272 ts_tablet_manager.cc:1918] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.366575 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf2bc530af64cd2be249d7b62488589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.366977 6272 log.cc:1196] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c2635c7c47ba4383b6b0f07cd3b42f74
W20260928 10:44:13.359174 5701 rpcz_store.cc:269] 0928 10:44:12.569669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.686544 (+116875us) service_pool.cc:227] Handling call
0928 10:44:13.359015 (+672471us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:13.314523 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:13.314599 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:13.314604 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:13.314606 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:13.314678 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:13.314685 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:13.314690 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:13.314746 (+ 56us) tablet.cc:699] Row locks acquired
0928 10:44:13.314748 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:13.314773 (+ 25us) write_op.cc:270] Start()
0928 10:44:13.314812 (+ 39us) write_op.cc:276] Timestamp: P: 1790592253314746 usec, L: 0
0928 10:44:13.314816 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:13.314943 (+ 127us) log.cc:842] Serialized 530 byte log entry
0928 10:44:13.355172 (+ 40229us) op_driver.cc:444] REPLICATION: finished
0928 10:44:13.357365 (+ 2193us) write_op.cc:301] APPLY: starting
0928 10:44:13.357375 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:13.357398 (+ 23us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:13.357424 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:13.357456 (+ 32us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:13.357479 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:13.357484 (+ 5us) write_op.cc:312] APPLY: finished
0928 10:44:13.357532 (+ 48us) log.cc:842] Serialized 23 byte log entry
0928 10:44:13.357577 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.357588 (+ 11us) write_op.cc:454] Released schema lock
0928 10:44:13.357594 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:13.357636 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.357639 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":2166,"apply.run_cpu_time_us":308,"apply.run_wall_time_us":306,"num_ops":1,"prepare.queue_time_us":111803,"prepare.run_cpu_time_us":479,"prepare.run_wall_time_us":479,"replication_time_us":40344,"threads_started":1}]]}
I20260928 10:44:13.367471 6272 ts_tablet_manager.cc:1939] T c2635c7c47ba4383b6b0f07cd3b42f74 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.369602 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 839) took 2698 ms. Trace:
I20260928 10:44:13.369828 6272 rpcz_store.cc:276] 0928 10:44:10.670907 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.670941 (+ 34us) service_pool.cc:227] Handling call
0928 10:44:13.243620 (+2572679us) ts_tablet_manager.cc:1145] Deleting tablet c2635c7c47ba4383b6b0f07cd3b42f74
0928 10:44:13.243631 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.265800 (+ 22169us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.280268 (+ 14468us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.369554 (+ 89286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2572579}
I20260928 10:44:13.358134 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 21922242230747e6baac1d77c0928d91 (DEFAULT_TABLE table=default.Table_3e40822e797d4d10b1aa9757f8008373 [id=1469eba59e5145bbbbb497aba1a17df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.374011 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21922242230747e6baac1d77c0928d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.374023 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 730) took 6097 ms. Trace:
I20260928 10:44:13.374133 6269 rpcz_store.cc:276] 0928 10:44:07.276208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.276272 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:13.066427 (+5790155us) ts_tablet_manager.cc:1145] Deleting tablet 44bc6831f9354ddb81212bc107efdf68
0928 10:44:13.066436 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.154083 (+ 87647us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.312054 (+157971us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.374004 (+ 61950us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5789946}
I20260928 10:44:13.374663 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 44bc6831f9354ddb81212bc107efdf68 (table default.Table_ccc54fc0e3d24f22a89149b227256f81 [id=7e99e684b74f47279b22e18c1cf09935]) successfully deleted
I20260928 10:44:13.319962 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 148a0e6334424831abbb6c19d6b39baa (DEFAULT_TABLE table=default.Table_7fef88bbff7b455e8425afae90011244 [id=2bc11b1516a445fbbb1d97f05bf679d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.375173 6269 tablet_replica.cc:330] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:13.375397 6269 raft_consensus.cc:2229] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.375577 6269 raft_consensus.cc:2258] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.376132 6269 ts_tablet_manager.cc:1905] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.324913 5852 tablet_service.cc:1467] Processing CreateTablet for tablet f6176d1218844218a958d1dd1ef78b8e (DEFAULT_TABLE table=default.Table_cb9f9c6d2a964f2591f62a0693cef5c5 [id=06ce51d163ad42329cccd534ad37b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.340907 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 (DEFAULT_TABLE table=default.Table_6ca7a0abc0e848c0884ef93ec7363e84 [id=38f361090c514d229628c6fc7d2e80b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.379149 6148 raft_consensus.cc:3037] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.379307 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c2635c7c47ba4383b6b0f07cd3b42f74 (table default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]) successfully deleted
I20260928 10:44:13.380191 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 440a50034c6b4110b74b1531a6b7790d with delete_type TABLET_DATA_DELETED (replaced by tablet a229207ce7cc475c8f4492e62d122721) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.380816 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 35345a76883045afadd5922c11de910d (DEFAULT_TABLE table=default.Table_01da441e756d46a991c3b81c3321667a [id=e2000861b4964e5e96fc2d8d2578c9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.381021 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 91337888b5864a2286b9afb7fcba8c98 (DEFAULT_TABLE table=default.Table_02a2d4e1648a495da6f9df0920977d38 [id=f4440c3619c744bdb1bd8aed38e6c059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.381168 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35345a76883045afadd5922c11de910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.381421 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91337888b5864a2286b9afb7fcba8c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.382309 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.342365 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24bf23a7d7be4a0897a3fd96941bb83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.383174 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adcdfdbeb074696a1081d7eb5d96926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.381546 6128 tablet_service.cc:1467] Processing CreateTablet for tablet c6b18e694df14b6399a554ae65496a82 (DEFAULT_TABLE table=default.Table_8ace400a292441809e397be68d13712c [id=31e35997574c41c6aebfd366856f21ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.387024 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b18e694df14b6399a554ae65496a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.388263 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148a0e6334424831abbb6c19d6b39baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.389123 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6176d1218844218a958d1dd1ef78b8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.316020 5818 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.392129 5818 leader_election.cc:302] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.392380 7184 raft_consensus.cc:2726] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.392656 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 76630.5us
I20260928 10:44:13.392663 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 842) took 2333 ms. Trace:
I20260928 10:44:13.393213 7184 raft_consensus.cc:482] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.393344 7184 raft_consensus.cc:504] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.393941 7184 leader_election.cc:288] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.393366 6272 rpcz_store.cc:276] 0928 10:44:11.058863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.085901 (+ 27038us) service_pool.cc:227] Handling call
0928 10:44:13.373826 (+2287925us) ts_tablet_manager.cc:1145] Deleting tablet 917513e857de49a7a57416eca237f70b
0928 10:44:13.391866 (+ 18040us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.392502 (+ 636us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2287664}
I20260928 10:44:13.394353 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.394971 5817 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.395462 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 841) took 2336 ms. Trace:
I20260928 10:44:13.396095 6272 rpcz_store.cc:276] 0928 10:44:11.058725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.090603 (+ 31878us) service_pool.cc:227] Handling call
0928 10:44:13.394798 (+2304195us) ts_tablet_manager.cc:1145] Deleting tablet be50535c36a54453b2a1a6d6d09207eb
0928 10:44:13.394922 (+ 124us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.395327 (+ 405us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2303895}
I20260928 10:44:13.396394 6272 tablet_replica.cc:330] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.396603 6272 raft_consensus.cc:2229] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.396911 6272 raft_consensus.cc:2258] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:13.399056 6091 consensus_peers.cc:487] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21b4deb353974c8aae4bb8148869758d. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:13.403064 6272 ts_tablet_manager.cc:1905] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.403331 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 91337888b5864a2286b9afb7fcba8c98 (DEFAULT_TABLE table=default.Table_02a2d4e1648a495da6f9df0920977d38 [id=f4440c3619c744bdb1bd8aed38e6c059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.403971 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91337888b5864a2286b9afb7fcba8c98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.405654 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 917513e857de49a7a57416eca237f70b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917513e857de49a7a57416eca237f70b already in progress: creating tablet
W20260928 10:44:13.405965 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet be50535c36a54453b2a1a6d6d09207eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be50535c36a54453b2a1a6d6d09207eb already in progress: creating tablet
I20260928 10:44:13.319056 6273 tablet_bootstrap.cc:654] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.355767 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 9da796356b8f45248a331412588136fc (DEFAULT_TABLE table=default.Table_360ffaceac464cdfb9ca8278f925d9fc [id=2b57666df33544908a3b2887cd832673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.407467 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da796356b8f45248a331412588136fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.409822 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd5e4e404df4305a5e7168e2ae71306 (DEFAULT_TABLE table=default.Table_b511e6944bb54de49970e8c6fee87274 [id=d87c2dadb2974d49a1c20c69a29555f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.410275 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd5e4e404df4305a5e7168e2ae71306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.358038 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf2bc530af64cd2be249d7b62488589 (DEFAULT_TABLE table=default.Table_48d4da09446e4cfa882d3a941745fcd2 [id=a86af677accb4761a99fd25d315db9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.410676 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf2bc530af64cd2be249d7b62488589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.413475 5861 tablet_service.cc:1467] Processing CreateTablet for tablet a4323f9bd7024d5bbb63e1d34c576a9e (DEFAULT_TABLE table=default.Table_a1160cb2c67c46d0829bea1d983dca12 [id=d50bcd5f61694303bb17cc011827a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.413921 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4323f9bd7024d5bbb63e1d34c576a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.364578 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 21922242230747e6baac1d77c0928d91 (DEFAULT_TABLE table=default.Table_3e40822e797d4d10b1aa9757f8008373 [id=1469eba59e5145bbbbb497aba1a17df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.417128 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21922242230747e6baac1d77c0928d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.419711 5856 tablet_service.cc:1467] Processing CreateTablet for tablet db62e1bb84fe46c0815e12dfbac03c3a (DEFAULT_TABLE table=default.Table_041e55375217446e8377abc4545d30ae [id=521655cba2a2432ba2438b00742d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.364804 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7131f9259a404382e86ad06c52b584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.420163 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62e1bb84fe46c0815e12dfbac03c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.371232 5859 tablet_service.cc:1467] Processing CreateTablet for tablet c6b18e694df14b6399a554ae65496a82 (DEFAULT_TABLE table=default.Table_8ace400a292441809e397be68d13712c [id=31e35997574c41c6aebfd366856f21ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.420881 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b18e694df14b6399a554ae65496a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.372530 5846 tablet_service.cc:1467] Processing CreateTablet for tablet 35345a76883045afadd5922c11de910d (DEFAULT_TABLE table=default.Table_01da441e756d46a991c3b81c3321667a [id=e2000861b4964e5e96fc2d8d2578c9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.423434 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35345a76883045afadd5922c11de910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.406929 7106 consensus_queue.cc:1035] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:13.430857 7184 raft_consensus.cc:482] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.431033 7184 raft_consensus.cc:504] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.431671 7184 leader_election.cc:288] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.431903 5849 tablet_service.cc:1467] Processing CreateTablet for tablet cee82663abf948a8a2a36c1676a57a8d (DEFAULT_TABLE table=default.Table_3926c98ab5364e61af330f941b3d63bc [id=95012621e3834bfebf0b83c2e45f0db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.432315 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee82663abf948a8a2a36c1676a57a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.433531 6272 ts_tablet_manager.cc:1918] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.433729 6272 log.cc:1196] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:44:13.434094 6272 ts_tablet_manager.cc:1939] T ecb1d807c9f04fe4b02e3343f0c6511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.434455 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 843) took 2234 ms. Trace:
I20260928 10:44:13.434602 6272 rpcz_store.cc:276] 0928 10:44:11.200201 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.200307 (+ 106us) service_pool.cc:227] Handling call
0928 10:44:13.396337 (+2196030us) ts_tablet_manager.cc:1145] Deleting tablet ecb1d807c9f04fe4b02e3343f0c6511c
0928 10:44:13.396347 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.430535 (+ 34188us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.433403 (+ 2868us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.434389 (+ 986us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195028}
I20260928 10:44:13.434985 6272 tablet_replica.cc:330] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.435232 6272 raft_consensus.cc:2229] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.435669 6272 raft_consensus.cc:2258] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.437577 7106 consensus_queue.cc:1035] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:13.443034 6272 ts_tablet_manager.cc:1905] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.444763 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.446579 5817 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.447415 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.447856 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6286ae20ffbe4e24a585f29444acfe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.457867 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet ecb1d807c9f04fe4b02e3343f0c6511c (table default.Table_2599faf42aa64d3e85b31db48c5b2644 [id=61ff49fcb43c4d0e94532e49a70e21b2]) successfully deleted
I20260928 10:44:13.463315 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd5e4e404df4305a5e7168e2ae71306 (DEFAULT_TABLE table=default.Table_b511e6944bb54de49970e8c6fee87274 [id=d87c2dadb2974d49a1c20c69a29555f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.463945 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0e3177956744198b74adbd2c31dbed (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.464429 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0e3177956744198b74adbd2c31dbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.464550 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd5e4e404df4305a5e7168e2ae71306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.475281 6117 tablet_service.cc:1467] Processing CreateTablet for tablet cee82663abf948a8a2a36c1676a57a8d (DEFAULT_TABLE table=default.Table_3926c98ab5364e61af330f941b3d63bc [id=95012621e3834bfebf0b83c2e45f0db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.475109 6130 tablet_service.cc:1467] Processing CreateTablet for tablet a4323f9bd7024d5bbb63e1d34c576a9e (DEFAULT_TABLE table=default.Table_a1160cb2c67c46d0829bea1d983dca12 [id=d50bcd5f61694303bb17cc011827a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.482208 6272 ts_tablet_manager.cc:1918] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.483773 6272 log.cc:1196] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:13.475281 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.484093 6272 ts_tablet_manager.cc:1939] T 23d4da5ccb214a4bbc543c67529b59cf P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.484161 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee82663abf948a8a2a36c1676a57a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.476737 6120 tablet_service.cc:1467] Processing CreateTablet for tablet db62e1bb84fe46c0815e12dfbac03c3a (DEFAULT_TABLE table=default.Table_041e55375217446e8377abc4545d30ae [id=521655cba2a2432ba2438b00742d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.487536 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62e1bb84fe46c0815e12dfbac03c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.488958 6269 ts_tablet_manager.cc:1918] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:13.489079 6269 log.cc:1196] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/72a0adec506e4ca9b10989f18d6c0c22
I20260928 10:44:13.489480 6269 ts_tablet_manager.cc:1939] T 72a0adec506e4ca9b10989f18d6c0c22 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:13.490407 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 731) took 6205 ms. Trace:
I20260928 10:44:13.490571 6269 rpcz_store.cc:276] 0928 10:44:07.284638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.285243 (+ 605us) service_pool.cc:227] Handling call
0928 10:44:13.375123 (+6089880us) ts_tablet_manager.cc:1145] Deleting tablet 72a0adec506e4ca9b10989f18d6c0c22
0928 10:44:13.375131 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.401631 (+ 26500us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.488860 (+ 87229us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.490365 (+ 1505us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6089694}
I20260928 10:44:13.490998 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6286ae20ffbe4e24a585f29444acfe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.491061 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 72a0adec506e4ca9b10989f18d6c0c22 (table default.Table_34437f380f6e451baa642895afcea0d9 [id=489e2ce035cb42c3ad1ed5ced42dcdc8]) successfully deleted
I20260928 10:44:13.491398 6269 tablet_replica.cc:330] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:13.464151 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7131f9259a404382e86ad06c52b584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.492870 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 844) took 2272 ms. Trace:
I20260928 10:44:13.492949 6272 rpcz_store.cc:276] 0928 10:44:11.220318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.220821 (+ 503us) service_pool.cc:227] Handling call
0928 10:44:13.434893 (+2214072us) ts_tablet_manager.cc:1145] Deleting tablet 23d4da5ccb214a4bbc543c67529b59cf
0928 10:44:13.434904 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.446858 (+ 11954us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.482128 (+ 35270us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.492856 (+ 10728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2213726}
I20260928 10:44:13.493203 6272 tablet_replica.cc:330] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.493355 6272 raft_consensus.cc:2229] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.493551 6272 pending_rounds.cc:62] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:13.493618 6272 pending_rounds.cc:68] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265865884758016 op_type: NO_OP noop_request { }
I20260928 10:44:13.493732 6272 raft_consensus.cc:2866] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:13.491603 6269 raft_consensus.cc:2229] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.494554 6272 raft_consensus.cc:2258] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.494757 6269 raft_consensus.cc:2258] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.495129 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4323f9bd7024d5bbb63e1d34c576a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.495198 6272 ts_tablet_manager.cc:1905] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.495600 6269 ts_tablet_manager.cc:1905] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.496043 7184 raft_consensus.cc:482] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.496168 7184 raft_consensus.cc:504] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.496766 7184 leader_election.cc:288] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.497349 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.497889 5817 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:13.498602 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet add5cbcbede9481494444371b44b5ab6 (table default.Table_702ce53597184b5c8e3ed3e16f49d491 [id=97e839da90124c499f45887cde116e02], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet add5cbcbede9481494444371b44b5ab6 consensus state has no leader
I20260928 10:44:13.499526 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 1b42af502e26433d9ba28df3d2e0113f (DEFAULT_TABLE table=default.Table_4eb3f2523bb2424f89c69fcb65ef6616 [id=291d3961d9fe4f7787dd4682b098fe46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.499923 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b42af502e26433d9ba28df3d2e0113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.500509 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 23d4da5ccb214a4bbc543c67529b59cf (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]) successfully deleted
I20260928 10:44:13.500804 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0e3177956744198b74adbd2c31dbed (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.501313 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0e3177956744198b74adbd2c31dbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.504679 6272 ts_tablet_manager.cc:1918] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.364482 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.365193 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7131f9259a404382e86ad06c52b584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.365394 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 9da796356b8f45248a331412588136fc (DEFAULT_TABLE table=default.Table_360ffaceac464cdfb9ca8278f925d9fc [id=2b57666df33544908a3b2887cd832673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.507570 6270 log.cc:1196] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a6b418bbb3364006b097e3a78edf5f55
I20260928 10:44:13.507841 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da796356b8f45248a331412588136fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.507983 6270 ts_tablet_manager.cc:1939] T a6b418bbb3364006b097e3a78edf5f55 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:13.508315 6272 log.cc:1196] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:13.508315 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 768) took 5338 ms. Trace:
I20260928 10:44:13.508399 6270 rpcz_store.cc:276] 0928 10:44:08.170048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.170805 (+ 757us) service_pool.cc:227] Handling call
0928 10:44:13.180142 (+5009337us) ts_tablet_manager.cc:1145] Deleting tablet a6b418bbb3364006b097e3a78edf5f55
0928 10:44:13.180153 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.312125 (+131972us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.337684 (+ 25559us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.508296 (+170612us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5009066}
I20260928 10:44:13.508635 6272 ts_tablet_manager.cc:1939] T dfd9b4092b1242b8a60974c445a2789a P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.508857 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a6b418bbb3364006b097e3a78edf5f55 (table default.Table_534373dcfd75430c9608190a3979421a [id=5557e0d93f67480ca44cf2cd28b92e2e]) successfully deleted
I20260928 10:44:13.508927 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 845) took 2288 ms. Trace:
I20260928 10:44:13.508998 6272 rpcz_store.cc:276] 0928 10:44:11.220404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.221043 (+ 639us) service_pool.cc:227] Handling call
0928 10:44:13.493171 (+2272128us) ts_tablet_manager.cc:1145] Deleting tablet dfd9b4092b1242b8a60974c445a2789a
0928 10:44:13.493179 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.501961 (+ 8782us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.504595 (+ 2634us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.508910 (+ 4315us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2271905}
I20260928 10:44:13.509413 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 850) took 2270 ms. Trace:
I20260928 10:44:13.509485 6272 rpcz_store.cc:276] 0928 10:44:11.239357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.239606 (+ 249us) service_pool.cc:227] Handling call
0928 10:44:13.509235 (+2269629us) ts_tablet_manager.cc:1145] Deleting tablet bc5d744dbc904525858a39c27636443e
0928 10:44:13.509245 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.509399 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2269413}
I20260928 10:44:13.509770 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 846) took 2270 ms. Trace:
I20260928 10:44:13.509835 6272 rpcz_store.cc:276] 0928 10:44:11.238949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.239044 (+ 95us) service_pool.cc:227] Handling call
0928 10:44:13.509675 (+2270631us) ts_tablet_manager.cc:1145] Deleting tablet ddd0439f5f6d4323978bb5fe2d039f75
0928 10:44:13.509682 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.509758 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2269583}
I20260928 10:44:13.510043 6272 tablet_replica.cc:330] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.510210 6272 raft_consensus.cc:2229] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.368543 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 21922242230747e6baac1d77c0928d91 (DEFAULT_TABLE table=default.Table_3e40822e797d4d10b1aa9757f8008373 [id=1469eba59e5145bbbbb497aba1a17df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.510546 6272 raft_consensus.cc:2258] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.510906 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21922242230747e6baac1d77c0928d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.512092 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41 (DEFAULT_TABLE table=default.Table_218b83d626d64b79bb195bd691125578 [id=711861f51c8343f699ab4b27a49ae184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.512507 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.368898 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 8cf2bc530af64cd2be249d7b62488589 (DEFAULT_TABLE table=default.Table_48d4da09446e4cfa882d3a941745fcd2 [id=a86af677accb4761a99fd25d315db9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.370697 5983 tablet_service.cc:1467] Processing CreateTablet for tablet c6b18e694df14b6399a554ae65496a82 (DEFAULT_TABLE table=default.Table_8ace400a292441809e397be68d13712c [id=31e35997574c41c6aebfd366856f21ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.371840 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 35345a76883045afadd5922c11de910d (DEFAULT_TABLE table=default.Table_01da441e756d46a991c3b81c3321667a [id=e2000861b4964e5e96fc2d8d2578c9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.373343 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 91337888b5864a2286b9afb7fcba8c98 (DEFAULT_TABLE table=default.Table_02a2d4e1648a495da6f9df0920977d38 [id=f4440c3619c744bdb1bd8aed38e6c059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.393013 5957 leader_election.cc:302] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.408748 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd5e4e404df4305a5e7168e2ae71306 (DEFAULT_TABLE table=default.Table_b511e6944bb54de49970e8c6fee87274 [id=d87c2dadb2974d49a1c20c69a29555f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.514832 7348 raft_consensus.cc:2781] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.412103 5993 tablet_service.cc:1467] Processing CreateTablet for tablet a4323f9bd7024d5bbb63e1d34c576a9e (DEFAULT_TABLE table=default.Table_a1160cb2c67c46d0829bea1d983dca12 [id=d50bcd5f61694303bb17cc011827a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.417464 5986 tablet_service.cc:1467] Processing CreateTablet for tablet db62e1bb84fe46c0815e12dfbac03c3a (DEFAULT_TABLE table=default.Table_041e55375217446e8377abc4545d30ae [id=521655cba2a2432ba2438b00742d0e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.514971 7348 raft_consensus.cc:686] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.429037 6000 tablet_service.cc:1467] Processing CreateTablet for tablet cee82663abf948a8a2a36c1676a57a8d (DEFAULT_TABLE table=default.Table_3926c98ab5364e61af330f941b3d63bc [id=95012621e3834bfebf0b83c2e45f0db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.444268 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.515215 7348 consensus_queue.cc:237] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.515415 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 1b42af502e26433d9ba28df3d2e0113f (DEFAULT_TABLE table=default.Table_4eb3f2523bb2424f89c69fcb65ef6616 [id=291d3961d9fe4f7787dd4682b098fe46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.515843 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee82663abf948a8a2a36c1676a57a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.515843 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b42af502e26433d9ba28df3d2e0113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.516054 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd5e4e404df4305a5e7168e2ae71306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.516333 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6286ae20ffbe4e24a585f29444acfe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.494371 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0e3177956744198b74adbd2c31dbed (DEFAULT_TABLE table=default.Table_107bf14a134c47eb829f32f9e31ca23b [id=85b228f8cd0e41dda6499f4350efcf07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.516526 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62e1bb84fe46c0815e12dfbac03c3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.514858 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 121866us
I20260928 10:44:13.516933 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cf2bc530af64cd2be249d7b62488589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.517350 5957 leader_election.cc:302] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.517997 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.518371 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.518702 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.518970 7365 raft_consensus.cc:2781] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.519068 7365 raft_consensus.cc:686] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.519274 7365 consensus_queue.cc:237] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.517347 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0e3177956744198b74adbd2c31dbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.521158 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet dfd9b4092b1242b8a60974c445a2789a (table default.Table_e690f55d690b46358de9c97d59e9644b [id=1fc32d0deb66442db0f46fe989de0d55]) successfully deleted
W20260928 10:44:13.521466 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bc5d744dbc904525858a39c27636443e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5d744dbc904525858a39c27636443e already in progress: creating tablet
W20260928 10:44:13.521684 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ddd0439f5f6d4323978bb5fe2d039f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd0439f5f6d4323978bb5fe2d039f75 already in progress: creating tablet
I20260928 10:44:13.521891 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4323f9bd7024d5bbb63e1d34c576a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.522229 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35345a76883045afadd5922c11de910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.522540 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41 (DEFAULT_TABLE table=default.Table_218b83d626d64b79bb195bd691125578 [id=711861f51c8343f699ab4b27a49ae184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.522934 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.524041 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91337888b5864a2286b9afb7fcba8c98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.527360 5818 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.527503 5818 leader_election.cc:302] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:13.527889 5818 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.527997 5818 leader_election.cc:302] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:13.528323 5818 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.528411 5818 leader_election.cc:302] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.495044 6271 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.499476 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 1b42af502e26433d9ba28df3d2e0113f (DEFAULT_TABLE table=default.Table_4eb3f2523bb2424f89c69fcb65ef6616 [id=291d3961d9fe4f7787dd4682b098fe46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.529834 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b42af502e26433d9ba28df3d2e0113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.534621 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b18e694df14b6399a554ae65496a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.535862 6271 ts_tablet_manager.cc:1397] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.293s user 0.005s sys 0.000s
I20260928 10:44:13.536649 6271 raft_consensus.cc:348] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.536861 6271 raft_consensus.cc:374] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.536913 6271 raft_consensus.cc:729] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.537268 6271 consensus_queue.cc:260] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.547216 7353 tablet.cc:1722] T 84912292d6c34a3991bd0f885de240a8 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:13.547845 7205 raft_consensus.cc:2726] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.548055 7205 raft_consensus.cc:2726] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.548198 7205 raft_consensus.cc:482] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.548316 7205 raft_consensus.cc:504] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.548923 7205 leader_election.cc:288] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:13.549364 6272 ts_tablet_manager.cc:1905] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.551517 7184 raft_consensus.cc:2726] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.547672 5993 tablet_service.cc:1467] Processing CreateTablet for tablet a61f862ae0da4763802ca3b28d5e2756 (DEFAULT_TABLE table=default.Table_d740f4b774d24747abdc1a2bbf45b43c [id=272c4622c5194567be13d0034b2c4930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.555452 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61f862ae0da4763802ca3b28d5e2756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.561761 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41 (DEFAULT_TABLE table=default.Table_218b83d626d64b79bb195bd691125578 [id=711861f51c8343f699ab4b27a49ae184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.562204 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15984ec2400e4ef8b9cabfc5eeb1ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.576064 6272 ts_tablet_manager.cc:1918] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.576206 6272 log.cc:1196] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:13.576532 6272 ts_tablet_manager.cc:1939] T 104a223ec6ef47988d0aa3335a1f81de P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.576843 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 847) took 2337 ms. Trace:
I20260928 10:44:13.576925 6272 rpcz_store.cc:276] 0928 10:44:11.239072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.240143 (+ 1071us) service_pool.cc:227] Handling call
0928 10:44:13.510007 (+2269864us) ts_tablet_manager.cc:1145] Deleting tablet 104a223ec6ef47988d0aa3335a1f81de
0928 10:44:13.510016 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.552650 (+ 42634us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.575953 (+ 23303us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.576824 (+ 871us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2269629}
I20260928 10:44:13.577240 6272 tablet_replica.cc:330] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.577417 6272 raft_consensus.cc:2229] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.577562 6272 raft_consensus.cc:2258] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.578081 6272 ts_tablet_manager.cc:1905] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.582653 7106 raft_consensus.cc:482] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.582798 7106 raft_consensus.cc:504] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.583374 7106 leader_election.cc:288] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.583565 5864 tablet_service.cc:1467] Processing CreateTablet for tablet cada7237dcb649188254449bd5fc3136 (DEFAULT_TABLE table=default.Table_ad06e835386b437d8a8ccb4b8dbc479c [id=ad0de11961a94830a5598709b9517440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.583837 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 8b152e2cd91948348a2bb5f557c91757 (DEFAULT_TABLE table=default.Table_1f22ec4cb61c43b3ad281df02eb63b6f [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.583995 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada7237dcb649188254449bd5fc3136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.584148 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b152e2cd91948348a2bb5f557c91757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.584055 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847b18c212474456ac9b40eee055dbd0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.584262 6012 raft_consensus.cc:2454] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:13.584646 6090 leader_election.cc:302] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.584897 7106 raft_consensus.cc:2781] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.584955 7106 raft_consensus.cc:482] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.585003 7106 raft_consensus.cc:3037] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.587257 7106 raft_consensus.cc:504] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.587994 7106 leader_election.cc:288] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.588618 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847b18c212474456ac9b40eee055dbd0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:13.588824 6012 raft_consensus.cc:3037] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.589140 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 2236d65e9048479db0e6b3a09ed71006 (DEFAULT_TABLE table=default.Table_ee1ee04831c7467caabc0039a916deea [id=b20900a39b934f3c8dd43bb4d4102d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.584367 5985 tablet_service.cc:1467] Processing CreateTablet for tablet cada7237dcb649188254449bd5fc3136 (DEFAULT_TABLE table=default.Table_ad06e835386b437d8a8ccb4b8dbc479c [id=ad0de11961a94830a5598709b9517440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.590590 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada7237dcb649188254449bd5fc3136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.591096 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2236d65e9048479db0e6b3a09ed71006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.591418 6012 raft_consensus.cc:2454] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:13.591804 6090 leader_election.cc:302] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.592087 7106 raft_consensus.cc:2781] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.582854 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 2236d65e9048479db0e6b3a09ed71006 (DEFAULT_TABLE table=default.Table_ee1ee04831c7467caabc0039a916deea [id=b20900a39b934f3c8dd43bb4d4102d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.593714 7106 raft_consensus.cc:686] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.593955 7106 consensus_queue.cc:237] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.595167 6272 ts_tablet_manager.cc:1918] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:13.595316 6272 log.cc:1196] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/bae5a2038947413f95f134602081c889
I20260928 10:44:13.595245 5990 tablet_service.cc:1467] Processing CreateTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 (DEFAULT_TABLE table=default.Table_87f60777a09c47299a48851d4774c1c0 [id=a1ee7375b97b4de7b7cadbb9e13ad586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.595314 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 8b152e2cd91948348a2bb5f557c91757 (DEFAULT_TABLE table=default.Table_1f22ec4cb61c43b3ad281df02eb63b6f [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.595659 6272 ts_tablet_manager.cc:1939] T bae5a2038947413f95f134602081c889 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.596002 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 849) took 2356 ms. Trace:
I20260928 10:44:13.596127 6272 rpcz_store.cc:276] 0928 10:44:11.239281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.240318 (+ 1037us) service_pool.cc:227] Handling call
0928 10:44:13.577193 (+2336875us) ts_tablet_manager.cc:1145] Deleting tablet bae5a2038947413f95f134602081c889
0928 10:44:13.577204 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.587006 (+ 9802us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.595081 (+ 8075us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.595985 (+ 904us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2336684}
I20260928 10:44:13.596380 5991 tablet_service.cc:1467] Processing CreateTablet for tablet b300d0ea612c4c3993188c8504ce334c (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.596513 6272 tablet_replica.cc:330] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.595554 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44e7c9d47c24c899ec65d6e7dd9f391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.596731 6272 raft_consensus.cc:2229] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.597052 6272 raft_consensus.cc:2258] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.597893 6272 ts_tablet_manager.cc:1905] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.598629 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b152e2cd91948348a2bb5f557c91757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.598951 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b300d0ea612c4c3993188c8504ce334c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.601397 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 104a223ec6ef47988d0aa3335a1f81de (table default.Table_a98c668a7dea48138cdba63f65364fe8 [id=87c3591cdbf34ccc8c10269033b20843]) successfully deleted
I20260928 10:44:13.601624 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet bae5a2038947413f95f134602081c889 (table default.Table_12f98eb7390e4942864fe3d2eeb10eb7 [id=0d4b949b15404578b153f8be9fc92a6e]) successfully deleted
I20260928 10:44:13.601809 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 2236d65e9048479db0e6b3a09ed71006 (DEFAULT_TABLE table=default.Table_ee1ee04831c7467caabc0039a916deea [id=b20900a39b934f3c8dd43bb4d4102d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.602140 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2236d65e9048479db0e6b3a09ed71006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.603958 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 772) took 5404 ms. Trace:
I20260928 10:44:13.604067 6270 rpcz_store.cc:276] 0928 10:44:08.199612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.199779 (+ 167us) service_pool.cc:227] Handling call
0928 10:44:13.603810 (+5404031us) ts_tablet_manager.cc:1145] Deleting tablet 29f07262a710456ea0837dc5af3eaebb
0928 10:44:13.603826 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.603935 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5403823}
I20260928 10:44:13.604501 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 773) took 5404 ms. Trace:
I20260928 10:44:13.604578 6270 rpcz_store.cc:276] 0928 10:44:08.199721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.200020 (+ 299us) service_pool.cc:227] Handling call
0928 10:44:13.604392 (+5404372us) ts_tablet_manager.cc:1145] Deleting tablet 0e4594eae7b840ff980f67da8ed82e01
0928 10:44:13.604402 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.604485 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5404159}
W20260928 10:44:13.604636 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 29f07262a710456ea0837dc5af3eaebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29f07262a710456ea0837dc5af3eaebb already in progress: creating tablet
I20260928 10:44:13.604877 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 770) took 5405 ms. Trace:
I20260928 10:44:13.604943 6270 rpcz_store.cc:276] 0928 10:44:08.199394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.200509 (+ 1115us) service_pool.cc:227] Handling call
0928 10:44:13.604788 (+5404279us) ts_tablet_manager.cc:1145] Deleting tablet 7e5bec611c95429ab309957f74b70eea
0928 10:44:13.604797 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.604863 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5403567}
W20260928 10:44:13.605152 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0e4594eae7b840ff980f67da8ed82e01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4594eae7b840ff980f67da8ed82e01 already in progress: creating tablet
W20260928 10:44:13.605599 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7e5bec611c95429ab309957f74b70eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e5bec611c95429ab309957f74b70eea already in progress: creating tablet
I20260928 10:44:13.606896 6119 tablet_service.cc:1467] Processing CreateTablet for tablet cada7237dcb649188254449bd5fc3136 (DEFAULT_TABLE table=default.Table_ad06e835386b437d8a8ccb4b8dbc479c [id=ad0de11961a94830a5598709b9517440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.607367 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada7237dcb649188254449bd5fc3136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.609126 6271 ts_tablet_manager.cc:1428] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260928 10:44:13.609426 6271 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.610811 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 8b152e2cd91948348a2bb5f557c91757 (DEFAULT_TABLE table=default.Table_1f22ec4cb61c43b3ad281df02eb63b6f [id=1eb33ea15c314d0687721d3b2452834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.611181 6271 tablet_bootstrap.cc:654] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.611195 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b152e2cd91948348a2bb5f557c91757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.614882 6136 tablet_service.cc:1467] Processing CreateTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 (DEFAULT_TABLE table=default.Table_87f60777a09c47299a48851d4774c1c0 [id=a1ee7375b97b4de7b7cadbb9e13ad586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.615015 5851 tablet_service.cc:1467] Processing CreateTablet for tablet a61f862ae0da4763802ca3b28d5e2756 (DEFAULT_TABLE table=default.Table_d740f4b774d24747abdc1a2bbf45b43c [id=272c4622c5194567be13d0034b2c4930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.615281 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44e7c9d47c24c899ec65d6e7dd9f391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.615283 5857 tablet_service.cc:1467] Processing CreateTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 (DEFAULT_TABLE table=default.Table_87f60777a09c47299a48851d4774c1c0 [id=a1ee7375b97b4de7b7cadbb9e13ad586]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:13.615588 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 64993.6us
I20260928 10:44:13.618817 6127 tablet_service.cc:1467] Processing CreateTablet for tablet b300d0ea612c4c3993188c8504ce334c (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.619197 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b300d0ea612c4c3993188c8504ce334c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.619966 6091 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 847b18c212474456ac9b40eee055dbd0
W20260928 10:44:13.620390 6091 leader_election.cc:341] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 847b18c212474456ac9b40eee055dbd0
I20260928 10:44:13.620860 7381 raft_consensus.cc:482] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.621016 7381 raft_consensus.cc:504] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.621639 7381 leader_election.cc:288] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.621802 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2236d65e9048479db0e6b3a09ed71006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.622073 6269 ts_tablet_manager.cc:1918] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:13.622207 6269 log.cc:1196] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:13.622550 6269 ts_tablet_manager.cc:1939] T f1a8f5241dd14684b5544e47d6cec9cc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:13.623235 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.623383 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 732) took 6312 ms. Trace:
I20260928 10:44:13.623494 6269 rpcz_store.cc:276] 0928 10:44:07.311231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.311336 (+ 105us) service_pool.cc:227] Handling call
0928 10:44:13.491334 (+6179998us) ts_tablet_manager.cc:1145] Deleting tablet f1a8f5241dd14684b5544e47d6cec9cc
0928 10:44:13.491344 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.564316 (+ 72972us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.621958 (+ 57642us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.623341 (+ 1383us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6179687}
I20260928 10:44:13.623976 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f1a8f5241dd14684b5544e47d6cec9cc (table default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]) successfully deleted
I20260928 10:44:13.624334 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61f862ae0da4763802ca3b28d5e2756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.626662 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44e7c9d47c24c899ec65d6e7dd9f391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.628286 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.635903 6275 tablet_bootstrap.cc:492] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.636052 6275 ts_tablet_manager.cc:1397] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.312s user 0.004s sys 0.000s
I20260928 10:44:13.636652 6275 raft_consensus.cc:348] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.636873 6275 raft_consensus.cc:374] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.636915 6275 raft_consensus.cc:729] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.637084 6275 consensus_queue.cc:260] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.641717 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 771) took 5442 ms. Trace:
I20260928 10:44:13.641999 6272 ts_tablet_manager.cc:1918] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.641846 6270 rpcz_store.cc:276] 0928 10:44:08.199525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.202287 (+ 2762us) service_pool.cc:227] Handling call
0928 10:44:13.605300 (+5403013us) ts_tablet_manager.cc:1145] Deleting tablet 7834a54e59114a77b4e54e9190049a47
0928 10:44:13.605310 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.641674 (+ 36364us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5402558}
I20260928 10:44:13.642161 6275 ts_tablet_manager.cc:1428] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:44:13.642163 6272 log.cc:1196] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:13.642395 6270 tablet_replica.cc:330] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:13.642601 6270 raft_consensus.cc:2229] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:13.642582 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7834a54e59114a77b4e54e9190049a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7834a54e59114a77b4e54e9190049a47 already in progress: creating tablet
I20260928 10:44:13.642791 6270 raft_consensus.cc:2258] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.642956 6272 ts_tablet_manager.cc:1939] T 98bd99e7bdb647ceb9357f88affc45d9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.643488 6270 ts_tablet_manager.cc:1905] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.643685 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 848) took 2404 ms. Trace:
I20260928 10:44:13.643846 6272 rpcz_store.cc:276] 0928 10:44:11.239193 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.240540 (+ 1347us) service_pool.cc:227] Handling call
0928 10:44:13.596475 (+2355935us) ts_tablet_manager.cc:1145] Deleting tablet 98bd99e7bdb647ceb9357f88affc45d9
0928 10:44:13.596485 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.600743 (+ 4258us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.641824 (+ 41081us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.643666 (+ 1842us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2355799}
I20260928 10:44:13.644332 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 851) took 2380 ms. Trace:
I20260928 10:44:13.644457 6272 rpcz_store.cc:276] 0928 10:44:11.264374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.264432 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:13.644214 (+2379782us) ts_tablet_manager.cc:1145] Deleting tablet 4a5564088c5e45788794f130134b5ba5
0928 10:44:13.644223 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.644309 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2372996}
I20260928 10:44:13.645040 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 98bd99e7bdb647ceb9357f88affc45d9 (table default.Table_9420102eb4994caea7a11294bebbebd0 [id=d47f757b2fab48be9a9d94e97f1ff72a]) successfully deleted
I20260928 10:44:13.646238 7348 consensus_queue.cc:1035] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:13.647043 6128 tablet_service.cc:1467] Processing CreateTablet for tablet a61f862ae0da4763802ca3b28d5e2756 (DEFAULT_TABLE table=default.Table_d740f4b774d24747abdc1a2bbf45b43c [id=272c4622c5194567be13d0034b2c4930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.647583 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a61f862ae0da4763802ca3b28d5e2756. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:13.652566 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4a5564088c5e45788794f130134b5ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a5564088c5e45788794f130134b5ba5 already in progress: creating tablet
I20260928 10:44:13.652697 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 852) took 2339 ms. Trace:
I20260928 10:44:13.652791 6272 rpcz_store.cc:276] 0928 10:44:11.313760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.313815 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:13.644840 (+2331025us) ts_tablet_manager.cc:1145] Deleting tablet 88f81c47745142568f7a4dd30d468220
0928 10:44:13.644849 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.652674 (+ 7825us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330793}
I20260928 10:44:13.653541 6272 tablet_replica.cc:330] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.654178 6272 raft_consensus.cc:2229] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.654785 6272 raft_consensus.cc:2258] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:13.655622 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 88f81c47745142568f7a4dd30d468220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88f81c47745142568f7a4dd30d468220 already in progress: creating tablet
I20260928 10:44:13.655790 6272 ts_tablet_manager.cc:1905] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.660450 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:13.660966 5697 catalog_manager.cc:6565] ReplaceTablet: tablet f7d762e03b384d85b4e04be8331474a4 deleted and replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37
I20260928 10:44:13.661123 5697 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:45112 (request call id 1095) took 1063 ms. Trace:
I20260928 10:44:13.661233 5697 rpcz_store.cc:276] 0928 10:44:12.597202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.032511 (+435309us) service_pool.cc:227] Handling call
0928 10:44:13.052485 (+ 19974us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e060a527 00007fa6d78fcda7 00007fa6d78fcad5 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:13.661058 (+608573us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:13.315035 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:13.315135 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:13.315139 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:13.315142 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:13.315223 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:13.315230 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:13.315234 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:13.315291 (+ 57us) tablet.cc:699] Row locks acquired
0928 10:44:13.315293 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:13.315317 (+ 24us) write_op.cc:270] Start()
0928 10:44:13.315340 (+ 23us) write_op.cc:276] Timestamp: P: 1790592253315291 usec, L: 0
0928 10:44:13.331946 (+ 16606us) op_driver.cc:331] REPLICATION: starting
0928 10:44:13.332190 (+ 244us) log.cc:842] Serialized 625 byte log entry
0928 10:44:13.659408 (+327218us) op_driver.cc:444] REPLICATION: finished
0928 10:44:13.659560 (+ 152us) write_op.cc:301] APPLY: starting
0928 10:44:13.659579 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:13.659630 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:13.659656 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:13.659779 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:13.659847 (+ 68us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:13.659853 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:13.659950 (+ 97us) log.cc:842] Serialized 29 byte log entry
0928 10:44:13.660030 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.660053 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:13.660062 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:13.660121 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:13.660124 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":44826880,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":628,"apply.run_wall_time_us":629,"num_ops":2,"prepare.queue_time_us":111532,"prepare.run_cpu_time_us":653,"prepare.run_wall_time_us":17235,"replication_time_us":327419}]]}
I20260928 10:44:13.661721 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d762e03b384d85b4e04be8331474a4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.662168 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b1cdff9f01974354a81179dd9bd5a26e
I20260928 10:44:13.662642 5700 catalog_manager.cc:6565] ReplaceTablet: tablet b1cdff9f01974354a81179dd9bd5a26e deleted and replaced by tablet e49c5428f8674548a309e5cf58c82049
I20260928 10:44:13.663074 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5" } modify_external_catalogs: true
I20260928 10:44:13.663275 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3ef63b0fd56a4ebaa31ba5d0ce7ad0e5" } modify_external_catalogs: true
I20260928 10:44:13.663280 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cdff9f01974354a81179dd9bd5a26e with delete_type TABLET_DATA_DELETED (replaced by tablet e49c5428f8674548a309e5cf58c82049) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.663452 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d1b89a8edd5645afa41693f5bca42f8d
I20260928 10:44:13.664219 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_763294cebd5a42a0b63f77c38ccd2663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.664592 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_135c07ef280d4a9b83f7529a30ce29fd" } modify_external_catalogs: true
W20260928 10:44:13.664849 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_763294cebd5a42a0b63f77c38ccd2663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.665135 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_56d98f59d24d4db58f8dc77f3c25918d" } modify_external_catalogs: true
I20260928 10:44:13.665364 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_56d98f59d24d4db58f8dc77f3c25918d" } modify_external_catalogs: true
I20260928 10:44:13.666568 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_55d599e766904a868f70b08efe31eb95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.666805 6271 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.666935 6271 ts_tablet_manager.cc:1397] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
W20260928 10:44:13.667191 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55d599e766904a868f70b08efe31eb95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.667677 6271 raft_consensus.cc:348] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.667869 6271 raft_consensus.cc:374] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.667913 6271 raft_consensus.cc:729] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.668213 6271 consensus_queue.cc:260] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.668322 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4e02eac28c6d47d3baf8e9d3e27c0cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.668816 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e02eac28c6d47d3baf8e9d3e27c0cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.669189 7348 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.669291 7348 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.669867 7348 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.670805 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.664786 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_135c07ef280d4a9b83f7529a30ce29fd" } modify_external_catalogs: true
W20260928 10:44:13.671471 5955 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.663085 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_85b812a6e2614d1eb3fe6afd7f0784ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.672331 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85b812a6e2614d1eb3fe6afd7f0784ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.672657 6271 ts_tablet_manager.cc:1428] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:44:13.673384 6271 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.674291 7106 consensus_queue.cc:1035] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:13.675668 5818 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.675879 5852 tablet_service.cc:1467] Processing CreateTablet for tablet b300d0ea612c4c3993188c8504ce334c (DEFAULT_TABLE table=default.Table_bbc76197cee647ed96ae1e077c21f1d9 [id=e4ad9bfa68104089bc71547d79159f10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:13.676623 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:13.676923 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:13.677870 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.680655 5694 catalog_manager.cc:5495] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:13.681144 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:13.681610 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:13.681934 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.682335 6271 tablet_bootstrap.cc:654] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.682509 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 735) took 6281 ms. Trace:
I20260928 10:44:13.684531 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b89a8edd5645afa41693f5bca42f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.686168 6270 ts_tablet_manager.cc:1918] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.686393 6270 log.cc:1196] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:13.687031 6270 ts_tablet_manager.cc:1939] T 3d5b422c70a84cc0bc9f8a686f4e2c82 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:13.687582 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 774) took 5356 ms. Trace:
I20260928 10:44:13.687808 6270 rpcz_store.cc:276] 0928 10:44:08.331531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.331591 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:13.642343 (+5310752us) ts_tablet_manager.cc:1145] Deleting tablet 3d5b422c70a84cc0bc9f8a686f4e2c82
0928 10:44:13.642356 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.646724 (+ 4368us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.686024 (+ 39300us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.687564 (+ 1540us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5310516}
I20260928 10:44:13.688458 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 (table default.Table_de468dcafe554bba9d4279813098e5d5 [id=92f40b0873ca472db40650520fdfa06a]) successfully deleted
I20260928 10:44:13.689769 6270 tablet_replica.cc:330] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:13.690126 6270 raft_consensus.cc:2229] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.690455 6270 raft_consensus.cc:2258] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.691860 5702 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916] alter complete (version 2)
I20260928 10:44:13.692175 6270 ts_tablet_manager.cc:1905] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.692973 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ab3769f0805b4970b30845f5f978e14a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.693522 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3769f0805b4970b30845f5f978e14a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.695257 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet de99da54941a4eaf9107f4b2efca5c7b
I20260928 10:44:13.695875 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet de99da54941a4eaf9107f4b2efca5c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.695955 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bef25f1d1cbf4967b518fdda6253dfe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.696488 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bef25f1d1cbf4967b518fdda6253dfe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.699515 6271 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.699750 6271 ts_tablet_manager.cc:1397] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260928 10:44:13.700066 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c2af1c83c4544bc68c67f7002742b2cd
I20260928 10:44:13.700958 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b155950aea474e6183a91c170817945b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.701277 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cdff9f01974354a81179dd9bd5a26e with delete_type TABLET_DATA_DELETED (replaced by tablet e49c5428f8674548a309e5cf58c82049) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:13.701624 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b155950aea474e6183a91c170817945b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.701551 6271 raft_consensus.cc:348] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.701817 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet c2af1c83c4544bc68c67f7002742b2cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.701901 6271 raft_consensus.cc:374] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.701936 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b89a8edd5645afa41693f5bca42f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.702018 6271 raft_consensus.cc:729] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.702328 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d762e03b384d85b4e04be8331474a4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.702554 6271 consensus_queue.cc:260] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.703826 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 19e0768dea6a40889a3f50b953c0ee4d from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.704275 6271 ts_tablet_manager.cc:1428] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:44:13.705014 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9fbab8d6361e4b5c911c8025224cec8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.706010 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fbab8d6361e4b5c911c8025224cec8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.707882 6271 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.708897 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet c2af1c83c4544bc68c67f7002742b2cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.710246 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet de99da54941a4eaf9107f4b2efca5c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.714290 6271 tablet_bootstrap.cc:654] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.720633 6272 ts_tablet_manager.cc:1918] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.720670 6275 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:13.725131 6270 ts_tablet_manager.cc:1918] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.725468 6270 log.cc:1196] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c2635c7c47ba4383b6b0f07cd3b42f74
I20260928 10:44:13.725755 6275 tablet_bootstrap.cc:654] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.726286 6270 ts_tablet_manager.cc:1939] T c2635c7c47ba4383b6b0f07cd3b42f74 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:13.726970 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 775) took 5363 ms. Trace:
I20260928 10:44:13.727108 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e15c910d058b467693d20c3f1c8fdcdd" } new_table_name: "default.Table_bdcfca3d91844b9c9defbe8d1d008484" modify_external_catalogs: true
I20260928 10:44:13.727167 6270 rpcz_store.cc:276] 0928 10:44:08.363558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.363617 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:13.688871 (+5325254us) ts_tablet_manager.cc:1145] Deleting tablet c2635c7c47ba4383b6b0f07cd3b42f74
0928 10:44:13.688885 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.715832 (+ 26947us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.723197 (+ 7365us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.726927 (+ 3730us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5320638}
I20260928 10:44:13.728536 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c2635c7c47ba4383b6b0f07cd3b42f74 (table default.Table_00012b0f0bd34c4bae0dd33bd461bc07 [id=6b41748e62a44f6cabb973f1c842b36e]) successfully deleted
I20260928 10:44:13.729058 6270 tablet_replica.cc:330] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:13.729079 6272 log.cc:1196] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/bd225da0b4b445c6ac03634d975e8396
I20260928 10:44:13.729434 6272 ts_tablet_manager.cc:1939] T bd225da0b4b445c6ac03634d975e8396 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.729568 6270 raft_consensus.cc:2229] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.729779 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 853) took 2388 ms. Trace:
I20260928 10:44:13.729887 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet bb4590c83aa24745af278fcac0a9d518
I20260928 10:44:13.729923 6270 pending_rounds.cc:62] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:13.729866 6272 rpcz_store.cc:276] 0928 10:44:11.341506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.341566 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:13.653493 (+2311927us) ts_tablet_manager.cc:1145] Deleting tablet bd225da0b4b445c6ac03634d975e8396
0928 10:44:13.653504 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.717580 (+ 64076us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.720510 (+ 2930us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.729761 (+ 9251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2311690}
I20260928 10:44:13.730181 6270 pending_rounds.cc:68] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265865884758016 op_type: NO_OP noop_request { }
I20260928 10:44:13.730469 6270 raft_consensus.cc:2866] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:13.730645 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1c452474e96647c6a42ccc1dfd19d7db" } new_table_name: "default.Table_2e7199f3e03c48228c2fe28bc4e79433" modify_external_catalogs: true
I20260928 10:44:13.730762 6270 raft_consensus.cc:2258] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.731148 6271 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.731277 6271 ts_tablet_manager.cc:1397] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.001s
I20260928 10:44:13.731526 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet bb4590c83aa24745af278fcac0a9d518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.732806 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet bd225da0b4b445c6ac03634d975e8396 (table default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]) successfully deleted
I20260928 10:44:13.732285 6271 raft_consensus.cc:348] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.734313 6271 raft_consensus.cc:374] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.734520 6271 raft_consensus.cc:729] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.735188 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.735033 6271 consensus_queue.cc:260] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.736065 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet c2af1c83c4544bc68c67f7002742b2cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.736397 6271 ts_tablet_manager.cc:1428] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
W20260928 10:44:13.736526 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 46761.6us
I20260928 10:44:13.736886 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b300d0ea612c4c3993188c8504ce334c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:13.736896 6271 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.738029 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d762e03b384d85b4e04be8331474a4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.737669 6269 rpcz_store.cc:276] 0928 10:44:07.346751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:07.346825 (+ 74us) service_pool.cc:227] Handling call
0928 10:44:13.628184 (+6281359us) ts_tablet_manager.cc:1145] Deleting tablet 0471473cce114d3985f9a8de2de77d39
0928 10:44:13.628207 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.628312 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6281116}
I20260928 10:44:13.739257 6270 ts_tablet_manager.cc:1905] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:13.739406 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0471473cce114d3985f9a8de2de77d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0471473cce114d3985f9a8de2de77d39 already in progress: creating tablet
I20260928 10:44:13.739521 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.739663 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet de99da54941a4eaf9107f4b2efca5c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.739925 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet bb4590c83aa24745af278fcac0a9d518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:13.740887 5817 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.741380 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cdff9f01974354a81179dd9bd5a26e with delete_type TABLET_DATA_DELETED (replaced by tablet e49c5428f8674548a309e5cf58c82049) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:13.741648 5818 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.742900 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.744494 5882 raft_consensus.cc:2454] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.741561 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b89a8edd5645afa41693f5bca42f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.734797 6275 tablet_bootstrap.cc:492] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.747839 6275 ts_tablet_manager.cc:1397] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.003s
I20260928 10:44:13.746115 5817 leader_election.cc:302] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.748512 6275 raft_consensus.cc:348] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.748739 6275 raft_consensus.cc:374] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.748791 6275 raft_consensus.cc:729] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.748987 6275 consensus_queue.cc:260] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.749492 6275 ts_tablet_manager.cc:1428] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:13.749854 5957 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.750077 6275 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:13.750391 7348 raft_consensus.cc:2781] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.750469 7348 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.750553 7348 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.751555 6275 tablet_bootstrap.cc:654] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.753403 7348 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.749848 7168 consensus_queue.cc:1035] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260928 10:44:13.754659 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:13.755442 5955 leader_election.cc:341] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.755426 7348 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.759228 6976 raft_consensus.cc:482] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.759379 6976 raft_consensus.cc:504] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.759977 6976 leader_election.cc:288] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.761451 7348 raft_consensus.cc:482] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.762367 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
W20260928 10:44:13.763458 6091 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:13.761693 7348 raft_consensus.cc:504] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.764413 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.764647 6012 raft_consensus.cc:2454] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:13.765681 6090 leader_election.cc:302] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:13.765960 6976 raft_consensus.cc:2781] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.766040 6976 raft_consensus.cc:482] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.766095 6976 raft_consensus.cc:3037] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.766844 7348 leader_election.cc:288] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.768584 6976 raft_consensus.cc:504] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.769631 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.769690 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac466fe364472391a1fc2d75a46b9b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:13.769840 6151 raft_consensus.cc:2379] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:44:13.769841 6012 raft_consensus.cc:3037] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.770181 6976 leader_election.cc:288] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.773720 6012 raft_consensus.cc:2454] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:13.774263 6090 leader_election.cc:302] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:13.774950 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dce9710720074022a1cc005217a6ad07" } new_table_name: "default.Table_db36b67d12bf4dcd8a50c552c5d3d0a6" modify_external_catalogs: true
I20260928 10:44:13.777555 6976 raft_consensus.cc:2781] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.777828 6976 raft_consensus.cc:686] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:13.778124 6976 consensus_queue.cc:237] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.779029 6271 tablet_bootstrap.cc:654] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.783689 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 749) took 6287 ms. Trace:
I20260928 10:44:13.791105 7382 raft_consensus.cc:2726] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.792644 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_35e86b6b24f34f20bd7121009fc8dd2e [id=11a38f1ba2c7418f93cf366da4ac5813] alter complete (version 3)
I20260928 10:44:13.795123 6151 raft_consensus.cc:3037] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.795444 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet ecb1d807c9f04fe4b02e3343f0c6511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.795442 6269 rpcz_store.cc:276] 0928 10:44:07.453566 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.102309 (+648743us) service_pool.cc:227] Handling call
0928 10:44:13.739380 (+5637071us) ts_tablet_manager.cc:1145] Deleting tablet 10c23684385749e98359126cfd04b6f7
0928 10:44:13.741295 (+ 1915us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.741410 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5573835}
I20260928 10:44:13.795687 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d4da5ccb214a4bbc543c67529b59cf with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef1e7125d4e42f5b30f33bfa588511c) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.795873 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet 54b78fbf508f4e47bd31661e05dcaa16 with delete_type TABLET_DATA_DELETED (replaced by tablet 75539c390965493eaa69a0d1215fa922) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:13.795991 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 10c23684385749e98359126cfd04b6f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c23684385749e98359126cfd04b6f7 already in progress: creating tablet
I20260928 10:44:13.796030 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 847b18c212474456ac9b40eee055dbd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb945bc6b99a44e0932b2a94f05db6c2) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.796170 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac466fe364472391a1fc2d75a46b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.796303 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e05cdd590894adcb987ef3ac78bf416 with delete_type TABLET_DATA_DELETED (replaced by tablet a3a69d7cdda844c38fcd6a32604aecb6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.796440 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet a25c7f3b94e94cafb3275a2e190be0ed with delete_type TABLET_DATA_DELETED (replaced by tablet e6bd816447ad4a58b679f83b8acbb4b5) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.796577 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 104a223ec6ef47988d0aa3335a1f81de with delete_type TABLET_DATA_DELETED (replaced by tablet 29a1be37ede84ea485182044be92b8c6) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.797895 5879 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.798187 7348 raft_consensus.cc:482] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.798344 7348 raft_consensus.cc:504] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.798666 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 98bd99e7bdb647ceb9357f88affc45d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 45a8098440fb4e919bc5e3f4dd3241a7) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.799533 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.799757 7348 leader_election.cc:288] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:13.800405 5955 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.802680 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet c2635c7c47ba4383b6b0f07cd3b42f74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.802937 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.803086 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.804834 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.741793 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet bb4590c83aa24745af278fcac0a9d518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.747648 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 854) took 2322 ms. Trace:
I20260928 10:44:13.806505 6272 rpcz_store.cc:276] 0928 10:44:11.425157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.425327 (+ 170us) service_pool.cc:227] Handling call
0928 10:44:13.747472 (+2322145us) ts_tablet_manager.cc:1145] Deleting tablet b6bf7ae81883467095a04ff22fe0c7f8
0928 10:44:13.747488 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.747623 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321953}
I20260928 10:44:13.807009 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 855) took 2350 ms. Trace:
I20260928 10:44:13.807097 6272 rpcz_store.cc:276] 0928 10:44:11.456822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.456885 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:13.806823 (+2349938us) ts_tablet_manager.cc:1145] Deleting tablet e9c596f9cd28453883d0299e698fba31
0928 10:44:13.806839 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.806988 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2349733}
I20260928 10:44:13.807405 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 856) took 1967 ms. Trace:
I20260928 10:44:13.807478 6272 rpcz_store.cc:276] 0928 10:44:11.840360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.840599 (+ 239us) service_pool.cc:227] Handling call
0928 10:44:13.807319 (+1966720us) ts_tablet_manager.cc:1145] Deleting tablet dbd5d1ccd2e54f3884af3af327bb892e
0928 10:44:13.807331 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.807391 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966512}
I20260928 10:44:13.807709 6272 tablet_replica.cc:330] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.807888 6272 raft_consensus.cc:2229] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.808048 6272 raft_consensus.cc:2258] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.808614 6272 ts_tablet_manager.cc:1905] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.809053 7238 consensus_queue.cc:1035] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:13.810755 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b6bf7ae81883467095a04ff22fe0c7f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6bf7ae81883467095a04ff22fe0c7f8 already in progress: creating tablet
W20260928 10:44:13.811058 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e9c596f9cd28453883d0299e698fba31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9c596f9cd28453883d0299e698fba31 already in progress: creating tablet
W20260928 10:44:13.811318 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet dbd5d1ccd2e54f3884af3af327bb892e because the tablet was not found. No further retry: Not found: Tablet not found: dbd5d1ccd2e54f3884af3af327bb892e
I20260928 10:44:13.812013 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_393615b6c4fc47f483918d58dc0cfae6" } new_table_name: "default.Table_e4ed417270ba431795f0e95eedb22d6f" modify_external_catalogs: true
I20260928 10:44:13.813575 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3c20aca5a38e43809461b0427df9b5f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:13.814216 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c20aca5a38e43809461b0427df9b5f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:13.814765 5817 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.815204 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.815464 5884 raft_consensus.cc:2454] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.815521 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_02a2d4e1648a495da6f9df0920977d38" } modify_external_catalogs: true
I20260928 10:44:13.815729 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_02a2d4e1648a495da6f9df0920977d38" } modify_external_catalogs: true
I20260928 10:44:13.816386 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_678f98b781d743d7a90db47d1a9bcb58" } new_table_name: "default.Table_fb35582dd0e647778ff1e5b0ffedab4c" modify_external_catalogs: true
I20260928 10:44:13.817312 6272 ts_tablet_manager.cc:1918] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:13.817420 6272 log.cc:1196] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/86b16eb36c034591ac1603ab84fd9342
I20260928 10:44:13.817694 6272 ts_tablet_manager.cc:1939] T 86b16eb36c034591ac1603ab84fd9342 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.818001 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 857) took 1977 ms. Trace:
I20260928 10:44:13.818074 6272 rpcz_store.cc:276] 0928 10:44:11.840540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.840840 (+ 300us) service_pool.cc:227] Handling call
0928 10:44:13.807669 (+1966829us) ts_tablet_manager.cc:1145] Deleting tablet 86b16eb36c034591ac1603ab84fd9342
0928 10:44:13.807679 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.813715 (+ 6036us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.817203 (+ 3488us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.817983 (+ 780us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966657}
I20260928 10:44:13.818321 5879 raft_consensus.cc:2454] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:13.818548 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 86b16eb36c034591ac1603ab84fd9342 (table default.Table_6279d9ee60ce44759d7bc1ae62dd2073 [id=d006fbd87b934957b39ed53725c2eb78]) successfully deleted
I20260928 10:44:13.818683 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 858) took 1959 ms. Trace:
I20260928 10:44:13.818758 6272 rpcz_store.cc:276] 0928 10:44:11.859428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.859484 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:13.818543 (+1959059us) ts_tablet_manager.cc:1145] Deleting tablet 00b7e26971914613a2372476b348b702
0928 10:44:13.818555 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.818667 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1957622}
W20260928 10:44:13.819217 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 00b7e26971914613a2372476b348b702 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b7e26971914613a2372476b348b702 already in progress: creating tablet
I20260928 10:44:13.819391 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 859) took 1937 ms. Trace:
I20260928 10:44:13.819505 6272 rpcz_store.cc:276] 0928 10:44:11.882351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.882400 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:13.819202 (+1936802us) ts_tablet_manager.cc:1145] Deleting tablet 19f68e9f9bf44cf09fc87f102de60f28
0928 10:44:13.819214 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.819300 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1936569}
W20260928 10:44:13.819938 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 19f68e9f9bf44cf09fc87f102de60f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f68e9f9bf44cf09fc87f102de60f28 already in progress: creating tablet
I20260928 10:44:13.820093 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 869) took 1777 ms. Trace:
I20260928 10:44:13.820205 6272 rpcz_store.cc:276] 0928 10:44:12.042337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.042561 (+ 224us) service_pool.cc:227] Handling call
0928 10:44:13.819927 (+1777366us) ts_tablet_manager.cc:1145] Deleting tablet 29b6d18cf0304edc8b3ca1d4d106decb
0928 10:44:13.819938 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.820015 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1554871}
I20260928 10:44:13.820637 6272 tablet_replica.cc:330] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:13.820636 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 29b6d18cf0304edc8b3ca1d4d106decb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b6d18cf0304edc8b3ca1d4d106decb already in progress: creating tablet
W20260928 10:44:13.825546 5957 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:13.825738 5957 leader_election.cc:302] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:13.826388 7365 raft_consensus.cc:2726] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.826882 5957 leader_election.cc:302] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.827275 7365 raft_consensus.cc:2781] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.827354 7365 raft_consensus.cc:482] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.827418 7365 raft_consensus.cc:3037] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.830881 5957 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.831326 7168 raft_consensus.cc:2781] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.831447 7168 raft_consensus.cc:686] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.831688 7168 consensus_queue.cc:237] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.830284 7365 raft_consensus.cc:504] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.834404 7365 leader_election.cc:288] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.834347 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:13.835037 5955 leader_election.cc:341] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:13.837280 6091 leader_election.cc:341] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:13.838274 7382 raft_consensus.cc:482] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.838467 7382 raft_consensus.cc:504] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.839218 7382 leader_election.cc:288] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.839550 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:13.839812 5879 raft_consensus.cc:3037] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.842625 5817 leader_election.cc:302] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.843024 7382 raft_consensus.cc:2726] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:13.843384 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 93889.6us
I20260928 10:44:13.843816 6273 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:13.845291 6273 ts_tablet_manager.cc:1397] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.590s user 0.007s sys 0.007s
I20260928 10:44:13.846184 6273 raft_consensus.cc:348] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.847421 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.848584 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:13.855118 6273 raft_consensus.cc:374] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.856032 6273 raft_consensus.cc:729] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.844166 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 759) took 6291 ms. Trace:
I20260928 10:44:13.856534 6273 consensus_queue.cc:260] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:13.849588 5817 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.857309 6269 rpcz_store.cc:276] 0928 10:44:07.504475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.172564 (+668089us) service_pool.cc:227] Handling call
0928 10:44:13.796274 (+5623710us) ts_tablet_manager.cc:1145] Deleting tablet e89d3b5d65454b2982e625dd4f909bfb
0928 10:44:13.796287 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.796393 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5623502}
I20260928 10:44:13.859025 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 764) took 6255 ms. Trace:
W20260928 10:44:13.859212 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e89d3b5d65454b2982e625dd4f909bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89d3b5d65454b2982e625dd4f909bfb already in progress: creating tablet
I20260928 10:44:13.859212 6269 rpcz_store.cc:276] 0928 10:44:07.604037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.183495 (+579458us) service_pool.cc:227] Handling call
0928 10:44:13.858833 (+5675338us) ts_tablet_manager.cc:1145] Deleting tablet 58b58d0c904a423f9801a883a2a2dfc1
0928 10:44:13.858847 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.858978 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5675082}
I20260928 10:44:13.859617 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 767) took 6161 ms. Trace:
W20260928 10:44:13.859829 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 58b58d0c904a423f9801a883a2a2dfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b58d0c904a423f9801a883a2a2dfc1 already in progress: creating tablet
I20260928 10:44:13.859810 6269 rpcz_store.cc:276] 0928 10:44:07.698112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.189851 (+491739us) service_pool.cc:227] Handling call
0928 10:44:13.859469 (+5669618us) ts_tablet_manager.cc:1145] Deleting tablet fe768adf9a1b4631b63151f8cf3cc3ba
0928 10:44:13.859481 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.859572 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5669378}
I20260928 10:44:13.860144 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 752) took 6392 ms. Trace:
I20260928 10:44:13.860230 6269 rpcz_store.cc:276] 0928 10:44:07.467364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.108980 (+641616us) service_pool.cc:227] Handling call
0928 10:44:13.860029 (+5751049us) ts_tablet_manager.cc:1145] Deleting tablet d42e218538814686a6c8308b1bc43949
0928 10:44:13.860038 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.860113 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5660486}
I20260928 10:44:13.860457 6269 tablet_replica.cc:330] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:13.860677 6269 raft_consensus.cc:2229] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:13.855886 5879 raft_consensus.cc:2454] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:13.861163 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet fe768adf9a1b4631b63151f8cf3cc3ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe768adf9a1b4631b63151f8cf3cc3ba already in progress: creating tablet
W20260928 10:44:13.861490 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d42e218538814686a6c8308b1bc43949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d42e218538814686a6c8308b1bc43949 already in progress: creating tablet
I20260928 10:44:13.861550 6273 ts_tablet_manager.cc:1428] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260928 10:44:13.862406 6269 raft_consensus.cc:2258] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.863535 6269 ts_tablet_manager.cc:1905] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:13.863039 5818 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.862907 6273 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:13.864859 5818 leader_election.cc:302] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.865166 7382 raft_consensus.cc:2726] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.865736 5957 leader_election.cc:302] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.866416 7168 raft_consensus.cc:2781] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.866586 7168 raft_consensus.cc:686] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.866813 7168 consensus_queue.cc:237] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.869534 7348 raft_consensus.cc:482] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.869699 7348 raft_consensus.cc:504] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.870424 7348 leader_election.cc:288] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.870710 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.871464 5955 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.873800 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.874048 5879 raft_consensus.cc:2454] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.875772 5957 leader_election.cc:302] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.876169 7365 raft_consensus.cc:2781] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.876346 7365 raft_consensus.cc:482] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:13.876457 7365 raft_consensus.cc:3037] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.876580 6272 raft_consensus.cc:2229] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.879877 7365 raft_consensus.cc:504] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.880820 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:13.881387 5955 leader_election.cc:341] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.884694 6272 raft_consensus.cc:2258] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.885560 6273 tablet_bootstrap.cc:654] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.886664 7365 leader_election.cc:288] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.887154 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:13.887416 5879 raft_consensus.cc:3037] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:13.888836 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:13.889856 6272 ts_tablet_manager.cc:1905] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.890115 5879 raft_consensus.cc:2454] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:13.890517 5957 leader_election.cc:302] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.891103 7168 raft_consensus.cc:2781] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:13.891239 7168 raft_consensus.cc:686] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:13.891491 7168 consensus_queue.cc:237] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.895960 6272 ts_tablet_manager.cc:1918] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.896134 6272 log.cc:1196] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/21b4deb353974c8aae4bb8148869758d
I20260928 10:44:13.896494 6272 ts_tablet_manager.cc:1939] T 21b4deb353974c8aae4bb8148869758d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:13.896857 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 880) took 1720 ms. Trace:
I20260928 10:44:13.896973 6272 rpcz_store.cc:276] 0928 10:44:12.176426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.265082 (+ 88656us) service_pool.cc:227] Handling call
0928 10:44:13.820584 (+1555502us) ts_tablet_manager.cc:1145] Deleting tablet 21b4deb353974c8aae4bb8148869758d
0928 10:44:13.820605 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.876891 (+ 56286us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x615000127da4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9086f04d 00007f6f91b135ec 00007f6f944a22e6 00007f6f944d4404 00007f6f944b5870 00007f6f944b55fd 00000000009edb7c 00007f6f8537d344 00007f6f8538091b 00007f6f85380798
0928 10:44:13.892633 (+ 15742us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.895850 (+ 3217us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.896838 (+ 988us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":127951232,"tablet-delete.queue_time_us":1555324}
I20260928 10:44:13.897825 6271 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.897842 6272 tablet_replica.cc:330] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:13.898212 6272 raft_consensus.cc:2229] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.898412 6271 ts_tablet_manager.cc:1397] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.161s user 0.002s sys 0.005s
I20260928 10:44:13.898824 6272 raft_consensus.cc:2258] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.901603 7382 raft_consensus.cc:482] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.901803 7382 raft_consensus.cc:504] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.902516 7382 leader_election.cc:288] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:13.903476 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.904191 5817 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.905587 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:13.906383 7365 raft_consensus.cc:482] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:13.906373 5818 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.906539 5818 leader_election.cc:302] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.906560 7365 raft_consensus.cc:504] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.906804 7382 raft_consensus.cc:2726] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:13.907199 7365 leader_election.cc:288] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.908198 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.908931 5955 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:13.909972 5955 consensus_peers.cc:487] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15931372e469401ab22422677bd90d1f. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:13.912949 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50d66d697f2740a98138a08fc6ef9b60 consensus state has no leader
I20260928 10:44:13.913363 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet b1cdff9f01974354a81179dd9bd5a26e from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:13.915310 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad79320a73b04a18813fbf83fb738b2e consensus state has no leader
I20260928 10:44:13.915619 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 3abfedf425b84f679b22d6ca9bef718a from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:13.917371 6271 raft_consensus.cc:348] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.917966 6271 raft_consensus.cc:374] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.918188 6271 raft_consensus.cc:729] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.918735 6271 consensus_queue.cc:260] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.919027 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9c334bacfa434b9aa29697243bf7364d" } modify_external_catalogs: true
I20260928 10:44:13.919270 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9c334bacfa434b9aa29697243bf7364d" } modify_external_catalogs: true
I20260928 10:44:13.917544 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_91563e9fb1494076938af89a1515a23a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.925889 6272 ts_tablet_manager.cc:1905] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.928537 7365 raft_consensus.cc:482] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:13.928799 7365 raft_consensus.cc:504] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.929534 7365 leader_election.cc:288] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:13.930382 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:13.932401 5955 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.933665 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:13.949039 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91563e9fb1494076938af89a1515a23a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.897588 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 21b4deb353974c8aae4bb8148869758d (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]) successfully deleted
W20260928 10:44:13.949723 5686 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 52168.1us
I20260928 10:44:13.937557 7403 tablet.cc:1722] T 04b947da50894cdba0f49d0738f60187 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:13.952339 6271 ts_tablet_manager.cc:1428] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.053s user 0.003s sys 0.000s
W20260928 10:44:13.953603 6091 consensus_peers.cc:487] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b77c90bc2ecc4fc29a4786152cb977bd. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:13.954711 5882 raft_consensus.cc:2454] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.954752 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:13.955051 5884 raft_consensus.cc:2454] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:13.958528 6271 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:13.962078 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03349ec4f7de48939ac81ed3db60b7b0 consensus state has no leader
I20260928 10:44:13.962575 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ca398b35ea764963925612fa671ebaef" } modify_external_catalogs: true
I20260928 10:44:13.962775 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ca398b35ea764963925612fa671ebaef" } modify_external_catalogs: true
W20260928 10:44:13.963378 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37669fbe13614892a9b8cc2df4e10b4a consensus state has no leader
W20260928 10:44:13.962116 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8bb524f0fc74503903f341d0e567e40 consensus state has no leader
I20260928 10:44:13.964501 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_413facdd66c5442eb11b3bc647d2f82e" } modify_external_catalogs: true
I20260928 10:44:13.964679 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_413facdd66c5442eb11b3bc647d2f82e" } modify_external_catalogs: true
I20260928 10:44:13.966902 6271 tablet_bootstrap.cc:654] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.967904 6270 ts_tablet_manager.cc:1918] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:13.968034 6270 log.cc:1196] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:13.968355 6270 ts_tablet_manager.cc:1939] T dfd9b4092b1242b8a60974c445a2789a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:13.970943 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fdda0fc49458417eaecd5e00951687e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.971030 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 776) took 5546 ms. Trace:
W20260928 10:44:13.971491 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdda0fc49458417eaecd5e00951687e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.972507 6275 tablet_bootstrap.cc:492] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.972643 6275 ts_tablet_manager.cc:1397] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.223s user 0.082s sys 0.054s
I20260928 10:44:13.973245 6275 raft_consensus.cc:348] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.973439 6275 raft_consensus.cc:374] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.973477 6275 raft_consensus.cc:729] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.973659 6275 consensus_queue.cc:260] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:13.974128 6275 ts_tablet_manager.cc:1428] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 10:44:13.974581 6275 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:13.971462 6270 rpcz_store.cc:276] 0928 10:44:08.422676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.424151 (+ 1475us) service_pool.cc:227] Handling call
0928 10:44:13.728976 (+5304825us) ts_tablet_manager.cc:1145] Deleting tablet dfd9b4092b1242b8a60974c445a2789a
0928 10:44:13.728988 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.793879 (+ 64891us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.967785 (+173906us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:13.969049 (+ 1264us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5304531}
I20260928 10:44:13.977717 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet dfd9b4092b1242b8a60974c445a2789a (table default.Table_e690f55d690b46358de9c97d59e9644b [id=1fc32d0deb66442db0f46fe989de0d55]) successfully deleted
I20260928 10:44:13.978222 6270 tablet_replica.cc:330] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:13.978669 6275 tablet_bootstrap.cc:654] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:13.979643 6270 raft_consensus.cc:2229] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:13.980592 6271 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:13.980787 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:13.981540 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_da36fa7394844e8ea5977ef66e6879b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:13.981737 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:13.981606 6271 ts_tablet_manager.cc:1397] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
W20260928 10:44:13.982082 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da36fa7394844e8ea5977ef66e6879b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:13.981969 6270 raft_consensus.cc:2258] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:13.982424 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:13.985419 6270 ts_tablet_manager.cc:1905] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:13.986060 6271 raft_consensus.cc:348] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.987167 6271 raft_consensus.cc:374] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.987517 6271 raft_consensus.cc:729] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.988737 6271 consensus_queue.cc:260] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:13.993462 6275 tablet_bootstrap.cc:492] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:13.993657 6275 ts_tablet_manager.cc:1397] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260928 10:44:13.994040 6271 ts_tablet_manager.cc:1428] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260928 10:44:13.994383 6275 raft_consensus.cc:348] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:13.994652 6275 raft_consensus.cc:374] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:13.994725 6275 raft_consensus.cc:729] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:13.995152 5957 leader_election.cc:302] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:13.995371 6091 consensus_peers.cc:487] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:13.995760 5852 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:13.995507 6271 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:13.996104 5957 leader_election.cc:302] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:13.996328 7168 raft_consensus.cc:2781] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:13.999990 7168 raft_consensus.cc:482] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.000116 7168 raft_consensus.cc:3037] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.001483 7381 raft_consensus.cc:482] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.001645 7381 raft_consensus.cc:504] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.002288 7381 leader_election.cc:288] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.002609 7365 raft_consensus.cc:2781] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.002703 7365 raft_consensus.cc:482] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.002801 7365 raft_consensus.cc:3037] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.002954 7184 raft_consensus.cc:482] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.003086 7184 raft_consensus.cc:504] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.003571 7184 leader_election.cc:288] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.004245 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bbdcc310aed44e3688cf170f1d20ea55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.004956 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbdcc310aed44e3688cf170f1d20ea55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.005326 7365 raft_consensus.cc:504] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.007007 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.007562 7365 leader_election.cc:288] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:14.007962 5817 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.008646 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:14.009218 5955 leader_election.cc:341] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.009750 7168 raft_consensus.cc:504] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.010311 7168 leader_election.cc:288] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.010948 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:14.011314 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:14.011926 5955 leader_election.cc:341] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:13.994918 6275 consensus_queue.cc:260] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.016798 6275 ts_tablet_manager.cc:1428] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260928 10:44:14.018189 6275 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.020924 6271 tablet_bootstrap.cc:654] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.024524 6275 tablet_bootstrap.cc:654] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.030649 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4e02eac28c6d47d3baf8e9d3e27c0cb3" } modify_external_catalogs: true
I20260928 10:44:14.030936 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4e02eac28c6d47d3baf8e9d3e27c0cb3" } modify_external_catalogs: true
I20260928 10:44:14.032445 7184 raft_consensus.cc:482] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.032636 7184 raft_consensus.cc:504] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.033340 7184 leader_election.cc:288] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.034166 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.034895 5817 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.035753 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ef5e35d63c67441396a87acc85e89775"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:14.036168 6271 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.036353 6271 ts_tablet_manager.cc:1397] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.005s
W20260928 10:44:14.036499 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef5e35d63c67441396a87acc85e89775 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.036677 6270 ts_tablet_manager.cc:1918] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:14.036974 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.037082 6270 log.cc:1196] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/362ef9f9aa8641cca11c0a154882e1d4
I20260928 10:44:14.037235 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28efefe228f24b01914e0d43be5061ce" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:14.037469 5884 raft_consensus.cc:3037] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.037657 6271 raft_consensus.cc:348] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.037858 6271 raft_consensus.cc:374] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.037909 6271 raft_consensus.cc:729] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.038511 6270 ts_tablet_manager.cc:1939] T 362ef9f9aa8641cca11c0a154882e1d4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.039441 6275 tablet_bootstrap.cc:492] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.039573 6275 ts_tablet_manager.cc:1397] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260928 10:44:14.039574 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 777) took 5610 ms. Trace:
I20260928 10:44:14.040251 5884 raft_consensus.cc:2454] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.039835 6270 rpcz_store.cc:276] 0928 10:44:08.428927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.428997 (+ 70us) service_pool.cc:227] Handling call
0928 10:44:13.977700 (+5548703us) ts_tablet_manager.cc:1145] Deleting tablet 362ef9f9aa8641cca11c0a154882e1d4
0928 10:44:13.977709 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.021295 (+ 43586us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.036301 (+ 15006us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.039469 (+ 3168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5548393}
I20260928 10:44:14.040292 6275 raft_consensus.cc:348] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.040797 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]) successfully deleted
I20260928 10:44:14.038403 6271 consensus_queue.cc:260] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.041373 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:14.041380 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 797) took 5558 ms. Trace:
I20260928 10:44:14.041630 5884 raft_consensus.cc:3037] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.041638 6270 rpcz_store.cc:276] 0928 10:44:08.482675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.482960 (+ 285us) service_pool.cc:227] Handling call
0928 10:44:14.040864 (+5557904us) ts_tablet_manager.cc:1145] Deleting tablet bc8b8b3a518c42ad9e3c76c9743e361b
0928 10:44:14.040879 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.041277 (+ 398us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5557623}
I20260928 10:44:14.043201 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 798) took 5560 ms. Trace:
W20260928 10:44:14.043829 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bc8b8b3a518c42ad9e3c76c9743e361b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8b8b3a518c42ad9e3c76c9743e361b already in progress: creating tablet
I20260928 10:44:14.043582 6270 rpcz_store.cc:276] 0928 10:44:08.482757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.483166 (+ 409us) service_pool.cc:227] Handling call
0928 10:44:14.042447 (+5559281us) ts_tablet_manager.cc:1145] Deleting tablet c90c3e290377422385a15e23a0e7dd9a
0928 10:44:14.042568 (+ 121us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.043182 (+ 614us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5559130}
I20260928 10:44:14.044903 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 796) took 5562 ms. Trace:
I20260928 10:44:14.045260 6270 rpcz_store.cc:276] 0928 10:44:08.482587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.489292 (+ 6705us) service_pool.cc:227] Handling call
0928 10:44:14.044489 (+5555197us) ts_tablet_manager.cc:1145] Deleting tablet 73c8f859a3ac4a4b89f1bb2929aa3c92
0928 10:44:14.044504 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.044886 (+ 382us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5554932}
I20260928 10:44:14.045847 5884 raft_consensus.cc:2454] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.046711 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 801) took 5561 ms. Trace:
I20260928 10:44:14.047003 6270 rpcz_store.cc:276] 0928 10:44:08.484670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.845976 (+361306us) service_pool.cc:227] Handling call
0928 10:44:14.046200 (+5200224us) ts_tablet_manager.cc:1145] Deleting tablet 9a94c95e55fa46d2a8badd9229f55cf7
0928 10:44:14.046307 (+ 107us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.046609 (+ 302us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199980}
I20260928 10:44:14.047401 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_833e6a9969bb4181a615685d78f21112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.047732 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c90c3e290377422385a15e23a0e7dd9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90c3e290377422385a15e23a0e7dd9a already in progress: creating tablet
W20260928 10:44:14.048035 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 already in progress: creating tablet
W20260928 10:44:14.048250 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9a94c95e55fa46d2a8badd9229f55cf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a94c95e55fa46d2a8badd9229f55cf7 already in progress: creating tablet
I20260928 10:44:14.048394 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 804) took 5485 ms. Trace:
W20260928 10:44:14.048723 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_833e6a9969bb4181a615685d78f21112 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.048558 6270 rpcz_store.cc:276] 0928 10:44:08.562782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.876741 (+313959us) service_pool.cc:227] Handling call
0928 10:44:14.047908 (+5171167us) ts_tablet_manager.cc:1145] Deleting tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d
0928 10:44:14.048010 (+ 102us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.048290 (+ 280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5136812}
W20260928 10:44:14.049427 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d already in progress: creating tablet
I20260928 10:44:14.050343 6270 tablet_replica.cc:330] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.051151 6270 raft_consensus.cc:2229] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.051932 6271 ts_tablet_manager.cc:1428] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260928 10:44:14.040482 6275 raft_consensus.cc:374] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.052079 6275 raft_consensus.cc:729] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.054033 5700 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2a8f515c7efd4d38ae307b74a025bb8c
I20260928 10:44:14.054371 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 9ecd8d56d7a945a0afbd9541048f232b from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:14.055080 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c22c186f038a4468a6683ce26452d411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.055672 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c22c186f038a4468a6683ce26452d411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.058281 6275 consensus_queue.cc:260] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.058755 6271 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.059128 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.059252 5957 leader_election.cc:302] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.059744 7168 raft_consensus.cc:2781] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:14.059827 6275 ts_tablet_manager.cc:1428] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260928 10:44:14.059870 7168 raft_consensus.cc:686] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:14.060099 6275 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.060079 7168 consensus_queue.cc:237] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.063339 6271 tablet_bootstrap.cc:654] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.047318 6272 ts_tablet_manager.cc:1918] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.064822 6272 log.cc:1196] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8b21a965426145c9b678ae80869be833
I20260928 10:44:14.065289 6272 ts_tablet_manager.cc:1939] T 8b21a965426145c9b678ae80869be833 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.065654 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 881) took 1889 ms. Trace:
I20260928 10:44:14.066269 5957 leader_election.cc:302] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.066579 7168 raft_consensus.cc:2781] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:14.066807 7168 raft_consensus.cc:686] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:14.067032 7168 consensus_queue.cc:237] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.068670 6270 raft_consensus.cc:2258] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.072844 6270 ts_tablet_manager.cc:1905] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.072973 6272 rpcz_store.cc:276] 0928 10:44:12.176525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.265273 (+ 88748us) service_pool.cc:227] Handling call
0928 10:44:13.897743 (+1632470us) ts_tablet_manager.cc:1145] Deleting tablet 8b21a965426145c9b678ae80869be833
0928 10:44:13.897781 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.043011 (+145230us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.047213 (+ 4202us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.065636 (+ 18423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632362}
I20260928 10:44:14.073432 6272 tablet_replica.cc:330] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.073565 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8b21a965426145c9b678ae80869be833 (table default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]) successfully deleted
I20260928 10:44:14.073657 6272 raft_consensus.cc:2229] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.074005 6272 raft_consensus.cc:2258] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.064953 6275 tablet_bootstrap.cc:654] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.076097 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.080089 7381 raft_consensus.cc:482] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.081099 6270 ts_tablet_manager.cc:1918] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.082088 6275 tablet_bootstrap.cc:492] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.082249 6275 ts_tablet_manager.cc:1397] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.002s
I20260928 10:44:14.082993 6275 raft_consensus.cc:348] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.084388 6275 raft_consensus.cc:374] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.084478 6275 raft_consensus.cc:729] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.084319 6272 ts_tablet_manager.cc:1905] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.085521 6275 consensus_queue.cc:260] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.086082 6275 ts_tablet_manager.cc:1428] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:44:14.088384 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]). Expected version 1 got 0
I20260928 10:44:14.088722 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]). Expected version 1 got 0
I20260928 10:44:14.088778 6275 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.084290 6271 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.090639 6271 ts_tablet_manager.cc:1397] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260928 10:44:14.090831 6275 tablet_bootstrap.cc:654] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.091354 6271 raft_consensus.cc:348] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.091553 6271 raft_consensus.cc:374] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.091604 6271 raft_consensus.cc:729] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.091802 6271 consensus_queue.cc:260] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.092468 6271 ts_tablet_manager.cc:1428] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:14.092762 6271 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.094079 6271 tablet_bootstrap.cc:654] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.096101 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:14.096444 5699 catalog_manager.cc:5495] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:14.096868 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:14.097117 6270 log.cc:1196] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/15931372e469401ab22422677bd90d1f
I20260928 10:44:14.097249 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:14.097610 6270 ts_tablet_manager.cc:1939] T 15931372e469401ab22422677bd90d1f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.097501 5699 catalog_manager.cc:5495] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:14.097877 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:14.098170 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 817) took 4903 ms. Trace:
I20260928 10:44:14.098187 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:14.098364 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:14.098654 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 593015cc3f8547b5a08043d2c016ec91 (table default.Table_05e9e2f2253945c286361ae7fb235dfe [id=78c21cb16c8e4745b67eb1700a404525]). Expected version 2 got 0
I20260928 10:44:14.098775 6270 rpcz_store.cc:276] 0928 10:44:09.195017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.328947 (+133930us) service_pool.cc:227] Handling call
0928 10:44:14.049822 (+4720875us) ts_tablet_manager.cc:1145] Deleting tablet 15931372e469401ab22422677bd90d1f
0928 10:44:14.050201 (+ 379us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.078272 (+ 28071us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.081006 (+ 2734us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.098152 (+ 17146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4720505}
I20260928 10:44:14.100898 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 6856095617f44c8fa27afc31c794d10d (DEFAULT_TABLE table=default.Table_e86b6b68c6a04f92af21d32ddd66e7c3 [id=a84cb6a934124585ab53f0f694e11b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.101222 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 820) took 4651 ms. Trace:
I20260928 10:44:14.101338 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6856095617f44c8fa27afc31c794d10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.101308 6270 rpcz_store.cc:276] 0928 10:44:09.449848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.449899 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:14.101068 (+4651169us) ts_tablet_manager.cc:1145] Deleting tablet f799021aca384269bfcd67829f3a7db5
0928 10:44:14.101081 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.101204 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4650981}
I20260928 10:44:14.102552 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 819) took 4652 ms. Trace:
I20260928 10:44:14.102630 6270 rpcz_store.cc:276] 0928 10:44:09.449751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.450001 (+ 250us) service_pool.cc:227] Handling call
0928 10:44:14.102392 (+4652391us) ts_tablet_manager.cc:1145] Deleting tablet 85f90d3cbc724e289f525c2a89296ce4
0928 10:44:14.102403 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.102535 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4652194}
I20260928 10:44:14.103790 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 818) took 4654 ms. Trace:
I20260928 10:44:14.103869 6270 rpcz_store.cc:276] 0928 10:44:09.449640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.449914 (+ 274us) service_pool.cc:227] Handling call
0928 10:44:14.103668 (+4653754us) ts_tablet_manager.cc:1145] Deleting tablet cd65a860b00d4a7ba8ae92dde5818212
0928 10:44:14.103679 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.103776 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":42,"tablet-delete.queue_time_us":4653466}
I20260928 10:44:14.105324 6270 tablet_replica.cc:330] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.105528 6270 raft_consensus.cc:2229] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.105675 6270 raft_consensus.cc:2258] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.108137 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd (DEFAULT_TABLE table=default.Table_e7aea1e0968d41238ad1618262f7c374 [id=4a9119c5ef8246ddbd22611592f5534f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.108551 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8092cd377a6548a1bce299cf5ce8f4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.110801 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e (DEFAULT_TABLE table=default.Table_98dc7959ac2f478fa8b34078b11d9adb [id=9f2532190b2440bdb950dbaa199d56ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.111187 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.114639 6976 consensus_queue.cc:1035] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.116202 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f01023aa1540413faac360ea5703e6ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.116850 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01023aa1540413faac360ea5703e6ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.118304 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8cfcbe514c50405d849db4b55a930620" } new_table_name: "default.Table_1e683ae5f18643d0ab62f09323a0b6e2" modify_external_catalogs: true
I20260928 10:44:14.123512 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 15931372e469401ab22422677bd90d1f (table default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]) successfully deleted
W20260928 10:44:14.123881 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f799021aca384269bfcd67829f3a7db5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799021aca384269bfcd67829f3a7db5 already in progress: creating tablet
W20260928 10:44:14.124097 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 85f90d3cbc724e289f525c2a89296ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f90d3cbc724e289f525c2a89296ce4 already in progress: creating tablet
I20260928 10:44:14.124027 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 6856095617f44c8fa27afc31c794d10d (DEFAULT_TABLE table=default.Table_e86b6b68c6a04f92af21d32ddd66e7c3 [id=a84cb6a934124585ab53f0f694e11b34]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:14.124312 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cd65a860b00d4a7ba8ae92dde5818212 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd65a860b00d4a7ba8ae92dde5818212 already in progress: creating tablet
I20260928 10:44:14.124450 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6856095617f44c8fa27afc31c794d10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.125319 7184 raft_consensus.cc:482] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.125506 7382 raft_consensus.cc:482] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.125485 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e (DEFAULT_TABLE table=default.Table_98dc7959ac2f478fa8b34078b11d9adb [id=9f2532190b2440bdb950dbaa199d56ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.125859 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.125931 6269 ts_tablet_manager.cc:1918] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.126083 6273 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:14.127067 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f7e51d1848f14067b414b283f4d0b0f6" } new_table_name: "default.Table_87de69693e544fa080beb3fb2a8999c3" modify_external_catalogs: true
I20260928 10:44:14.128829 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bdd5c076fa3043b8b40005418342a901"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.129514 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdd5c076fa3043b8b40005418342a901 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.129539 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd (DEFAULT_TABLE table=default.Table_e7aea1e0968d41238ad1618262f7c374 [id=4a9119c5ef8246ddbd22611592f5534f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.129941 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8092cd377a6548a1bce299cf5ce8f4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.133728 6136 tablet_service.cc:1467] Processing CreateTablet for tablet fbb9d7d94cda48dca2a4c7e867432ae2 (DEFAULT_TABLE table=default.Table_7e753a6df4ff4d8ab22c7b18b6004f9a [id=5f624e253c324aafaacc893c84333888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.134171 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb9d7d94cda48dca2a4c7e867432ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.134196 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2ef9828d240838217d45c433ff667 (DEFAULT_TABLE table=default.Table_a071f4e45b5c41ab934a5244ae781050 [id=e91731dfad844d72ac171d5145f0185d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.134582 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2ef9828d240838217d45c433ff667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.137718 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 19e0768dea6a40889a3f50b953c0ee4d
I20260928 10:44:14.138170 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 19e0768dea6a40889a3f50b953c0ee4d deleted and replaced by tablet 7b876b30dca04b758f8f540bf86426ef
I20260928 10:44:14.138829 5993 tablet_service.cc:1467] Processing CreateTablet for tablet fbb9d7d94cda48dca2a4c7e867432ae2 (DEFAULT_TABLE table=default.Table_7e753a6df4ff4d8ab22c7b18b6004f9a [id=5f624e253c324aafaacc893c84333888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.139248 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb9d7d94cda48dca2a4c7e867432ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.139271 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d with delete_type TABLET_DATA_DELETED (replaced by tablet 7b876b30dca04b758f8f540bf86426ef) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.139680 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2ef9828d240838217d45c433ff667 (DEFAULT_TABLE table=default.Table_a071f4e45b5c41ab934a5244ae781050 [id=e91731dfad844d72ac171d5145f0185d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.140210 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2ef9828d240838217d45c433ff667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.142673 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d with delete_type TABLET_DATA_DELETED (replaced by tablet 7b876b30dca04b758f8f540bf86426ef) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:14.145383 5817 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.146731 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 581f97bde63a48f0815b61e678890438 (DEFAULT_TABLE table=default.Table_016f3ae69c4441799d03955f4520ab88 [id=7eefddd12c384d519505bb03184afb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.147609 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581f97bde63a48f0815b61e678890438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.147642 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 532d074d8dfb45b2b475ea09fb52c107 (DEFAULT_TABLE table=default.Table_6df2766d782a4f19a05ba2a3f9b69bbf [id=0da4c0d7ca6243a9ac5ea0f1fcf0af2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.147642 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 532d074d8dfb45b2b475ea09fb52c107 (DEFAULT_TABLE table=default.Table_6df2766d782a4f19a05ba2a3f9b69bbf [id=0da4c0d7ca6243a9ac5ea0f1fcf0af2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.147994 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532d074d8dfb45b2b475ea09fb52c107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.147992 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532d074d8dfb45b2b475ea09fb52c107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.151988 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 581f97bde63a48f0815b61e678890438 (DEFAULT_TABLE table=default.Table_016f3ae69c4441799d03955f4520ab88 [id=7eefddd12c384d519505bb03184afb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.152014 7381 raft_consensus.cc:504] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.152424 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581f97bde63a48f0815b61e678890438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.162537 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 6856095617f44c8fa27afc31c794d10d (DEFAULT_TABLE table=default.Table_e86b6b68c6a04f92af21d32ddd66e7c3 [id=a84cb6a934124585ab53f0f694e11b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.164932 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 91337888b5864a2286b9afb7fcba8c98
I20260928 10:44:14.165060 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5eb089481e47455cb7387b0f17eda9fb
I20260928 10:44:14.166529 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cab9bc67c7474cb681566118af1bbf07
I20260928 10:44:14.168535 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 91337888b5864a2286b9afb7fcba8c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.168813 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 04b947da50894cdba0f49d0738f60187 (table default.Table_f320ef807d6b4746a02d578c8d662dc9 [id=4a75e89669ef4e509eb3d9b832262916]). Expected version 2 got 0
I20260928 10:44:14.169018 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet cab9bc67c7474cb681566118af1bbf07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.169018 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:14.169220 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:14.169487 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet dfd9b4092b1242b8a60974c445a2789a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.169935 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.169063 6272 ts_tablet_manager.cc:1918] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.170363 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.170677 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb089481e47455cb7387b0f17eda9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.170428 6272 log.cc:1196] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:14.173938 6272 ts_tablet_manager.cc:1939] T b77c90bc2ecc4fc29a4786152cb977bd P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.176575 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_48eadf82cd0f4428b5673ab0b1643fbc" } new_table_name: "default.Table_fe50ad3f7d3747b493b0adc467e88325" modify_external_catalogs: true
I20260928 10:44:14.177024 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_78b4faac9b3840ad92ad3350a8777a44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.177584 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78b4faac9b3840ad92ad3350a8777a44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.176613 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d9a9b1e53f0424cbd3ac7c00550534f" } new_table_name: "default.Table_5fc5b45674dd41b5a393b263eab27d3f" modify_external_catalogs: true
I20260928 10:44:14.177341 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 882) took 2000 ms. Trace:
I20260928 10:44:14.178810 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ad2135ad3d3e47d38c8f863737165aea" } new_table_name: "default.Table_5fc9a16567af46819d9549748c48d2fd" modify_external_catalogs: true
I20260928 10:44:14.181620 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb089481e47455cb7387b0f17eda9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.181998 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet cab9bc67c7474cb681566118af1bbf07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.182502 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 9afe3c828c9747958a7c558716643007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.178329 6272 rpcz_store.cc:276] 0928 10:44:12.176621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.265385 (+ 88764us) service_pool.cc:227] Handling call
0928 10:44:14.073337 (+1807952us) ts_tablet_manager.cc:1145] Deleting tablet b77c90bc2ecc4fc29a4786152cb977bd
0928 10:44:14.073348 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.115611 (+ 42263us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.168398 (+ 52787us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.177317 (+ 8919us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807853}
I20260928 10:44:14.183775 5991 tablet_service.cc:1467] Processing CreateTablet for tablet b5cb4e02560241abbc6502415e9ebdac (DEFAULT_TABLE table=default.Table_db8191bd52844ecd8c92c336e8d687fa [id=8080f39767724e4aac9821f1eb4846b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.184134 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5cb4e02560241abbc6502415e9ebdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.185209 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 870) took 2142 ms. Trace:
I20260928 10:44:14.185860 6272 rpcz_store.cc:276] 0928 10:44:12.042447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.042566 (+ 119us) service_pool.cc:227] Handling call
0928 10:44:14.184096 (+2141530us) ts_tablet_manager.cc:1145] Deleting tablet 25a2f20766024978a16b6bccd366a848
0928 10:44:14.184107 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.184779 (+ 672us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1918069}
I20260928 10:44:14.187312 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01da441e756d46a991c3b81c3321667a" } modify_external_catalogs: true
I20260928 10:44:14.187508 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01da441e756d46a991c3b81c3321667a" } modify_external_catalogs: true
I20260928 10:44:14.187532 5983 tablet_service.cc:1467] Processing CreateTablet for tablet a6e7c7058f5e4e5c99a323b3374f1474 (DEFAULT_TABLE table=default.Table_54e00eb04a924f518130c405bf7576de [id=68d58857ef52420593ea71f671aaac32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.187902 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e7c7058f5e4e5c99a323b3374f1474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.189657 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 872) took 2113 ms. Trace:
I20260928 10:44:14.190313 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet b77c90bc2ecc4fc29a4786152cb977bd (table default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]) successfully deleted
W20260928 10:44:14.190601 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 25a2f20766024978a16b6bccd366a848 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25a2f20766024978a16b6bccd366a848 already in progress: creating tablet
I20260928 10:44:14.191138 6127 tablet_service.cc:1467] Processing CreateTablet for tablet a6e7c7058f5e4e5c99a323b3374f1474 (DEFAULT_TABLE table=default.Table_54e00eb04a924f518130c405bf7576de [id=68d58857ef52420593ea71f671aaac32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.191466 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e7c7058f5e4e5c99a323b3374f1474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.190191 6272 rpcz_store.cc:276] 0928 10:44:12.075728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.075793 (+ 65us) service_pool.cc:227] Handling call
0928 10:44:14.188381 (+2112588us) ts_tablet_manager.cc:1145] Deleting tablet 46490066d50847ceb2362e35dce84f31
0928 10:44:14.188393 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.189048 (+ 655us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919057}
I20260928 10:44:14.193598 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 876) took 2077 ms. Trace:
I20260928 10:44:14.194211 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_53b45401a11d480983d2e28849b9ec52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.194779 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53b45401a11d480983d2e28849b9ec52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.195030 6119 tablet_service.cc:1467] Processing CreateTablet for tablet b5cb4e02560241abbc6502415e9ebdac (DEFAULT_TABLE table=default.Table_db8191bd52844ecd8c92c336e8d687fa [id=8080f39767724e4aac9821f1eb4846b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.195528 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e7257c8b114e80853ff0a108d2998a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.195173 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet efa178fc1e344069b086003d39f1b848 with delete_type TABLET_DATA_DELETED (replaced by tablet bcecdf79aafe497080e2a1f6256ef6fd) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.195197 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 (DEFAULT_TABLE table=default.Table_30d19d5fb4aa4c15831b572b721e1ce0 [id=0fd917ca852d404fbcac54c6debe1633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.195849 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet db824b43256640e9bfef44da1ccf8e1a with delete_type TABLET_DATA_DELETED (replaced by tablet 877e2d1c734a4e2891119f308f9f3ae8) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.195348 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.196307 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5cb4e02560241abbc6502415e9ebdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.198601 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a2279aa4554a3dbee6f22b18205a47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:14.204236 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 46490066d50847ceb2362e35dce84f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46490066d50847ceb2362e35dce84f31 already in progress: creating tablet
I20260928 10:44:14.205292 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 509f7571433d4a93b806da738e046a68 (DEFAULT_TABLE table=default.Table_d84bf40eb66a46179460ac24c87e2688 [id=97bb7dbb50224a2d95b0da473390ed2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.205703 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509f7571433d4a93b806da738e046a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.205724 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 960181c4f6ae4c3d86d7cd372d2520a1 (DEFAULT_TABLE table=default.Table_80b098cecf5b43acada53ad76023891a [id=18d0b52fc52d4ff6b4949c34975f95ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.206085 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960181c4f6ae4c3d86d7cd372d2520a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.206866 6976 consensus_queue.cc:1035] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.194255 6272 rpcz_store.cc:276] 0928 10:44:12.115743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.115871 (+ 128us) service_pool.cc:227] Handling call
0928 10:44:14.192622 (+2076751us) ts_tablet_manager.cc:1145] Deleting tablet 6bfcdaa9d8bf45c98411cf0e6febd294
0928 10:44:14.192635 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.193300 (+ 665us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921704}
I20260928 10:44:14.209389 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 (DEFAULT_TABLE table=default.Table_30d19d5fb4aa4c15831b572b721e1ce0 [id=0fd917ca852d404fbcac54c6debe1633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.209810 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a2279aa4554a3dbee6f22b18205a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.211551 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 93b4ac29f2ab4deeb61ca2897835d20f (DEFAULT_TABLE table=default.Table_75ed8b29e5124e269ae766667d19c71c [id=89c929a09e474c158b8f84ebce15b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.211627 6124 tablet_service.cc:1467] Processing CreateTablet for tablet c2f0c7eabf66422c82d7201ea72514e3 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.212008 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b4ac29f2ab4deeb61ca2897835d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.212244 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f0c7eabf66422c82d7201ea72514e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.212548 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 98689ee648a84666a783aef0d4601fc2 (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.212885 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98689ee648a84666a783aef0d4601fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.213908 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 509f7571433d4a93b806da738e046a68 (DEFAULT_TABLE table=default.Table_d84bf40eb66a46179460ac24c87e2688 [id=97bb7dbb50224a2d95b0da473390ed2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.214269 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509f7571433d4a93b806da738e046a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.214977 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 9e190bf45c9148d5bfce5bd32210812d (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.215355 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e190bf45c9148d5bfce5bd32210812d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.219154 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 74c881d097724ace9aa499db50c569b0 (DEFAULT_TABLE table=default.Table_892d0c2bd5e241ae9782bea7ba02e421 [id=585bc9efea6d4d23b1872228ca6ed68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.219579 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c881d097724ace9aa499db50c569b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.221062 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 93b4ac29f2ab4deeb61ca2897835d20f (DEFAULT_TABLE table=default.Table_75ed8b29e5124e269ae766667d19c71c [id=89c929a09e474c158b8f84ebce15b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.221442 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b4ac29f2ab4deeb61ca2897835d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.220813 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 877) took 2097 ms. Trace:
I20260928 10:44:14.221797 6272 rpcz_store.cc:276] 0928 10:44:12.123390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.123474 (+ 84us) service_pool.cc:227] Handling call
0928 10:44:14.210291 (+2086817us) ts_tablet_manager.cc:1145] Deleting tablet a3b0ec0cf3bc4a09b0aaa15d18873f70
0928 10:44:14.210304 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.220561 (+ 10257us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939073}
I20260928 10:44:14.226246 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 883) took 1905 ms. Trace:
I20260928 10:44:14.227788 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 98689ee648a84666a783aef0d4601fc2 (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.226940 6272 rpcz_store.cc:276] 0928 10:44:12.320894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.320988 (+ 94us) service_pool.cc:227] Handling call
0928 10:44:14.224755 (+1903767us) ts_tablet_manager.cc:1145] Deleting tablet b257d722a42e44f4ac554b1ebe7d8e31
0928 10:44:14.224987 (+ 232us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.225985 (+ 998us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903461}
I20260928 10:44:14.228255 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98689ee648a84666a783aef0d4601fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.228638 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:14.228739 6272 tablet_replica.cc:330] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.230319 6131 tablet_service.cc:1467] Processing CreateTablet for tablet e49c5428f8674548a309e5cf58c82049 (DEFAULT_TABLE table=default.Table_5d9a9b1e53f0424cbd3ac7c00550534f [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.230094 6272 raft_consensus.cc:2229] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.230417 6135 tablet_service.cc:1467] Processing CreateTablet for tablet bb1742a19f4144eb8ebd30e8cf4b9d37 (DEFAULT_TABLE table=default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.230572 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 91337888b5864a2286b9afb7fcba8c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.230744 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e49c5428f8674548a309e5cf58c82049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.230976 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 35af342381bc4151bf8d8c4817d6be52 (DEFAULT_TABLE table=default.Table_c61910c227dc41cba5ed9d53e9caad2d [id=cfc13cb05d5548b596870a7e5d476130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.231299 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35af342381bc4151bf8d8c4817d6be52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:14.232069 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bfcdaa9d8bf45c98411cf0e6febd294 already in progress: creating tablet
W20260928 10:44:14.232342 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 already in progress: creating tablet
W20260928 10:44:14.232560 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b257d722a42e44f4ac554b1ebe7d8e31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b257d722a42e44f4ac554b1ebe7d8e31 already in progress: creating tablet
I20260928 10:44:14.234899 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2ef9828d240838217d45c433ff667 (DEFAULT_TABLE table=default.Table_a071f4e45b5c41ab934a5244ae781050 [id=e91731dfad844d72ac171d5145f0185d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.235368 7184 raft_consensus.cc:504] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.235641 7382 raft_consensus.cc:504] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.236261 6269 log.cc:1196] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a6b418bbb3364006b097e3a78edf5f55
I20260928 10:44:14.236509 6273 ts_tablet_manager.cc:1397] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.263s user 0.005s sys 0.005s
W20260928 10:44:14.237608 5955 consensus_peers.cc:487] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:14.238282 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 9e190bf45c9148d5bfce5bd32210812d (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.238705 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e190bf45c9148d5bfce5bd32210812d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.232530 6272 raft_consensus.cc:2258] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.234198 6133 tablet_service.cc:1467] Processing CreateTablet for tablet fc75a9ed5996413683ade84861702ad0 (DEFAULT_TABLE table=default.Table_e1a2578af95a49e28e3277e77cc7621b [id=e794ef93366a4c849b7984e450c0486f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.233174 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 960181c4f6ae4c3d86d7cd372d2520a1 (DEFAULT_TABLE table=default.Table_80b098cecf5b43acada53ad76023891a [id=18d0b52fc52d4ff6b4949c34975f95ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.234769 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 5c930ea58cde4785a358d7c4f98dbb0c (DEFAULT_TABLE table=default.Table_9b454e35f83d493eb2b483872f5ad81c [id=e30d3716784947ceb335ad842fc9af67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.243618 5851 tablet_service.cc:1467] Processing CreateTablet for tablet fbb9d7d94cda48dca2a4c7e867432ae2 (DEFAULT_TABLE table=default.Table_7e753a6df4ff4d8ab22c7b18b6004f9a [id=5f624e253c324aafaacc893c84333888]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:14.243978 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 68862.1us
I20260928 10:44:14.245690 5992 tablet_service.cc:1467] Processing CreateTablet for tablet e49c5428f8674548a309e5cf58c82049 (DEFAULT_TABLE table=default.Table_5d9a9b1e53f0424cbd3ac7c00550534f [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.245965 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e (DEFAULT_TABLE table=default.Table_98dc7959ac2f478fa8b34078b11d9adb [id=9f2532190b2440bdb950dbaa199d56ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.246080 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e49c5428f8674548a309e5cf58c82049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.246703 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.247262 6272 ts_tablet_manager.cc:1905] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.250617 7381 leader_election.cc:288] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.250828 7381 raft_consensus.cc:482] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.250979 7381 raft_consensus.cc:504] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.251082 6000 tablet_service.cc:1467] Processing CreateTablet for tablet bb1742a19f4144eb8ebd30e8cf4b9d37 (DEFAULT_TABLE table=default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.251505 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1742a19f4144eb8ebd30e8cf4b9d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.243584 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd (DEFAULT_TABLE table=default.Table_e7aea1e0968d41238ad1618262f7c374 [id=4a9119c5ef8246ddbd22611592f5534f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.255436 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 35af342381bc4151bf8d8c4817d6be52 (DEFAULT_TABLE table=default.Table_c61910c227dc41cba5ed9d53e9caad2d [id=cfc13cb05d5548b596870a7e5d476130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.255860 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35af342381bc4151bf8d8c4817d6be52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.257481 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.246717 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1742a19f4144eb8ebd30e8cf4b9d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.259362 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c930ea58cde4785a358d7c4f98dbb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.263043 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc75a9ed5996413683ade84861702ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.266733 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960181c4f6ae4c3d86d7cd372d2520a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.266904 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.270112 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 5c930ea58cde4785a358d7c4f98dbb0c (DEFAULT_TABLE table=default.Table_9b454e35f83d493eb2b483872f5ad81c [id=e30d3716784947ceb335ad842fc9af67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.270562 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c930ea58cde4785a358d7c4f98dbb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.270949 6272 ts_tablet_manager.cc:1918] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.271265 6272 log.cc:1196] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:14.271912 6272 ts_tablet_manager.cc:1939] T 122fbbe54c174c4ea9cf38698debcb27 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.272460 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 884) took 1941 ms. Trace:
I20260928 10:44:14.272753 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 93b4ac29f2ab4deeb61ca2897835d20f (DEFAULT_TABLE table=default.Table_75ed8b29e5124e269ae766667d19c71c [id=89c929a09e474c158b8f84ebce15b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.272655 6272 rpcz_store.cc:276] 0928 10:44:12.331308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.331366 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:14.228529 (+1897163us) ts_tablet_manager.cc:1145] Deleting tablet 122fbbe54c174c4ea9cf38698debcb27
0928 10:44:14.228543 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.262421 (+ 33878us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.269354 (+ 6933us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.272380 (+ 3026us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1839463}
I20260928 10:44:14.273218 5862 tablet_service.cc:1467] Processing CreateTablet for tablet c2f0c7eabf66422c82d7201ea72514e3 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.273510 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 885) took 1941 ms. Trace:
I20260928 10:44:14.273748 6272 rpcz_store.cc:276] 0928 10:44:12.332106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.337424 (+ 5318us) service_pool.cc:227] Handling call
0928 10:44:14.273244 (+1935820us) ts_tablet_manager.cc:1145] Deleting tablet a6b418bbb3364006b097e3a78edf5f55
0928 10:44:14.273255 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.273399 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874326}
I20260928 10:44:14.274251 6272 tablet_replica.cc:330] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.274588 6272 raft_consensus.cc:2229] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.274760 6002 tablet_service.cc:1467] Processing CreateTablet for tablet fc75a9ed5996413683ade84861702ad0 (DEFAULT_TABLE table=default.Table_e1a2578af95a49e28e3277e77cc7621b [id=e794ef93366a4c849b7984e450c0486f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.274950 6272 raft_consensus.cc:2258] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.275097 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc75a9ed5996413683ade84861702ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.275940 6272 ts_tablet_manager.cc:1905] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.275895 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 509f7571433d4a93b806da738e046a68 (DEFAULT_TABLE table=default.Table_d84bf40eb66a46179460ac24c87e2688 [id=97bb7dbb50224a2d95b0da473390ed2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.276319 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 581f97bde63a48f0815b61e678890438 (DEFAULT_TABLE table=default.Table_016f3ae69c4441799d03955f4520ab88 [id=7eefddd12c384d519505bb03184afb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.276530 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 91337888b5864a2286b9afb7fcba8c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.277304 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 9e190bf45c9148d5bfce5bd32210812d (DEFAULT_TABLE table=default.Table_5036aebd63204ce8ae1e2ce09e507570 [id=5dda50b839ab47a8b1ba324d127aa892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.277494 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb089481e47455cb7387b0f17eda9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.277801 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 74c881d097724ace9aa499db50c569b0 (DEFAULT_TABLE table=default.Table_892d0c2bd5e241ae9782bea7ba02e421 [id=585bc9efea6d4d23b1872228ca6ed68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.277964 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet cab9bc67c7474cb681566118af1bbf07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.278883 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2ef9828d240838217d45c433ff667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.279186 7382 leader_election.cc:288] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.279341 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 74c881d097724ace9aa499db50c569b0 (DEFAULT_TABLE table=default.Table_892d0c2bd5e241ae9782bea7ba02e421 [id=585bc9efea6d4d23b1872228ca6ed68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.279569 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 122fbbe54c174c4ea9cf38698debcb27 (table default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]) successfully deleted
I20260928 10:44:14.279675 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c881d097724ace9aa499db50c569b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:14.279866 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a6b418bbb3364006b097e3a78edf5f55 because the tablet was not found. No further retry: Not found: Tablet not found: a6b418bbb3364006b097e3a78edf5f55
I20260928 10:44:14.280193 5864 tablet_service.cc:1467] Processing CreateTablet for tablet e49c5428f8674548a309e5cf58c82049 (DEFAULT_TABLE table=default.Table_5d9a9b1e53f0424cbd3ac7c00550534f [id=d50909d69f7d4e8cb62569961c640822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.280391 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e0768dea6a40889a3f50b953c0ee4d with delete_type TABLET_DATA_DELETED (replaced by tablet 7b876b30dca04b758f8f540bf86426ef) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.280710 5845 tablet_service.cc:1467] Processing CreateTablet for tablet bb1742a19f4144eb8ebd30e8cf4b9d37 (DEFAULT_TABLE table=default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.280875 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 960181c4f6ae4c3d86d7cd372d2520a1 (DEFAULT_TABLE table=default.Table_80b098cecf5b43acada53ad76023891a [id=18d0b52fc52d4ff6b4949c34975f95ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.281006 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 (DEFAULT_TABLE table=default.Table_30d19d5fb4aa4c15831b572b721e1ce0 [id=0fd917ca852d404fbcac54c6debe1633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.281589 5846 tablet_service.cc:1467] Processing CreateTablet for tablet b5cb4e02560241abbc6502415e9ebdac (DEFAULT_TABLE table=default.Table_db8191bd52844ecd8c92c336e8d687fa [id=8080f39767724e4aac9821f1eb4846b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.282209 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 532d074d8dfb45b2b475ea09fb52c107 (DEFAULT_TABLE table=default.Table_6df2766d782a4f19a05ba2a3f9b69bbf [id=0da4c0d7ca6243a9ac5ea0f1fcf0af2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.282393 7381 leader_election.cc:288] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.282768 5984 tablet_service.cc:1467] Processing CreateTablet for tablet c2f0c7eabf66422c82d7201ea72514e3 (DEFAULT_TABLE table=default.Table_96735822e535485388cefe7e10d7c0d4 [id=2895ba4915d241318b79631194c22cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.282895 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 35af342381bc4151bf8d8c4817d6be52 (DEFAULT_TABLE table=default.Table_c61910c227dc41cba5ed9d53e9caad2d [id=cfc13cb05d5548b596870a7e5d476130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.283123 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f0c7eabf66422c82d7201ea72514e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.283553 6273 raft_consensus.cc:348] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.283728 6272 ts_tablet_manager.cc:1918] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.283882 6272 log.cc:1196] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:14.284200 6272 ts_tablet_manager.cc:1939] T 5f42d5aef2424b3aacc8564d98cd3b67 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.284328 6976 consensus_queue.cc:1035] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.284559 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 886) took 1718 ms. Trace:
I20260928 10:44:14.284696 6272 rpcz_store.cc:276] 0928 10:44:12.566555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.566610 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:14.274133 (+1707523us) ts_tablet_manager.cc:1145] Deleting tablet 5f42d5aef2424b3aacc8564d98cd3b67
0928 10:44:14.274143 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.280623 (+ 6480us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.283606 (+ 2983us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.284518 (+ 912us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1707095}
I20260928 10:44:14.285144 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 887) took 1403 ms. Trace:
I20260928 10:44:14.285207 6273 raft_consensus.cc:374] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.285313 6273 raft_consensus.cc:729] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.285409 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 5f42d5aef2424b3aacc8564d98cd3b67 (table default.Table_868c82ae2401426fae6d2aea18ca318b [id=7d91230c80fd4951adc2206362b423ec]) successfully deleted
I20260928 10:44:14.285969 6273 consensus_queue.cc:260] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.286026 6272 rpcz_store.cc:276] 0928 10:44:12.882122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.882540 (+ 418us) service_pool.cc:227] Handling call
0928 10:44:14.285020 (+1402480us) ts_tablet_manager.cc:1145] Deleting tablet daf7a87b82424e25ae47d3f61c2ddb7f
0928 10:44:14.285029 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.285113 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317000}
I20260928 10:44:14.286417 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 888) took 1393 ms. Trace:
I20260928 10:44:14.286607 6273 ts_tablet_manager.cc:1428] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.050s user 0.001s sys 0.001s
I20260928 10:44:14.286804 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb9d7d94cda48dca2a4c7e867432ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.286759 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 98689ee648a84666a783aef0d4601fc2 (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:14.292573 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet daf7a87b82424e25ae47d3f61c2ddb7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daf7a87b82424e25ae47d3f61c2ddb7f already in progress: creating tablet
I20260928 10:44:14.292887 6272 rpcz_store.cc:276] 0928 10:44:12.893237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.893291 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:14.286304 (+1393013us) ts_tablet_manager.cc:1145] Deleting tablet a36ae00e0f664d4da444a6a4a17bcbca
0928 10:44:14.286314 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.286390 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1315686}
I20260928 10:44:14.293336 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 889) took 1360 ms. Trace:
W20260928 10:44:14.293749 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a36ae00e0f664d4da444a6a4a17bcbca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ae00e0f664d4da444a6a4a17bcbca already in progress: creating tablet
I20260928 10:44:14.293968 6272 rpcz_store.cc:276] 0928 10:44:12.932863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.932924 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:14.293201 (+1360277us) ts_tablet_manager.cc:1145] Deleting tablet 8b167fd6cdbd4b829d962ebafeee0272
0928 10:44:14.293213 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.293306 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321657}
I20260928 10:44:14.294271 6272 tablet_replica.cc:330] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.294513 7184 leader_election.cc:288] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:14.294556 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8b167fd6cdbd4b829d962ebafeee0272 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b167fd6cdbd4b829d962ebafeee0272 already in progress: creating tablet
I20260928 10:44:14.294960 6272 raft_consensus.cc:2229] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.295173 6272 raft_consensus.cc:2258] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.295811 6272 ts_tablet_manager.cc:1905] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:14.297004 5817 leader_election.cc:341] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:14.297454 5817 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:14.297616 5817 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.297719 5849 tablet_service.cc:1467] Processing CreateTablet for tablet a6e7c7058f5e4e5c99a323b3374f1474 (DEFAULT_TABLE table=default.Table_54e00eb04a924f518130c405bf7576de [id=68d58857ef52420593ea71f671aaac32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.299027 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b1c01a1e4d54fcfb2f1ca9ba862848e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.302618 6272 ts_tablet_manager.cc:1918] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.302934 6272 log.cc:1196] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:14.303361 6272 ts_tablet_manager.cc:1939] T 440a50034c6b4110b74b1531a6b7790d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.305418 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8092cd377a6548a1bce299cf5ce8f4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.306507 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b4ac29f2ab4deeb61ca2897835d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.311664 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509f7571433d4a93b806da738e046a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.312150 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f0c7eabf66422c82d7201ea72514e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.313817 6275 tablet_bootstrap.cc:492] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.313958 6275 ts_tablet_manager.cc:1397] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.225s user 0.004s sys 0.002s
I20260928 10:44:14.314710 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6856095617f44c8fa27afc31c794d10d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.314658 6275 raft_consensus.cc:348] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.314893 6275 raft_consensus.cc:374] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.314941 6275 raft_consensus.cc:729] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.315167 6275 consensus_queue.cc:260] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.315696 6275 ts_tablet_manager.cc:1428] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:14.316006 6275 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.317376 6275 tablet_bootstrap.cc:654] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.319483 6273 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:14.320210 6976 raft_consensus.cc:482] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.320366 6976 raft_consensus.cc:504] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.321013 6976 leader_election.cc:288] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.106205 6270 ts_tablet_manager.cc:1905] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.323534 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 440a50034c6b4110b74b1531a6b7790d (table default.Table_dadadc27cb47481fac861cc24bd236c0 [id=9f353ac79b55463da1daedc2523f6cd1]) successfully deleted
I20260928 10:44:14.324658 6275 tablet_bootstrap.cc:492] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.324844 6275 ts_tablet_manager.cc:1397] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260928 10:44:14.325759 6275 raft_consensus.cc:348] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.325989 6275 raft_consensus.cc:374] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.326061 6275 raft_consensus.cc:729] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.326740 6275 consensus_queue.cc:260] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.327527 6275 ts_tablet_manager.cc:1428] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:14.327850 6275 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.329771 6272 tablet_replica.cc:330] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.330000 6272 raft_consensus.cc:2229] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.330755 6272 pending_rounds.cc:62] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.330842 6272 pending_rounds.cc:68] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868317294592 op_type: NO_OP noop_request { }
I20260928 10:44:14.331039 6272 raft_consensus.cc:2866] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.331172 6272 raft_consensus.cc:2258] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.331907 6272 ts_tablet_manager.cc:1905] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.337065 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e49c5428f8674548a309e5cf58c82049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.330508 6275 tablet_bootstrap.cc:654] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.338779 6271 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.338932 6271 ts_tablet_manager.cc:1397] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.246s user 0.003s sys 0.002s
I20260928 10:44:14.339619 6271 raft_consensus.cc:348] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.339846 6271 raft_consensus.cc:374] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.339890 6271 raft_consensus.cc:729] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.340080 6271 consensus_queue.cc:260] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.340183 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 5c930ea58cde4785a358d7c4f98dbb0c (DEFAULT_TABLE table=default.Table_9b454e35f83d493eb2b483872f5ad81c [id=e30d3716784947ceb335ad842fc9af67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.340386 6270 ts_tablet_manager.cc:1918] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.340481 6270 log.cc:1196] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/98bd99e7bdb647ceb9357f88affc45d9
I20260928 10:44:14.340592 6271 ts_tablet_manager.cc:1428] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:14.340802 6270 ts_tablet_manager.cc:1939] T 98bd99e7bdb647ceb9357f88affc45d9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.340858 6271 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.341089 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 827) took 4494 ms. Trace:
I20260928 10:44:14.341171 6270 rpcz_store.cc:276] 0928 10:44:09.846456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.847851 (+ 1395us) service_pool.cc:227] Handling call
0928 10:44:14.105284 (+4257433us) ts_tablet_manager.cc:1145] Deleting tablet 98bd99e7bdb647ceb9357f88affc45d9
0928 10:44:14.105293 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.326257 (+220964us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.340280 (+ 14023us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.341071 (+ 791us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4257215}
I20260928 10:44:14.341492 6270 tablet_replica.cc:330] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.341684 6270 raft_consensus.cc:2229] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.341842 6270 raft_consensus.cc:2258] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.342247 6271 tablet_bootstrap.cc:654] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.342381 6270 ts_tablet_manager.cc:1905] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.343770 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98689ee648a84666a783aef0d4601fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.344007 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c881d097724ace9aa499db50c569b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.346674 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960181c4f6ae4c3d86d7cd372d2520a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.346985 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581f97bde63a48f0815b61e678890438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.347740 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1742a19f4144eb8ebd30e8cf4b9d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.349980 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e190bf45c9148d5bfce5bd32210812d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.350705 6270 ts_tablet_manager.cc:1918] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.350867 6270 log.cc:1196] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/82b3afe074194023ba788094a2a6b81c
I20260928 10:44:14.350867 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e7c7058f5e4e5c99a323b3374f1474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.351231 6270 ts_tablet_manager.cc:1939] T 82b3afe074194023ba788094a2a6b81c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.351719 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 825) took 4505 ms. Trace:
I20260928 10:44:14.351842 6270 rpcz_store.cc:276] 0928 10:44:09.846314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.848108 (+ 1794us) service_pool.cc:227] Handling call
0928 10:44:14.341449 (+4493341us) ts_tablet_manager.cc:1145] Deleting tablet 82b3afe074194023ba788094a2a6b81c
0928 10:44:14.341461 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.345265 (+ 3804us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.350601 (+ 5336us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.351698 (+ 1097us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4493220}
I20260928 10:44:14.352233 6270 tablet_replica.cc:330] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.352440 6270 raft_consensus.cc:2229] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.353076 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c930ea58cde4785a358d7c4f98dbb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.353297 6270 raft_consensus.cc:2258] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.353880 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5cb4e02560241abbc6502415e9ebdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.353942 6270 ts_tablet_manager.cc:1905] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.357424 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a2279aa4554a3dbee6f22b18205a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.358907 6271 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.359032 6271 ts_tablet_manager.cc:1397] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20260928 10:44:14.359668 6271 raft_consensus.cc:348] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.359890 6271 raft_consensus.cc:374] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.359936 6271 raft_consensus.cc:729] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.360152 6271 consensus_queue.cc:260] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.360466 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35af342381bc4151bf8d8c4817d6be52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.360790 6271 ts_tablet_manager.cc:1428] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:14.361032 6271 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.362322 6271 tablet_bootstrap.cc:654] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.363481 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532d074d8dfb45b2b475ea09fb52c107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:14.359681 6270 ts_tablet_manager.cc:1918] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.364512 6270 log.cc:1196] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/ecb1d807c9f04fe4b02e3343f0c6511c
I20260928 10:44:14.364820 6270 ts_tablet_manager.cc:1939] T ecb1d807c9f04fe4b02e3343f0c6511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.365097 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 826) took 4518 ms. Trace:
I20260928 10:44:14.365166 6270 rpcz_store.cc:276] 0928 10:44:09.846379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.848247 (+ 1868us) service_pool.cc:227] Handling call
0928 10:44:14.352167 (+4503920us) ts_tablet_manager.cc:1145] Deleting tablet ecb1d807c9f04fe4b02e3343f0c6511c
0928 10:44:14.352179 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.356872 (+ 4693us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.359606 (+ 2734us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.365081 (+ 5475us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4503766}
I20260928 10:44:14.365556 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 830) took 4455 ms. Trace:
I20260928 10:44:14.365619 6270 rpcz_store.cc:276] 0928 10:44:09.910404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.910464 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:14.365432 (+4454968us) ts_tablet_manager.cc:1145] Deleting tablet 01bd3593f7ac421cbed8ac5797e068fa
0928 10:44:14.365441 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.365545 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4454692}
I20260928 10:44:14.365864 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 829) took 4455 ms. Trace:
I20260928 10:44:14.365922 6270 rpcz_store.cc:276] 0928 10:44:09.910329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.910810 (+ 481us) service_pool.cc:227] Handling call
0928 10:44:14.365789 (+4454979us) ts_tablet_manager.cc:1145] Deleting tablet 51df1f1107e14996bb1b4787819de64f
0928 10:44:14.365797 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.365854 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4454803}
I20260928 10:44:14.366173 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 828) took 4456 ms. Trace:
I20260928 10:44:14.366287 6270 rpcz_store.cc:276] 0928 10:44:09.910236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.911222 (+ 986us) service_pool.cc:227] Handling call
0928 10:44:14.366084 (+4454862us) ts_tablet_manager.cc:1145] Deleting tablet 2a359f1585924866be13588125db2dc4
0928 10:44:14.366092 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.366160 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4454702}
I20260928 10:44:14.366621 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 831) took 4391 ms. Trace:
I20260928 10:44:14.366717 6270 rpcz_store.cc:276] 0928 10:44:09.975066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.975745 (+ 679us) service_pool.cc:227] Handling call
0928 10:44:14.366522 (+4390777us) ts_tablet_manager.cc:1145] Deleting tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670
0928 10:44:14.366530 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.366604 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390515}
I20260928 10:44:14.367035 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 832) took 4390 ms. Trace:
I20260928 10:44:14.367129 6270 rpcz_store.cc:276] 0928 10:44:09.976135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.976448 (+ 313us) service_pool.cc:227] Handling call
0928 10:44:14.366940 (+4390492us) ts_tablet_manager.cc:1145] Deleting tablet 3e15b3cc46734ed5b8f0aef2f50025dd
0928 10:44:14.366949 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.367021 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390328}
I20260928 10:44:14.367349 6275 tablet_bootstrap.cc:492] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.367448 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 833) took 4316 ms. Trace:
I20260928 10:44:14.367509 6275 ts_tablet_manager.cc:1397] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.005s
I20260928 10:44:14.367532 6270 rpcz_store.cc:276] 0928 10:44:10.051302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.051364 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:14.367356 (+4315992us) ts_tablet_manager.cc:1145] Deleting tablet 9956318fe8ef4d1cbc92eda9caa98602
0928 10:44:14.367365 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.367435 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4315709}
I20260928 10:44:14.367830 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 845) took 3740 ms. Trace:
I20260928 10:44:14.367928 6270 rpcz_store.cc:276] 0928 10:44:10.627419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.627609 (+ 190us) service_pool.cc:227] Handling call
0928 10:44:14.367742 (+3740133us) ts_tablet_manager.cc:1145] Deleting tablet 349d67ee0d3840ef813f241ac13968fe
0928 10:44:14.367751 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.367817 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3739890}
I20260928 10:44:14.368233 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 847) took 3739 ms. Trace:
I20260928 10:44:14.368330 6270 rpcz_store.cc:276] 0928 10:44:10.629200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.629329 (+ 129us) service_pool.cc:227] Handling call
0928 10:44:14.368134 (+3738805us) ts_tablet_manager.cc:1145] Deleting tablet 733ac3eb76f74468a4811c5d642d53f0
0928 10:44:14.368143 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.368208 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3738606}
I20260928 10:44:14.368270 6275 raft_consensus.cc:348] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.368472 6275 raft_consensus.cc:374] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.368548 6275 raft_consensus.cc:729] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.368643 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 846) took 3739 ms. Trace:
I20260928 10:44:14.368723 6270 rpcz_store.cc:276] 0928 10:44:10.629086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.629645 (+ 559us) service_pool.cc:227] Handling call
0928 10:44:14.368550 (+3738905us) ts_tablet_manager.cc:1145] Deleting tablet 9ecd8d56d7a945a0afbd9541048f232b
0928 10:44:14.368559 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.368629 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3738773}
I20260928 10:44:14.368821 6275 consensus_queue.cc:260] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.368961 6270 tablet_replica.cc:330] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.369156 6270 raft_consensus.cc:2229] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.369351 6270 raft_consensus.cc:2258] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.369485 6275 ts_tablet_manager.cc:1428] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:14.369913 6270 ts_tablet_manager.cc:1905] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.369987 6275 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.373968 6275 tablet_bootstrap.cc:654] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.375538 6270 ts_tablet_manager.cc:1918] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.375675 6270 log.cc:1196] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/bd225da0b4b445c6ac03634d975e8396
I20260928 10:44:14.376004 6270 ts_tablet_manager.cc:1939] T bd225da0b4b445c6ac03634d975e8396 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.375538 6272 ts_tablet_manager.cc:1918] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.376098 6272 log.cc:1196] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:14.376334 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 849) took 3735 ms. Trace:
I20260928 10:44:14.376461 6273 tablet_bootstrap.cc:654] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.376498 6272 ts_tablet_manager.cc:1939] T 4a973a1d20e3437c87ad889c723e7ebc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.376437 6270 rpcz_store.cc:276] 0928 10:44:10.640859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.641074 (+ 215us) service_pool.cc:227] Handling call
0928 10:44:14.368925 (+3727851us) ts_tablet_manager.cc:1145] Deleting tablet bd225da0b4b445c6ac03634d975e8396
0928 10:44:14.368934 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.372763 (+ 3829us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.375468 (+ 2705us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.376318 (+ 850us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3727653}
I20260928 10:44:14.376765 6270 tablet_replica.cc:330] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.376962 6270 raft_consensus.cc:2229] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.377139 6270 raft_consensus.cc:2258] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.377110 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4a973a1d20e3437c87ad889c723e7ebc (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
I20260928 10:44:14.377653 6270 ts_tablet_manager.cc:1905] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:14.378103 5955 consensus_peers.cc:487] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:14.378326 6271 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.378439 6271 ts_tablet_manager.cc:1397] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260928 10:44:14.379107 6271 raft_consensus.cc:348] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.379426 6271 raft_consensus.cc:374] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.379518 6271 raft_consensus.cc:729] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.379523 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.379722 6271 consensus_queue.cc:260] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:14.380033 5817 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.380410 6271 ts_tablet_manager.cc:1428] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:14.380738 6271 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.381990 6271 tablet_bootstrap.cc:654] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.382262 6272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 905) took 1002 ms. Trace:
I20260928 10:44:14.384379 5862 tablet_service.cc:1467] Processing CreateTablet for tablet fc75a9ed5996413683ade84861702ad0 (DEFAULT_TABLE table=default.Table_e1a2578af95a49e28e3277e77cc7621b [id=e794ef93366a4c849b7984e450c0486f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:14.384358 6272 rpcz_store.cc:276] 0928 10:44:13.379892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.463865 (+ 83973us) service_pool.cc:227] Handling call
0928 10:44:14.382149 (+918284us) ts_tablet_manager.cc:1145] Deleting tablet 1c7131f9259a404382e86ad06c52b584
0928 10:44:14.382160 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.382245 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":889460}
I20260928 10:44:14.384742 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc75a9ed5996413683ade84861702ad0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:14.384836 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1c7131f9259a404382e86ad06c52b584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c7131f9259a404382e86ad06c52b584 already in progress: creating tablet
W20260928 10:44:14.385104 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b1cdff9f01974354a81179dd9bd5a26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1cdff9f01974354a81179dd9bd5a26e already in progress: creating tablet
I20260928 10:44:14.382911 6270 ts_tablet_manager.cc:1918] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.385293 6270 log.cc:1196] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8b21a965426145c9b678ae80869be833
I20260928 10:44:14.385605 6270 ts_tablet_manager.cc:1939] T 8b21a965426145c9b678ae80869be833 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:14.385823 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d1b89a8edd5645afa41693f5bca42f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1b89a8edd5645afa41693f5bca42f8d already in progress: creating tablet
I20260928 10:44:14.385875 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 850) took 3744 ms. Trace:
I20260928 10:44:14.385941 6270 rpcz_store.cc:276] 0928 10:44:10.641018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.641311 (+ 293us) service_pool.cc:227] Handling call
0928 10:44:14.376726 (+3735415us) ts_tablet_manager.cc:1145] Deleting tablet 8b21a965426145c9b678ae80869be833
0928 10:44:14.376735 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.380282 (+ 3547us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.382842 (+ 2560us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.385861 (+ 3019us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3735270}
I20260928 10:44:14.386188 6270 tablet_replica.cc:330] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:14.386335 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f7d762e03b384d85b4e04be8331474a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7d762e03b384d85b4e04be8331474a4 already in progress: creating tablet
I20260928 10:44:14.386372 6270 raft_consensus.cc:2229] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.386540 6270 raft_consensus.cc:2258] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:14.386894 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c2af1c83c4544bc68c67f7002742b2cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2af1c83c4544bc68c67f7002742b2cd already in progress: creating tablet
I20260928 10:44:14.387132 6270 ts_tablet_manager.cc:1905] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:14.387719 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet de99da54941a4eaf9107f4b2efca5c7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de99da54941a4eaf9107f4b2efca5c7b already in progress: creating tablet
W20260928 10:44:14.388545 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ecb1d807c9f04fe4b02e3343f0c6511c because the tablet was not found. No further retry: Not found: Tablet not found: ecb1d807c9f04fe4b02e3343f0c6511c
W20260928 10:44:14.390023 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 23d4da5ccb214a4bbc543c67529b59cf because the tablet was not found. No further retry: Not found: Tablet not found: 23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:14.390689 6272 tablet_replica.cc:330] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:14.391162 5818 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.391216 6272 raft_consensus.cc:2229] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.391372 6272 pending_rounds.cc:62] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.391362 5818 leader_election.cc:302] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.391419 6272 pending_rounds.cc:68] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868310765568 op_type: NO_OP noop_request { }
I20260928 10:44:14.391527 6272 raft_consensus.cc:2866] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.391610 6272 raft_consensus.cc:2258] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.391773 7381 raft_consensus.cc:2726] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.392099 6272 ts_tablet_manager.cc:1905] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:14.392130 5818 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.392325 5818 leader_election.cc:302] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.392531 7381 raft_consensus.cc:2726] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.392647 6270 ts_tablet_manager.cc:1918] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.392763 6270 log.cc:1196] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/104a223ec6ef47988d0aa3335a1f81de
W20260928 10:44:14.392982 5818 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.393097 6270 ts_tablet_manager.cc:1939] T 104a223ec6ef47988d0aa3335a1f81de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.393121 5818 leader_election.cc:302] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.393417 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 851) took 3675 ms. Trace:
I20260928 10:44:14.393529 6270 rpcz_store.cc:276] 0928 10:44:10.717674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.717724 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:14.386155 (+3668431us) ts_tablet_manager.cc:1145] Deleting tablet 104a223ec6ef47988d0aa3335a1f81de
0928 10:44:14.386163 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.389996 (+ 3833us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.392576 (+ 2580us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.393403 (+ 827us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3668246}
I20260928 10:44:14.393888 6270 tablet_replica.cc:330] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.394085 6270 raft_consensus.cc:2229] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.394287 6270 raft_consensus.cc:2258] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.394831 6270 ts_tablet_manager.cc:1905] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.400537 6270 ts_tablet_manager.cc:1918] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.400753 6270 log.cc:1196] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/23d4da5ccb214a4bbc543c67529b59cf
I20260928 10:44:14.401168 6270 ts_tablet_manager.cc:1939] T 23d4da5ccb214a4bbc543c67529b59cf P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.401551 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 852) took 3683 ms. Trace:
I20260928 10:44:14.401692 6270 rpcz_store.cc:276] 0928 10:44:10.718406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.718451 (+ 45us) service_pool.cc:227] Handling call
0928 10:44:14.393850 (+3675399us) ts_tablet_manager.cc:1145] Deleting tablet 23d4da5ccb214a4bbc543c67529b59cf
0928 10:44:14.393860 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.397605 (+ 3745us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.400448 (+ 2843us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.401532 (+ 1084us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3675208}
I20260928 10:44:14.402100 6270 tablet_replica.cc:330] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.402338 6270 raft_consensus.cc:2229] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.402575 6270 raft_consensus.cc:2258] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.403483 6270 ts_tablet_manager.cc:1905] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.403728 6271 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.403877 6271 ts_tablet_manager.cc:1397] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.004s
I20260928 10:44:14.405061 7381 raft_consensus.cc:482] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.406863 7381 raft_consensus.cc:504] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.407483 7381 leader_election.cc:288] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.408370 7381 raft_consensus.cc:2726] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.408670 7348 raft_consensus.cc:482] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.408802 7348 raft_consensus.cc:504] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.409312 6270 ts_tablet_manager.cc:1918] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.409386 7348 leader_election.cc:288] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.409415 6270 log.cc:1196] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/21b4deb353974c8aae4bb8148869758d
I20260928 10:44:14.409737 6270 ts_tablet_manager.cc:1939] T 21b4deb353974c8aae4bb8148869758d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.410094 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 853) took 3690 ms. Trace:
I20260928 10:44:14.410279 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.410238 6270 rpcz_store.cc:276] 0928 10:44:10.719170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.719330 (+ 160us) service_pool.cc:227] Handling call
0928 10:44:14.402056 (+3682726us) ts_tablet_manager.cc:1145] Deleting tablet 21b4deb353974c8aae4bb8148869758d
0928 10:44:14.402068 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.406471 (+ 4403us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.409223 (+ 2752us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.410077 (+ 854us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3682572}
W20260928 10:44:14.410462 6091 consensus_peers.cc:487] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a25c7f3b94e94cafb3275a2e190be0ed. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:14.410764 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 855) took 3352 ms. Trace:
W20260928 10:44:14.410787 5955 consensus_peers.cc:487] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:14.411027 5955 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.411204 6270 rpcz_store.cc:276] 0928 10:44:11.057960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.061687 (+ 3727us) service_pool.cc:227] Handling call
0928 10:44:14.410651 (+3348964us) ts_tablet_manager.cc:1145] Deleting tablet 917513e857de49a7a57416eca237f70b
0928 10:44:14.410662 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.410748 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3326695}
W20260928 10:44:14.411312 6091 consensus_peers.cc:487] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e05cdd590894adcb987ef3ac78bf416. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:14.411612 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 854) took 3354 ms. Trace:
I20260928 10:44:14.411716 6270 rpcz_store.cc:276] 0928 10:44:11.057453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.085573 (+ 28120us) service_pool.cc:227] Handling call
0928 10:44:14.411517 (+3325944us) ts_tablet_manager.cc:1145] Deleting tablet be50535c36a54453b2a1a6d6d09207eb
0928 10:44:14.411527 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.411598 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3325684}
I20260928 10:44:14.412071 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.412267 6021 raft_consensus.cc:2454] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:14.412366 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.412738 6270 tablet_replica.cc:330] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.412796 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.413385 5817 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.411180 6271 raft_consensus.cc:348] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.414186 6271 raft_consensus.cc:374] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.414258 6271 raft_consensus.cc:729] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.414525 6271 consensus_queue.cc:260] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.415174 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 98bd99e7bdb647ceb9357f88affc45d9 (table default.Table_9420102eb4994caea7a11294bebbebd0 [id=d47f757b2fab48be9a9d94e97f1ff72a]) successfully deleted
I20260928 10:44:14.415444 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 82b3afe074194023ba788094a2a6b81c (table default.Table_922ff47b37674ce099a7cab4c39b7167 [id=3eb8d737f4b444c09db5707afb70265b]) successfully deleted
I20260928 10:44:14.415624 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet ecb1d807c9f04fe4b02e3343f0c6511c (table default.Table_2599faf42aa64d3e85b31db48c5b2644 [id=61ff49fcb43c4d0e94532e49a70e21b2]) successfully deleted
W20260928 10:44:14.415827 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 01bd3593f7ac421cbed8ac5797e068fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01bd3593f7ac421cbed8ac5797e068fa already in progress: creating tablet
W20260928 10:44:14.416033 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 51df1f1107e14996bb1b4787819de64f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51df1f1107e14996bb1b4787819de64f already in progress: creating tablet
W20260928 10:44:14.416251 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2a359f1585924866be13588125db2dc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a359f1585924866be13588125db2dc4 already in progress: creating tablet
W20260928 10:44:14.416462 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 already in progress: creating tablet
W20260928 10:44:14.416676 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3e15b3cc46734ed5b8f0aef2f50025dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e15b3cc46734ed5b8f0aef2f50025dd already in progress: creating tablet
I20260928 10:44:14.416703 6275 tablet_bootstrap.cc:492] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:14.416864 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9956318fe8ef4d1cbc92eda9caa98602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9956318fe8ef4d1cbc92eda9caa98602 already in progress: creating tablet
I20260928 10:44:14.416919 6275 ts_tablet_manager.cc:1397] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.004s
W20260928 10:44:14.417065 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 349d67ee0d3840ef813f241ac13968fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349d67ee0d3840ef813f241ac13968fe already in progress: creating tablet
W20260928 10:44:14.417268 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 733ac3eb76f74468a4811c5d642d53f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ac3eb76f74468a4811c5d642d53f0 already in progress: creating tablet
W20260928 10:44:14.417469 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9ecd8d56d7a945a0afbd9541048f232b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ecd8d56d7a945a0afbd9541048f232b already in progress: creating tablet
I20260928 10:44:14.417636 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet bd225da0b4b445c6ac03634d975e8396 (table default.Table_91702b0277c943068af0c1f3ac3b6604 [id=bfaed7f145e140f8af46bbc2f85f2e7c]) successfully deleted
I20260928 10:44:14.417830 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8b21a965426145c9b678ae80869be833 (table default.Table_8a22814f9f7c4a3aa9bc76471f973c53 [id=4a7ab0168fd648d8bb4fa4001ad76f1c]) successfully deleted
I20260928 10:44:14.418004 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 104a223ec6ef47988d0aa3335a1f81de (table default.Table_a98c668a7dea48138cdba63f65364fe8 [id=87c3591cdbf34ccc8c10269033b20843]) successfully deleted
I20260928 10:44:14.418187 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 23d4da5ccb214a4bbc543c67529b59cf (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]) successfully deleted
I20260928 10:44:14.418166 6275 raft_consensus.cc:348] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.418407 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 21b4deb353974c8aae4bb8148869758d (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]) successfully deleted
I20260928 10:44:14.418609 6275 raft_consensus.cc:374] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:14.418648 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 917513e857de49a7a57416eca237f70b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917513e857de49a7a57416eca237f70b already in progress: creating tablet
I20260928 10:44:14.418771 6275 raft_consensus.cc:729] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:14.418889 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet be50535c36a54453b2a1a6d6d09207eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be50535c36a54453b2a1a6d6d09207eb already in progress: creating tablet
I20260928 10:44:14.419091 6275 consensus_queue.cc:260] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.419616 6275 ts_tablet_manager.cc:1428] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:14.419857 6275 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.421089 6275 tablet_bootstrap.cc:654] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.421911 6271 ts_tablet_manager.cc:1428] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 10:44:14.422247 6271 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.423811 6271 tablet_bootstrap.cc:654] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.429626 6275 tablet_bootstrap.cc:492] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.429939 6275 ts_tablet_manager.cc:1397] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20260928 10:44:14.430855 6275 raft_consensus.cc:348] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.431126 6275 raft_consensus.cc:374] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.431177 6275 raft_consensus.cc:729] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.431855 6272 ts_tablet_manager.cc:1918] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.432049 6272 log.cc:1196] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/54b78fbf508f4e47bd31661e05dcaa16
I20260928 10:44:14.432610 6272 ts_tablet_manager.cc:1939] T 54b78fbf508f4e47bd31661e05dcaa16 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.433142 6272 tablet_replica.cc:330] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.433326 6272 raft_consensus.cc:2229] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.433367 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 54b78fbf508f4e47bd31661e05dcaa16 (table default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]) successfully deleted
I20260928 10:44:14.433557 6272 pending_rounds.cc:62] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.433600 6272 pending_rounds.cc:68] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265870723272704 op_type: NO_OP noop_request { }
I20260928 10:44:14.433717 6272 raft_consensus.cc:2866] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.433804 6272 raft_consensus.cc:2258] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.434055 6275 consensus_queue.cc:260] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.434672 6275 ts_tablet_manager.cc:1428] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:44:14.434959 6275 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.436609 6275 tablet_bootstrap.cc:654] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.443003 6272 ts_tablet_manager.cc:1905] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.455269 6272 ts_tablet_manager.cc:1918] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.455422 6272 log.cc:1196] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/847b18c212474456ac9b40eee055dbd0
I20260928 10:44:14.455761 6272 ts_tablet_manager.cc:1939] T 847b18c212474456ac9b40eee055dbd0 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.456223 6272 tablet_replica.cc:330] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.456413 6272 raft_consensus.cc:2229] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.456413 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 847b18c212474456ac9b40eee055dbd0 (table default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]) successfully deleted
I20260928 10:44:14.456635 6272 pending_rounds.cc:62] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.456679 6272 pending_rounds.cc:68] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265871478595584 op_type: NO_OP noop_request { }
I20260928 10:44:14.456811 6272 raft_consensus.cc:2866] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.456892 6272 raft_consensus.cc:2258] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.456816 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.458016 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.463124 6272 ts_tablet_manager.cc:1905] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.464097 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.467721 6275 tablet_bootstrap.cc:492] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.467859 6275 ts_tablet_manager.cc:1397] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260928 10:44:14.468530 6275 raft_consensus.cc:348] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.468745 6275 raft_consensus.cc:374] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.468789 6275 raft_consensus.cc:729] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.468967 6275 consensus_queue.cc:260] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.469393 6270 raft_consensus.cc:2229] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.469483 6275 ts_tablet_manager.cc:1428] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:14.469746 6275 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.469781 6270 pending_rounds.cc:62] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:14.469822 6270 pending_rounds.cc:68] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868377260032 op_type: NO_OP noop_request { }
I20260928 10:44:14.469923 6270 raft_consensus.cc:2866] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.470000 6270 raft_consensus.cc:2258] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.471958 6275 tablet_bootstrap.cc:654] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.475154 6270 ts_tablet_manager.cc:1905] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.475395 6272 ts_tablet_manager.cc:1918] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.476822 6275 tablet_bootstrap.cc:492] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.480926 6275 ts_tablet_manager.cc:1397] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260928 10:44:14.481577 6275 raft_consensus.cc:348] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.481769 6275 raft_consensus.cc:374] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.481817 6275 raft_consensus.cc:729] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.482311 6270 ts_tablet_manager.cc:1918] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.482496 6270 log.cc:1196] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a25c7f3b94e94cafb3275a2e190be0ed
I20260928 10:44:14.482168 6275 consensus_queue.cc:260] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.482934 6270 ts_tablet_manager.cc:1939] T a25c7f3b94e94cafb3275a2e190be0ed P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.483156 6275 ts_tablet_manager.cc:1428] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:14.483294 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 860) took 3288 ms. Trace:
I20260928 10:44:14.483482 6275 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.483417 6270 rpcz_store.cc:276] 0928 10:44:11.195218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.198044 (+ 2826us) service_pool.cc:227] Handling call
0928 10:44:14.412696 (+3214652us) ts_tablet_manager.cc:1145] Deleting tablet a25c7f3b94e94cafb3275a2e190be0ed
0928 10:44:14.412706 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.469699 (+ 56993us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x6150001039a4. stack: 00007f07d55a366e 00007f07d55a3430 00007f07d462a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f07e0adb04d 00007f07e1d7f5ec 00007f07e470e2e6 00007f07e4740404 00007f07e4721870 00007f07e47215fd 00000000009edb7c 00007f07d55e9344 00007f07d55ec91b 00007f07d55ec798
0928 10:44:14.478115 (+ 8416us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.482221 (+ 4106us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.483278 (+ 1057us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":129723648,"tablet-delete.queue_time_us":3214417}
I20260928 10:44:14.484346 6270 tablet_replica.cc:330] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.484583 6270 raft_consensus.cc:2229] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.484790 6270 raft_consensus.cc:2258] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.485240 6275 tablet_bootstrap.cc:654] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.485585 6976 raft_consensus.cc:482] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.485658 6270 ts_tablet_manager.cc:1905] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.485689 6976 raft_consensus.cc:504] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.486302 6976 leader_election.cc:288] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.486639 6272 log.cc:1196] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:14.486945 6272 ts_tablet_manager.cc:1939] T fbac466fe364472391a1fc2d75a46b9b P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.487501 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet fbac466fe364472391a1fc2d75a46b9b (table default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]) successfully deleted
I20260928 10:44:14.488692 6272 tablet_replica.cc:330] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.488943 6272 raft_consensus.cc:2229] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.489246 6272 pending_rounds.cc:62] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.489348 6272 pending_rounds.cc:68] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868880121856 op_type: NO_OP noop_request { }
I20260928 10:44:14.489534 6272 raft_consensus.cc:2866] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.489675 6272 raft_consensus.cc:2258] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.490264 6272 ts_tablet_manager.cc:1905] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.489451 6275 tablet_bootstrap.cc:492] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.492400 6275 ts_tablet_manager.cc:1397] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20260928 10:44:14.493503 7381 raft_consensus.cc:482] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.493391 6275 raft_consensus.cc:348] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.493672 6275 raft_consensus.cc:374] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.493724 6275 raft_consensus.cc:729] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.493672 7381 raft_consensus.cc:504] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.493935 6275 consensus_queue.cc:260] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.494443 6275 ts_tablet_manager.cc:1428] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:14.494621 7381 leader_election.cc:288] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.494711 6275 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.495042 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.495622 5817 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.496435 6275 tablet_bootstrap.cc:654] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.503458 7348 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.503633 7348 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.504253 7348 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.506450 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.507544 5955 leader_election.cc:341] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:14.510594 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ad79320a73b04a18813fbf83fb738b2e (table default.Table_2e7199f3e03c48228c2fe28bc4e79433 [id=00f4a47d4b814b7788e8aa3e686b46ae], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ad79320a73b04a18813fbf83fb738b2e consensus state has no leader
I20260928 10:44:14.517975 7381 raft_consensus.cc:482] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.518298 7381 raft_consensus.cc:504] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.518795 6272 ts_tablet_manager.cc:1918] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.519572 7381 leader_election.cc:288] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.519582 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.521433 6272 log.cc:1196] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9e05cdd590894adcb987ef3ac78bf416
I20260928 10:44:14.522122 6272 ts_tablet_manager.cc:1939] T 9e05cdd590894adcb987ef3ac78bf416 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:14.522084 5817 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.523478 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9e05cdd590894adcb987ef3ac78bf416 (table default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]) successfully deleted
I20260928 10:44:14.524343 6272 tablet_replica.cc:330] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.524868 6272 raft_consensus.cc:2229] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.525467 6272 pending_rounds.cc:62] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.525853 6272 pending_rounds.cc:68] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868377260032 op_type: NO_OP noop_request { }
I20260928 10:44:14.526181 6272 raft_consensus.cc:2866] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.526466 6272 raft_consensus.cc:2258] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.527873 6272 ts_tablet_manager.cc:1905] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.528906 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.529358 6019 raft_consensus.cc:2454] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.530297 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.531354 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a25c7f3b94e94cafb3275a2e190be0ed (table default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]) successfully deleted
I20260928 10:44:14.532734 6090 leader_election.cc:302] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:14.533097 6976 raft_consensus.cc:2781] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.533183 6976 raft_consensus.cc:482] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.533239 6976 raft_consensus.cc:3037] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.536206 6976 raft_consensus.cc:504] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.536947 6976 leader_election.cc:288] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.541724 6976 raft_consensus.cc:482] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.542002 6976 raft_consensus.cc:504] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.542953 6976 leader_election.cc:288] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.544289 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e7257c8b114e80853ff0a108d2998a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:14.544523 6013 raft_consensus.cc:3037] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.544951 6272 ts_tablet_manager.cc:1918] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.545079 6272 log.cc:1196] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a25c7f3b94e94cafb3275a2e190be0ed
I20260928 10:44:14.545451 6272 ts_tablet_manager.cc:1939] T a25c7f3b94e94cafb3275a2e190be0ed P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.546159 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a25c7f3b94e94cafb3275a2e190be0ed (table default.Table_db5f2736588a497ca53d21f0deb71ae2 [id=3df3d12f4b2941e2920378658bb74300]) successfully deleted
I20260928 10:44:14.547600 6013 raft_consensus.cc:2454] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:14.548229 6976 raft_consensus.cc:482] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.548431 6976 raft_consensus.cc:504] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.549422 6976 leader_election.cc:288] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.550644 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.550926 5884 raft_consensus.cc:2454] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:14.552081 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "943db4a7f3fe4283a67defd68e744e33" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.552345 5884 raft_consensus.cc:2379] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.552922 7348 raft_consensus.cc:482] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.553084 7348 raft_consensus.cc:504] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.553755 7348 leader_election.cc:288] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.554589 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.555222 5955 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:14.556172 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 104a223ec6ef47988d0aa3335a1f81de because the tablet was not found. No further retry: Not found: Tablet not found: 104a223ec6ef47988d0aa3335a1f81de
I20260928 10:44:14.559278 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:14.563117 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 98bd99e7bdb647ceb9357f88affc45d9 because the tablet was not found. No further retry: Not found: Tablet not found: 98bd99e7bdb647ceb9357f88affc45d9
W20260928 10:44:14.564383 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bb4590c83aa24745af278fcac0a9d518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb4590c83aa24745af278fcac0a9d518 already in progress: creating tablet
I20260928 10:44:14.565008 6272 tablet_replica.cc:330] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.565830 6272 raft_consensus.cc:2229] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.566803 6272 raft_consensus.cc:2258] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.567646 6272 ts_tablet_manager.cc:1905] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.575394 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5590c0fd47fdbf44e5217b8d0be6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.575704 6013 raft_consensus.cc:2454] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.588936 6272 ts_tablet_manager.cc:1918] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:14.590423 7348 raft_consensus.cc:482] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.590613 7348 raft_consensus.cc:504] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.591249 7348 leader_election.cc:288] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.591493 6976 raft_consensus.cc:482] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.592002 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.598896 6976 raft_consensus.cc:504] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:14.599436 5955 leader_election.cc:341] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.599656 6976 leader_election.cc:288] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.600267 6272 log.cc:1196] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:14.600936 6272 ts_tablet_manager.cc:1939] T ffa971239a2b4ac6bc309dfbacdbe12e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.601697 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9afe3c828c9747958a7c558716643007" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.602046 6013 raft_consensus.cc:2454] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.602239 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]) successfully deleted
W20260928 10:44:14.603801 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 19e0768dea6a40889a3f50b953c0ee4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19e0768dea6a40889a3f50b953c0ee4d already in progress: creating tablet
W20260928 10:44:14.606318 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5eb089481e47455cb7387b0f17eda9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb089481e47455cb7387b0f17eda9fb already in progress: creating tablet
W20260928 10:44:14.607863 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cab9bc67c7474cb681566118af1bbf07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab9bc67c7474cb681566118af1bbf07 already in progress: creating tablet
I20260928 10:44:14.612977 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.613588 6272 tablet_replica.cc:330] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.613865 6272 raft_consensus.cc:2229] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.614295 6090 leader_election.cc:302] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:14.614800 6272 raft_consensus.cc:2258] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.614926 6090 leader_election.cc:302] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:14.614610 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.615305 6976 raft_consensus.cc:2781] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:14.615806 7443 raft_consensus.cc:2781] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.615926 7443 raft_consensus.cc:482] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.616006 7443 raft_consensus.cc:3037] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.616250 6272 ts_tablet_manager.cc:1905] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.619673 6976 raft_consensus.cc:686] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:14.619853 7443 raft_consensus.cc:504] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.619951 6976 consensus_queue.cc:237] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.622411 7443 leader_election.cc:288] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.629819 7438 tablet.cc:1722] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.639256 6272 ts_tablet_manager.cc:1918] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.639459 6272 log.cc:1196] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9afe3c828c9747958a7c558716643007
W20260928 10:44:14.640990 5957 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:14.641115 5957 leader_election.cc:302] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:14.641115 7348 consensus_queue.cc:1035] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.641695 7348 raft_consensus.cc:2726] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.642715 5818 leader_election.cc:302] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:14.640945 6091 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1e7257c8b114e80853ff0a108d2998a
W20260928 10:44:14.643260 5818 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.643362 5818 leader_election.cc:302] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.643802 6091 leader_election.cc:302] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:14.644191 6091 leader_election.cc:341] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1e7257c8b114e80853ff0a108d2998a
W20260928 10:44:14.644457 6091 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:14.644518 7381 raft_consensus.cc:2781] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 10:44:14.644599 6091 leader_election.cc:341] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9afe3c828c9747958a7c558716643007
I20260928 10:44:14.644613 7381 raft_consensus.cc:482] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.644676 7381 raft_consensus.cc:3037] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.644855 6976 raft_consensus.cc:3037] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.645293 7420 raft_consensus.cc:2726] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.647938 6976 raft_consensus.cc:2726] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.648655 6272 ts_tablet_manager.cc:1939] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.658049 6976 raft_consensus.cc:482] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.658318 6976 raft_consensus.cc:504] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.659343 6976 leader_election.cc:288] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.667552 6976 raft_consensus.cc:482] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.667779 6976 raft_consensus.cc:504] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.668440 6976 leader_election.cc:288] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.672940 7420 raft_consensus.cc:482] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.673295 7420 raft_consensus.cc:504] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.675128 7420 leader_election.cc:288] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:14.675221 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.675805 5817 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.683691 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9afe3c828c9747958a7c558716643007 (table default.Table_72fa42e53bb14b278e9f91b8c5276960 [id=b9fd4743707c40a9bbfb44b1d14bfe90]) successfully deleted
I20260928 10:44:14.684073 6272 tablet_replica.cc:330] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.684299 6272 raft_consensus.cc:2229] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:14.684540 6272 pending_rounds.cc:62] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:14.684578 6272 pending_rounds.cc:68] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265874925723648 op_type: NO_OP noop_request { }
I20260928 10:44:14.684700 6272 raft_consensus.cc:2866] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:14.684854 6272 raft_consensus.cc:2258] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.685959 6272 ts_tablet_manager.cc:1905] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.689644 7446 tablet.cc:1722] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.694563 6272 ts_tablet_manager.cc:1918] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.694868 6272 log.cc:1196] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c1e7257c8b114e80853ff0a108d2998a
I20260928 10:44:14.695307 6272 ts_tablet_manager.cc:1939] T c1e7257c8b114e80853ff0a108d2998a P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.696030 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c1e7257c8b114e80853ff0a108d2998a (table default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]) successfully deleted
I20260928 10:44:14.696466 6272 tablet_replica.cc:330] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.696704 6272 raft_consensus.cc:2229] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.697383 6272 raft_consensus.cc:2258] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:14.697845 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 54550.6us
I20260928 10:44:14.698421 6272 ts_tablet_manager.cc:1905] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:14.698462 5818 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.698803 5818 leader_election.cc:302] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:14.699615 5818 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.700127 7420 raft_consensus.cc:2726] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.699904 5818 leader_election.cc:302] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.710007 7420 raft_consensus.cc:2726] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:14.710753 5818 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:14.713603 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 98686.8us
I20260928 10:44:14.714241 6090 leader_election.cc:302] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:14.714718 6090 raft_consensus.cc:2670] T 9afe3c828c9747958a7c558716643007 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:14.716233 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5590c0fd47fdbf44e5217b8d0be6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:14.716825 6021 raft_consensus.cc:3037] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.721055 6272 ts_tablet_manager.cc:1918] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.721604 6272 log.cc:1196] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/efa178fc1e344069b086003d39f1b848
I20260928 10:44:14.722150 6272 ts_tablet_manager.cc:1939] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.722169 6021 raft_consensus.cc:2454] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:14.723330 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet efa178fc1e344069b086003d39f1b848 (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:14.729257 6275 tablet_bootstrap.cc:492] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.729559 6275 ts_tablet_manager.cc:1397] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.235s user 0.039s sys 0.019s
I20260928 10:44:14.730371 6275 raft_consensus.cc:348] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:14.729257 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 88065.5us
I20260928 10:44:14.730825 6275 raft_consensus.cc:374] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.730947 6275 raft_consensus.cc:729] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.731268 6275 consensus_queue.cc:260] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.731936 6275 ts_tablet_manager.cc:1428] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:14.732662 5957 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.734967 7446 tablet.cc:1722] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.735918 7445 raft_consensus.cc:2781] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.736178 7445 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.736416 7445 raft_consensus.cc:3037] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.724530 6273 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:14.727017 7439 tablet.cc:1722] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.729619 7381 raft_consensus.cc:504] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.741082 6273 ts_tablet_manager.cc:1397] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.422s user 0.006s sys 0.006s
I20260928 10:44:14.741950 7381 leader_election.cc:288] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.742144 6275 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.744252 6275 tablet_bootstrap.cc:654] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.740368 5818 leader_election.cc:302] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.742426 6272 tablet_replica.cc:330] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.746757 6272 raft_consensus.cc:2229] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.746989 6272 raft_consensus.cc:2258] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.747572 6272 ts_tablet_manager.cc:1905] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.745824 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:14.749046 7381 raft_consensus.cc:2726] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.746011 6273 raft_consensus.cc:348] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.754918 6273 raft_consensus.cc:374] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.759393 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:14.760541 5817 leader_election.cc:341] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.758147 6273 raft_consensus.cc:729] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:14.760541 5818 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.762255 5818 leader_election.cc:302] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.764485 6270 ts_tablet_manager.cc:1918] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:14.764823 6270 log.cc:1196] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:14.765873 7420 raft_consensus.cc:2726] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.766598 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa178fc1e344069b086003d39f1b848" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.766820 6013 raft_consensus.cc:2454] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.762928 7447 tablet.cc:1722] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.767927 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db824b43256640e9bfef44da1ccf8e1a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.768159 6013 raft_consensus.cc:2454] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.769495 6275 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.769690 6275 ts_tablet_manager.cc:1397] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260928 10:44:14.769767 6146 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.770588 6275 raft_consensus.cc:348] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.770872 6275 raft_consensus.cc:374] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.770969 6275 raft_consensus.cc:729] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.771203 6275 consensus_queue.cc:260] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.771776 6275 ts_tablet_manager.cc:1428] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:14.772066 6275 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.765139 6273 consensus_queue.cc:260] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:14.774524 5818 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.778012 6275 tablet_bootstrap.cc:654] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.777259 5818 leader_election.cc:302] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.780359 7420 raft_consensus.cc:2726] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.779479 6272 ts_tablet_manager.cc:1918] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.781209 6976 raft_consensus.cc:482] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.781327 6976 raft_consensus.cc:504] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.781888 6976 leader_election.cc:288] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.783135 6273 ts_tablet_manager.cc:1428] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.042s user 0.004s sys 0.000s
I20260928 10:44:14.784726 6272 log.cc:1196] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/db824b43256640e9bfef44da1ccf8e1a
I20260928 10:44:14.785141 6272 ts_tablet_manager.cc:1939] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.785851 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet db824b43256640e9bfef44da1ccf8e1a (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
I20260928 10:44:14.786250 6272 tablet_replica.cc:330] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.786512 6272 raft_consensus.cc:2229] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.786736 6272 raft_consensus.cc:2258] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.787325 6272 ts_tablet_manager.cc:1905] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.794817 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:14.796962 5699 catalog_manager.cc:5495] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:14.797338 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.797592 5699 catalog_manager.cc:5495] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:14.797937 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
W20260928 10:44:14.798863 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e49c5428f8674548a309e5cf58c82049 consensus state has no leader
I20260928 10:44:14.799371 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 39cbecd1c19541f28bd32b7c46f2df61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:14.799322 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b1d6629390ff446f954502b32d093231"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.799883 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1d6629390ff446f954502b32d093231 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:14.800275 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 914ea799da554974960e7bf142a407b1 consensus state has no leader
I20260928 10:44:14.800705 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d3985cb736ef4d5ea6c413cd992d0f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.801179 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3985cb736ef4d5ea6c413cd992d0f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:14.801287 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed1d3dd8a4d741199a8349a4d9520432 consensus state has no leader
I20260928 10:44:14.801343 6275 tablet_bootstrap.cc:492] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.801517 6275 ts_tablet_manager.cc:1397] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260928 10:44:14.801710 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c12b8a90ee4a4c99a8e28da7f3788bc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.802176 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c12b8a90ee4a4c99a8e28da7f3788bc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.802392 6275 raft_consensus.cc:348] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.802711 6275 raft_consensus.cc:374] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.802821 6275 raft_consensus.cc:729] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.803095 6275 consensus_queue.cc:260] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.803673 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7a2b5c5e039641bb84f974157bcc8b1a" } modify_external_catalogs: true
I20260928 10:44:14.803865 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7a2b5c5e039641bb84f974157bcc8b1a" } modify_external_catalogs: true
W20260928 10:44:14.804257 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57c925616df64d1eb141ea85b43c3887 consensus state has no leader
I20260928 10:44:14.798213 5699 catalog_manager.cc:5495] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:14.806360 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 593015cc3f8547b5a08043d2c016ec91 (table default.Table_05e9e2f2253945c286361ae7fb235dfe [id=78c21cb16c8e4745b67eb1700a404525]). Expected version 2 got 0
I20260928 10:44:14.807199 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.808120 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.809039 6275 ts_tablet_manager.cc:1428] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:14.809464 6275 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.811384 6275 tablet_bootstrap.cc:654] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.816636 6269 ts_tablet_manager.cc:1939] T a6b418bbb3364006b097e3a78edf5f55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:14.816919 6270 ts_tablet_manager.cc:1939] T b77c90bc2ecc4fc29a4786152cb977bd P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:14.820931 6273 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:14.823125 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59c67a02d7f84bed9c440c8c451ea4ff consensus state has no leader
I20260928 10:44:14.823740 6273 tablet_bootstrap.cc:654] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.829334 6976 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.832155 6976 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.832892 6976 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.834857 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 35345a76883045afadd5922c11de910d
I20260928 10:44:14.835776 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 35345a76883045afadd5922c11de910d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:14.836133 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.836606 6976 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.836786 6976 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.837112 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 35345a76883045afadd5922c11de910d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:14.837414 6976 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.837541 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593015cc3f8547b5a08043d2c016ec91" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.837781 5884 raft_consensus.cc:2379] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.838101 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 35345a76883045afadd5922c11de910d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:14.839395 5944 kernel_stack_watchdog.cc:198] Thread 6271 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 305ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f07d88ac980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f07d55c6bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f07d55e6fd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f07d55e2beb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f07d55e7cef kudu::ThreadPool::Submit() at ??:0
@ 0x7f07e048806d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f07e04870bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f07e0486ca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f07e048ea02 kudu::log::Log::Init() at ??:0
@ 0x7f07e048ddbf kudu::log::Log::Open() at ??:0
@ 0x7f07e1d1f2ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f07e1d1b7dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f07e1d19fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 10:44:14.841158 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.841257 7420 raft_consensus.cc:482] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.841396 5884 raft_consensus.cc:2379] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.841369 7420 raft_consensus.cc:504] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.841883 7420 leader_election.cc:288] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:14.841840 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.841980 7420 raft_consensus.cc:482] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.842016 5884 raft_consensus.cc:2454] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:14.842075 7420 raft_consensus.cc:504] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:14.842444 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.842545 7420 leader_election.cc:288] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:14.842621 5884 raft_consensus.cc:2454] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:14.843088 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.843245 5884 raft_consensus.cc:2454] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:14.843312 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.843693 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:14.843827 5817 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.843839 5884 raft_consensus.cc:2454] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:14.844303 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:14.844516 6019 raft_consensus.cc:3037] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.831918 6272 ts_tablet_manager.cc:1918] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.847177 6272 log.cc:1196] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:14.847647 6272 ts_tablet_manager.cc:1939] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.848388 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (table default.Table_fb25cc33ccfb474ca51b0db8e1b167f7 [id=620121bbc5c641b792d823560616b120]) successfully deleted
W20260928 10:44:14.849244 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 91337888b5864a2286b9afb7fcba8c98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91337888b5864a2286b9afb7fcba8c98 already in progress: creating tablet
I20260928 10:44:14.849668 6272 tablet_replica.cc:330] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:14.849922 6272 raft_consensus.cc:2229] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.850100 6272 raft_consensus.cc:2258] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.850237 7365 raft_consensus.cc:482] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.850394 7365 raft_consensus.cc:504] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.851070 7365 leader_election.cc:288] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.852150 6275 tablet_bootstrap.cc:492] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.852330 6275 ts_tablet_manager.cc:1397] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260928 10:44:14.853157 6275 raft_consensus.cc:348] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.853489 6275 raft_consensus.cc:374] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.853580 6275 raft_consensus.cc:729] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.853858 6275 consensus_queue.cc:260] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.859336 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:14.859997 5817 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.859457 6275 ts_tablet_manager.cc:1428] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260928 10:44:14.860502 6272 ts_tablet_manager.cc:1905] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.860605 7439 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:34882 (request call id 946) took 1076 ms. Trace:
I20260928 10:44:14.860714 7439 rpcz_store.cc:276] 0928 10:44:13.784089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.784189 (+ 100us) service_pool.cc:227] Handling call
0928 10:44:14.860576 (+1076387us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:13.858989 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 10:44:13.952608 (+ 93619us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 10:44:13.952621 (+ 13us) alter_schema_op.cc:65] Acquired schema lock
0928 10:44:13.952629 (+ 8us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 10:44:13.956775 (+ 4146us) alter_schema_op.cc:126] START. Timestamp: 1790592253956647
0928 10:44:13.956782 (+ 7us) op_driver.cc:331] REPLICATION: starting
0928 10:44:14.001102 (+ 44320us) log.cc:842] Serialized 173 byte log entry
0928 10:44:14.498015 (+496913us) op_driver.cc:444] REPLICATION: finished
0928 10:44:14.726990 (+228975us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0928 10:44:14.742535 (+ 15545us) log.cc:842] Serialized 5 byte log entry
0928 10:44:14.746249 (+ 3714us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.746920 (+ 671us) log.cc:842] Serialized 14 byte log entry
0928 10:44:14.747672 (+ 752us) alter_schema_op.cc:71] Released schema lock
0928 10:44:14.747678 (+ 6us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":228911,"prepare.queue_time_us":39778,"prepare.run_cpu_time_us":12126,"prepare.run_wall_time_us":661299,"raft.queue_time_us":55,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":784,"replication_time_us":541200,"thread_start_us":843107,"threads_started":3,"wal-append.queue_time_us":381446}]]}
I20260928 10:44:14.769824 6090 leader_election.cc:302] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:14.863183 6090 raft_consensus.cc:2670] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:44:14.863305 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 93501.5us
I20260928 10:44:14.863528 6090 leader_election.cc:302] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:14.863708 6090 raft_consensus.cc:2670] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:14.863864 6090 leader_election.cc:302] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:14.864018 6090 raft_consensus.cc:2670] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:14.864423 7365 consensus_queue.cc:1035] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.865821 7438 tablet.cc:1722] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:14.867728 6275 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.868194 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 859) took 3673 ms. Trace:
I20260928 10:44:14.868280 6270 rpcz_store.cc:276] 0928 10:44:11.195095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.198317 (+ 3222us) service_pool.cc:227] Handling call
0928 10:44:14.483877 (+3285560us) ts_tablet_manager.cc:1145] Deleting tablet b77c90bc2ecc4fc29a4786152cb977bd
0928 10:44:14.484312 (+ 435us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.488554 (+ 4242us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.764208 (+275654us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.868147 (+103939us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3285414}
I20260928 10:44:14.868717 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet b77c90bc2ecc4fc29a4786152cb977bd (table default.Table_2782a761b523442d88471194d3f881e8 [id=afb32d37eaed4b688eecba5a60b716ac]) successfully deleted
I20260928 10:44:14.869477 6275 tablet_bootstrap.cc:654] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.872663 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 770) took 6703 ms. Trace:
I20260928 10:44:14.872771 6269 rpcz_store.cc:276] 0928 10:44:08.169259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.199583 (+ 30324us) service_pool.cc:227] Handling call
0928 10:44:13.860406 (+5660823us) ts_tablet_manager.cc:1145] Deleting tablet a6b418bbb3364006b097e3a78edf5f55
0928 10:44:13.860414 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:13.903230 (+ 42816us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.052753 (+149523us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.872641 (+819888us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46339,"tablet-delete.queue_time_us":5660629}
I20260928 10:44:14.873207 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 772) took 6666 ms. Trace:
I20260928 10:44:14.873276 6269 rpcz_store.cc:276] 0928 10:44:08.206635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.223280 (+ 16645us) service_pool.cc:227] Handling call
0928 10:44:14.873089 (+6649809us) ts_tablet_manager.cc:1145] Deleting tablet 7e5bec611c95429ab309957f74b70eea
0928 10:44:14.873102 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.873190 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6649597}
I20260928 10:44:14.873569 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 773) took 6666 ms. Trace:
I20260928 10:44:14.873631 6269 rpcz_store.cc:276] 0928 10:44:08.206774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.223511 (+ 16737us) service_pool.cc:227] Handling call
0928 10:44:14.873457 (+6649946us) ts_tablet_manager.cc:1145] Deleting tablet 7834a54e59114a77b4e54e9190049a47
0928 10:44:14.873465 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.873527 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6649802}
I20260928 10:44:14.873876 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 774) took 6667 ms. Trace:
I20260928 10:44:14.873936 6269 rpcz_store.cc:276] 0928 10:44:08.206850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.223667 (+ 16817us) service_pool.cc:227] Handling call
0928 10:44:14.873795 (+6650128us) ts_tablet_manager.cc:1145] Deleting tablet 29f07262a710456ea0837dc5af3eaebb
0928 10:44:14.873803 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.873865 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6650002}
I20260928 10:44:14.874174 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 775) took 6667 ms. Trace:
I20260928 10:44:14.874229 6269 rpcz_store.cc:276] 0928 10:44:08.206944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.223807 (+ 16863us) service_pool.cc:227] Handling call
0928 10:44:14.874095 (+6650288us) ts_tablet_manager.cc:1145] Deleting tablet 0e4594eae7b840ff980f67da8ed82e01
0928 10:44:14.874103 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.874163 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6611738}
I20260928 10:44:14.875586 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a6b418bbb3364006b097e3a78edf5f55 (table default.Table_534373dcfd75430c9608190a3979421a [id=5557e0d93f67480ca44cf2cd28b92e2e]) successfully deleted
W20260928 10:44:14.875898 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7e5bec611c95429ab309957f74b70eea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e5bec611c95429ab309957f74b70eea already in progress: creating tablet
W20260928 10:44:14.876122 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 7834a54e59114a77b4e54e9190049a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7834a54e59114a77b4e54e9190049a47 already in progress: creating tablet
W20260928 10:44:14.876320 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 29f07262a710456ea0837dc5af3eaebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29f07262a710456ea0837dc5af3eaebb already in progress: creating tablet
W20260928 10:44:14.876495 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 0e4594eae7b840ff980f67da8ed82e01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4594eae7b840ff980f67da8ed82e01 already in progress: creating tablet
I20260928 10:44:14.876852 6270 tablet_replica.cc:330] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:14.877040 6270 raft_consensus.cc:2229] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.877199 6270 raft_consensus.cc:2258] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.877800 6270 ts_tablet_manager.cc:1905] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.880177 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.880379 5880 raft_consensus.cc:2454] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:14.880769 6091 leader_election.cc:341] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:14.881163 6091 leader_election.cc:302] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:14.881354 6275 tablet_bootstrap.cc:492] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.881500 6275 ts_tablet_manager.cc:1397] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
W20260928 10:44:14.881526 6091 leader_election.cc:341] T efa178fc1e344069b086003d39f1b848 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: efa178fc1e344069b086003d39f1b848
W20260928 10:44:14.881799 6091 leader_election.cc:341] T db824b43256640e9bfef44da1ccf8e1a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: db824b43256640e9bfef44da1ccf8e1a
I20260928 10:44:14.882108 6091 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:14.882236 5957 leader_election.cc:302] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.882357 6091 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:14.882556 7443 raft_consensus.cc:3037] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.882602 6976 raft_consensus.cc:2781] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.882711 6976 raft_consensus.cc:482] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.882800 6976 raft_consensus.cc:3037] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.882787 5957 leader_election.cc:302] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.882886 6272 ts_tablet_manager.cc:1918] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:14.883014 6272 log.cc:1196] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:44:14.883317 6272 ts_tablet_manager.cc:1939] T 39cbecd1c19541f28bd32b7c46f2df61 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:14.883319 7168 raft_consensus.cc:2781] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.883395 7168 raft_consensus.cc:482] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.883448 7168 raft_consensus.cc:3037] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.883863 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 39cbecd1c19541f28bd32b7c46f2df61 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:14.884325 6275 raft_consensus.cc:348] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.884512 6275 raft_consensus.cc:374] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.884589 6275 raft_consensus.cc:729] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.884773 6275 consensus_queue.cc:260] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.885046 7443 raft_consensus.cc:2726] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.885208 7443 raft_consensus.cc:2781] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 10:44:14.885300 7443 raft_consensus.cc:482] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.885362 7443 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Advancing to term 2
I20260928 10:44:14.885349 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.885653 7348 raft_consensus.cc:2781] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.885716 7348 raft_consensus.cc:482] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.885771 7348 raft_consensus.cc:3037] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.885741 7168 raft_consensus.cc:504] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.886255 7168 leader_election.cc:288] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:14.886554 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 35345a76883045afadd5922c11de910d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35345a76883045afadd5922c11de910d already in progress: creating tablet
I20260928 10:44:14.885218 6976 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.887863 7348 raft_consensus.cc:504] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.887985 6976 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.888342 7348 leader_election.cc:288] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.888823 7443 raft_consensus.cc:504] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.889184 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8242d0647d1b4f28a5f1ccf36b00d616" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.889366 7443 leader_election.cc:288] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.889601 7445 raft_consensus.cc:504] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.892035 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.893198 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.893385 6021 raft_consensus.cc:2379] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.894630 7348 consensus_queue.cc:1035] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.894970 7348 consensus_queue.cc:1035] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.900472 6275 ts_tablet_manager.cc:1428] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.019s user 0.002s sys 0.003s
I20260928 10:44:14.900943 6275 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:14.902115 5818 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.874444 6269 tablet_replica.cc:330] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:14.902917 6269 raft_consensus.cc:2229] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:14.903117 6269 raft_consensus.cc:2258] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:14.902585 5818 leader_election.cc:302] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.906697 7184 raft_consensus.cc:2726] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.907456 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.908008 6273 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:14.908155 6273 ts_tablet_manager.cc:1397] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.001s
I20260928 10:44:14.908515 6275 tablet_bootstrap.cc:654] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.908931 6273 raft_consensus.cc:348] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.909145 6273 raft_consensus.cc:374] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.909191 6273 raft_consensus.cc:729] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.909365 6273 consensus_queue.cc:260] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.911073 5957 leader_election.cc:302] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:14.911156 7348 consensus_queue.cc:1035] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:14.911597 7348 raft_consensus.cc:2781] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:14.911576 6269 ts_tablet_manager.cc:1905] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:14.911680 7348 raft_consensus.cc:482] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:14.911742 7348 raft_consensus.cc:3037] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.913930 7455 raft_consensus.cc:482] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.914109 7455 raft_consensus.cc:504] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.914877 7455 leader_election.cc:288] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.915390 7348 raft_consensus.cc:504] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.916253 7348 leader_election.cc:288] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.920426 7445 leader_election.cc:288] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:14.921984 6275 tablet_bootstrap.cc:492] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.922173 6275 ts_tablet_manager.cc:1397] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.001s
W20260928 10:44:14.922269 5818 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.922392 5818 leader_election.cc:302] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.922981 6275 raft_consensus.cc:348] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.923223 6271 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:14.923245 6275 raft_consensus.cc:374] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.923314 6275 raft_consensus.cc:729] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.923352 6271 ts_tablet_manager.cc:1397] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.501s user 0.144s sys 0.231s
I20260928 10:44:14.923539 6275 consensus_queue.cc:260] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.924026 6271 raft_consensus.cc:348] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.924681 6271 raft_consensus.cc:374] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:14.924734 6271 raft_consensus.cc:729] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:14.924953 6271 consensus_queue.cc:260] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:14.925444 6271 ts_tablet_manager.cc:1428] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:14.925690 6271 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:14.926496 7184 raft_consensus.cc:2726] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:14.926977 5818 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.927086 5818 leader_election.cc:302] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:14.927271 7184 raft_consensus.cc:2726] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:14.927969 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_143d8d94dda84b9d8857beb53cae399d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:14.928565 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143d8d94dda84b9d8857beb53cae399d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.928977 6271 tablet_bootstrap.cc:654] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.929381 6275 ts_tablet_manager.cc:1428] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:14.930454 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:14.930456 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:14.930668 5880 raft_consensus.cc:3037] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.933326 5880 raft_consensus.cc:2454] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:14.934710 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:14.934890 5880 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Advancing to term 2
I20260928 10:44:14.935851 6275 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:14.936002 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:14.937526 5880 raft_consensus.cc:2454] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 2.
I20260928 10:44:14.938426 6275 tablet_bootstrap.cc:654] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.939316 6146 raft_consensus.cc:1226] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 FOLLOWER]: Rejecting Update request from peer 2f6ffbf4f0534383bf89d15aa37e3027 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 10:44:14.939409 5883 raft_consensus.cc:1226] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 2 FOLLOWER]: Rejecting Update request from peer 2f6ffbf4f0534383bf89d15aa37e3027 for earlier term 1. Current term is 2. Ops: []
I20260928 10:44:14.939549 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:14.939803 5880 raft_consensus.cc:2379] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.939867 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:14.940253 6273 ts_tablet_manager.cc:1428] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260928 10:44:14.940627 6273 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.142429 6273 tablet_bootstrap.cc:654] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:14.955587 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eed9a56bf4674e4a834e316bc9af0e73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.143177 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eed9a56bf4674e4a834e316bc9af0e73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:14.948498 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.143538 5881 raft_consensus.cc:3037] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.944592 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd09430a2c34965a590f2e0852c686b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:14.940340 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0ca8630f134d5fba6e87bd901df70b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.144809 6146 raft_consensus.cc:3037] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.146289 5881 raft_consensus.cc:2454] T 5e0ca8630f134d5fba6e87bd901df70b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.948494 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.146580 5880 raft_consensus.cc:3037] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.147523 6146 raft_consensus.cc:2454] T 5e0ca8630f134d5fba6e87bd901df70b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.965116 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_22d5b7f76ea14a399cf45ec4f9a53a27" } modify_external_catalogs: true
I20260928 10:44:15.147909 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_22d5b7f76ea14a399cf45ec4f9a53a27" } modify_external_catalogs: true
I20260928 10:44:15.149048 5880 raft_consensus.cc:2454] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.957247 6269 ts_tablet_manager.cc:1918] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:15.149341 6269 log.cc:1196] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/362ef9f9aa8641cca11c0a154882e1d4
I20260928 10:44:15.149715 6269 ts_tablet_manager.cc:1939] T 362ef9f9aa8641cca11c0a154882e1d4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.150563 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 776) took 6719 ms. Trace:
I20260928 10:44:15.150651 6269 rpcz_store.cc:276] 0928 10:44:08.431021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.431087 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:14.874410 (+6443323us) ts_tablet_manager.cc:1145] Deleting tablet 362ef9f9aa8641cca11c0a154882e1d4
0928 10:44:14.874418 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:14.954052 (+ 79634us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:14.957138 (+ 3086us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.150533 (+193395us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6442976}
W20260928 10:44:14.945135 5955 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.151057 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 753) took 7675 ms. Trace:
W20260928 10:44:15.151049 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 205905us
I20260928 10:44:15.151130 6269 rpcz_store.cc:276] 0928 10:44:07.475640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.110132 (+634492us) service_pool.cc:227] Handling call
0928 10:44:15.150926 (+7040794us) ts_tablet_manager.cc:1145] Deleting tablet 6f317439c55e4575a0d72ef282c467d5
0928 10:44:15.150938 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.151039 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6683622}
I20260928 10:44:15.151371 6269 tablet_replica.cc:330] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:15.151645 6269 raft_consensus.cc:2229] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.151790 6269 raft_consensus.cc:2258] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:15.152046 5955 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:14.965418 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.152390 5884 raft_consensus.cc:3037] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:14.941510 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb9c554d363441b8006abc2d9bdd856" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:14.991124 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_53aa173b737349c8a4113b62208d8fd4" } modify_external_catalogs: true
I20260928 10:44:15.152884 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_53aa173b737349c8a4113b62208d8fd4" } modify_external_catalogs: true
I20260928 10:44:14.946084 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d64c1af58d6a4dfcabd6eecb8c75d572" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.155038 5884 raft_consensus.cc:2454] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:14.945851 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.156415 6151 raft_consensus.cc:2379] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:44:14.998208 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ad06e835386b437d8a8ccb4b8dbc479c" } modify_external_catalogs: true
I20260928 10:44:14.965945 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.156817 5878 raft_consensus.cc:2379] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:44:15.156739 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ad06e835386b437d8a8ccb4b8dbc479c" } modify_external_catalogs: true
I20260928 10:44:14.983704 7184 raft_consensus.cc:482] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.157049 7184 raft_consensus.cc:504] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.157616 7184 leader_election.cc:288] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.157735 7184 raft_consensus.cc:482] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:14.979447 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16510244612242f796910cf28e367da9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.157820 7184 raft_consensus.cc:504] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.158073 6013 raft_consensus.cc:2379] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:14.949725 6275 tablet_bootstrap.cc:492] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:14.977097 6091 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.158257 7184 leader_election.cc:288] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:14.989389 7420 raft_consensus.cc:482] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.158422 6275 ts_tablet_manager.cc:1397] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.223s user 0.001s sys 0.004s
I20260928 10:44:15.158398 7420 raft_consensus.cc:504] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.158548 7455 raft_consensus.cc:2781] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 10:44:15.158512 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 181395us
I20260928 10:44:15.158718 7455 raft_consensus.cc:686] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.158882 7420 leader_election.cc:288] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:14.981979 7458 consensus_queue.cc:1046] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.158967 7455 consensus_queue.cc:237] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.159147 7458 raft_consensus.cc:3032] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 10:44:15.159237 7458 raft_consensus.cc:729] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.159221 6275 raft_consensus.cc:348] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.159420 6275 raft_consensus.cc:374] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.159507 6275 raft_consensus.cc:729] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.159523 7458 consensus_queue.cc:260] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.159688 6275 consensus_queue.cc:260] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.159857 7458 raft_consensus.cc:3037] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Advancing to term 2
I20260928 10:44:15.159834 6091 leader_election.cc:302] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.028290 7381 raft_consensus.cc:482] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.160277 6275 ts_tablet_manager.cc:1428] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:15.160262 7381 raft_consensus.cc:504] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.160548 6275 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:15.160748 7381 leader_election.cc:288] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.161080 7443 raft_consensus.cc:2781] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 10:44:15.161230 7443 raft_consensus.cc:686] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.161499 7443 consensus_queue.cc:237] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:14.945638 6090 leader_election.cc:302] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.012403 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 791e310f4af14569aca647cca4cf9dc3
W20260928 10:44:15.162753 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 217113us
I20260928 10:44:15.060477 7447 tablet.cc:1722] T 3168fb311ee64931bd326b043a397ea1 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:15.163589 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b23b0742d5e04154b63487c884850da3" } new_table_name: "default.Table_7bbd2a0c0bbd4316946f6a5e67e513f0" modify_external_catalogs: true
W20260928 10:44:15.162515 7474 consensus_queue.cc:1159] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dab87557ec9445dbe35ea05e3561a94" responder_term: 2 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f6ffbf4f0534383bf89d15aa37e3027 for earlier term 1. Current term is 2. Ops: [1.1-1.1]" } } last_received_current_leader { term: 0 index: 0 } }
I20260928 10:44:15.164113 6269 ts_tablet_manager.cc:1905] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.164985 7442 raft_consensus.cc:3037] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.025352 6271 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.166666 6271 ts_tablet_manager.cc:1397] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.241s user 0.015s sys 0.002s
I20260928 10:44:15.167373 6271 raft_consensus.cc:348] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.167572 6271 raft_consensus.cc:374] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.167615 6271 raft_consensus.cc:729] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.167656 7442 raft_consensus.cc:2726] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.167768 6271 consensus_queue.cc:260] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.167846 7442 raft_consensus.cc:482] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.168203 6271 ts_tablet_manager.cc:1428] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 10:44:15.168463 6271 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.169790 6271 tablet_bootstrap.cc:654] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.014858 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:15.068049 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:15.171448 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e310f4af14569aca647cca4cf9dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:15.031086 7348 raft_consensus.cc:482] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.031960 6270 ts_tablet_manager.cc:1918] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.171934 6270 log.cc:1196] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/fbac466fe364472391a1fc2d75a46b9b
I20260928 10:44:15.171856 7348 raft_consensus.cc:504] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.172255 6270 ts_tablet_manager.cc:1939] T fbac466fe364472391a1fc2d75a46b9b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:15.172418 7348 leader_election.cc:288] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.017787 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 6037e24ee6ba4399b6100ab27c4ed621 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:15.172523 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 858) took 3977 ms. Trace:
I20260928 10:44:15.172587 6270 rpcz_store.cc:276] 0928 10:44:11.195012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.198502 (+ 3490us) service_pool.cc:227] Handling call
0928 10:44:14.876806 (+3678304us) ts_tablet_manager.cc:1145] Deleting tablet fbac466fe364472391a1fc2d75a46b9b
0928 10:44:14.876817 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.026880 (+150063us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.031616 (+ 4736us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.172509 (+140893us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3678160}
I20260928 10:44:15.172861 6270 tablet_replica.cc:330] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:15.173022 6270 raft_consensus.cc:2229] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.173148 6270 pending_rounds.cc:62] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:15.173180 6270 pending_rounds.cc:68] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868317294592 op_type: NO_OP noop_request { }
I20260928 10:44:15.173269 6270 raft_consensus.cc:2866] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:15.173338 6270 raft_consensus.cc:2258] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.082221 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_12b41558208a45519e9cc26f4bf5b1ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:15.117100 7382 raft_consensus.cc:482] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.173643 7382 raft_consensus.cc:504] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:15.173882 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12b41558208a45519e9cc26f4bf5b1ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.174230 7382 leader_election.cc:288] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.083233 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5e977c789e184021b9821dd9eb1da987"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:15.175268 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:15.175501 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 593015cc3f8547b5a08043d2c016ec91 (table default.Table_05e9e2f2253945c286361ae7fb235dfe [id=78c21cb16c8e4745b67eb1700a404525]). Expected version 2 got 0
I20260928 10:44:15.175704 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:15.175864 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:15.176126 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e310f4af14569aca647cca4cf9dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:15.177012 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 791e310f4af14569aca647cca4cf9dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 791e310f4af14569aca647cca4cf9dc3 already in progress: creating tablet
I20260928 10:44:15.177495 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 362ef9f9aa8641cca11c0a154882e1d4 (table default.Table_6e5afe68ebdd46258a4e2ba8e4de308c [id=be4415ae9e774501a41f230cedd27be9]) successfully deleted
W20260928 10:44:15.177716 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6f317439c55e4575a0d72ef282c467d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f317439c55e4575a0d72ef282c467d5 already in progress: creating tablet
I20260928 10:44:15.032562 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.178603 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e310f4af14569aca647cca4cf9dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:14 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.032660 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.032660 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet b77c90bc2ecc4fc29a4786152cb977bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab820fc9e4460bac0d4c21dd69d361) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.033412 7445 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.182611 7445 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.183152 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet fbac466fe364472391a1fc2d75a46b9b (table default.Table_e57f65b9a17d4afa8b1e7329d8e053f8 [id=6e1567ef98664e22baf2376bdf4151f5]) successfully deleted
I20260928 10:44:15.183187 7445 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.033583 7451 tablet.cc:1722] T 3168fb311ee64931bd326b043a397ea1 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:15.054154 6019 raft_consensus.cc:2454] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:15.184439 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.184768 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.184824 5957 leader_election.cc:302] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.185158 5957 leader_election.cc:302] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.185577 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.186218 7474 raft_consensus.cc:2781] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.186339 7474 raft_consensus.cc:686] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.186456 7469 raft_consensus.cc:2781] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.186606 7469 raft_consensus.cc:686] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.186568 7474 consensus_queue.cc:237] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.186815 7469 consensus_queue.cc:237] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.187688 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.167970 7442 raft_consensus.cc:504] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.188777 7442 leader_election.cc:288] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.189481 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.189673 7438 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 10:44:15.175264 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e977c789e184021b9821dd9eb1da987 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.191627 5818 leader_election.cc:302] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.191887 7381 raft_consensus.cc:482] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:15.192005 5818 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.192024 7381 raft_consensus.cc:504] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:15.192194 5818 leader_election.cc:341] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.192600 7381 leader_election.cc:288] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.192520 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.192729 7381 raft_consensus.cc:2781] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.192750 5878 raft_consensus.cc:2454] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.192822 7381 raft_consensus.cc:686] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:15.193034 7381 consensus_queue.cc:237] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.193809 6270 ts_tablet_manager.cc:1905] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.201506 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 850693fd00274d98ab347eb40ae76b85
I20260928 10:44:15.202397 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_041e55375217446e8377abc4545d30ae" } new_table_name: "default.Table_2ff250c2b3b4486fb54c073b9ce8328d" modify_external_catalogs: true
I20260928 10:44:15.203082 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 850693fd00274d98ab347eb40ae76b85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:15.203876 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 850693fd00274d98ab347eb40ae76b85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 850693fd00274d98ab347eb40ae76b85 already in progress: creating tablet
I20260928 10:44:15.204550 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 850693fd00274d98ab347eb40ae76b85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.206367 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 850693fd00274d98ab347eb40ae76b85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.210721 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_85b812a6e2614d1eb3fe6afd7f0784ed" } new_table_name: "default.Table_d8e6782bc6994b32b03164e6193a10dc" modify_external_catalogs: true
I20260928 10:44:15.210853 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.211078 5884 raft_consensus.cc:2454] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.213778 5955 leader_election.cc:302] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:15.214102 5955 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.214386 5955 leader_election.cc:302] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.214685 7458 raft_consensus.cc:2781] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.214720 7348 raft_consensus.cc:2726] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.214794 7458 raft_consensus.cc:686] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.215005 7458 consensus_queue.cc:237] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.218644 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.218919 5881 raft_consensus.cc:2379] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
W20260928 10:44:15.221225 5818 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.221621 5818 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.221787 5818 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.221865 5957 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.222204 5957 leader_election.cc:302] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.222726 7168 raft_consensus.cc:2781] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.222621 7475 consensus_queue.cc:1035] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.222792 7168 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.222875 7168 raft_consensus.cc:3037] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.223097 7475 consensus_queue.cc:1035] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.223325 6271 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.223412 7475 raft_consensus.cc:2781] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.223448 6271 ts_tablet_manager.cc:1397] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.005s
I20260928 10:44:15.223479 7475 raft_consensus.cc:482] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.223528 7475 raft_consensus.cc:3037] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.224133 6271 raft_consensus.cc:348] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.224313 6271 raft_consensus.cc:374] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.224355 6271 raft_consensus.cc:729] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.224504 6271 consensus_queue.cc:260] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.225365 7168 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.225940 7168 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.225853 7475 raft_consensus.cc:504] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.226337 7475 leader_election.cc:288] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.226821 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.227432 7447 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:15.231173 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e8e3d92709bb4893973e5d24736bafcf
I20260928 10:44:15.233026 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cada7237dcb649188254449bd5fc3136
I20260928 10:44:15.234699 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet cada7237dcb649188254449bd5fc3136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:15.234985 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e3d92709bb4893973e5d24736bafcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:15.234409 6271 ts_tablet_manager.cc:1428] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 10:44:15.235858 6271 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.236404 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet cada7237dcb649188254449bd5fc3136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.236649 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e3d92709bb4893973e5d24736bafcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.237267 6271 tablet_bootstrap.cc:654] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:15.237627 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cada7237dcb649188254449bd5fc3136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cada7237dcb649188254449bd5fc3136 already in progress: creating tablet
W20260928 10:44:15.237916 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e8e3d92709bb4893973e5d24736bafcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8e3d92709bb4893973e5d24736bafcf already in progress: creating tablet
W20260928 10:44:15.240342 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d72fa48751d46fba41feb7f7c720657 consensus state has no leader
I20260928 10:44:15.242159 6269 ts_tablet_manager.cc:1918] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.242292 6269 log.cc:1196] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/2eded874aa094054b0c2e7c2e592dba1
I20260928 10:44:15.242499 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet cada7237dcb649188254449bd5fc3136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.242740 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e3d92709bb4893973e5d24736bafcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.252082 6275 tablet_bootstrap.cc:654] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:15.257643 5818 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.258774 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.258988 5878 raft_consensus.cc:3037] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.261799 5878 raft_consensus.cc:2454] T 4082931c332f40fc9c6530190fb61017 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:15.258782 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.262909 5880 raft_consensus.cc:3037] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.265483 5880 raft_consensus.cc:2454] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:15.268941 5957 leader_election.cc:302] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.269268 7468 raft_consensus.cc:2781] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.269394 7468 raft_consensus.cc:686] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.269654 7468 consensus_queue.cc:237] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.271013 5957 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.271556 7445 raft_consensus.cc:2781] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.271682 7445 raft_consensus.cc:686] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.271883 7445 consensus_queue.cc:237] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.274516 7455 raft_consensus.cc:482] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.274688 7455 raft_consensus.cc:504] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.274988 6270 ts_tablet_manager.cc:1918] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:15.275105 6270 log.cc:1196] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:15.275317 7455 leader_election.cc:288] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.275468 6270 ts_tablet_manager.cc:1939] T 4a973a1d20e3437c87ad889c723e7ebc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:15.275759 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 857) took 4080 ms. Trace:
I20260928 10:44:15.276257 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.280157 7455 raft_consensus.cc:482] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.280345 7455 raft_consensus.cc:504] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.280993 7455 leader_election.cc:288] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:15.281934 6091 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:15.286564 6270 rpcz_store.cc:276] 0928 10:44:11.194897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.198660 (+ 3763us) service_pool.cc:227] Handling call
0928 10:44:15.172820 (+3974160us) ts_tablet_manager.cc:1145] Deleting tablet 4a973a1d20e3437c87ad889c723e7ebc
0928 10:44:15.172830 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.199836 (+ 27006us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.274875 (+ 75039us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.275742 (+ 867us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3973981}
I20260928 10:44:15.287241 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4a973a1d20e3437c87ad889c723e7ebc (table default.Table_c2552880d04743968cc2e72c5f916b37 [id=a806768cdbab4df98036ea77f86a7e20]) successfully deleted
I20260928 10:44:15.287680 6270 tablet_replica.cc:330] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:15.287930 6270 raft_consensus.cc:2229] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.288206 6270 raft_consensus.cc:2258] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.288864 6270 ts_tablet_manager.cc:1905] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.291683 7348 consensus_queue.cc:1035] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.295526 6269 ts_tablet_manager.cc:1939] T 2eded874aa094054b0c2e7c2e592dba1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.295907 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 777) took 6829 ms. Trace:
I20260928 10:44:15.296051 6269 rpcz_store.cc:276] 0928 10:44:08.466856 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.467216 (+ 360us) service_pool.cc:227] Handling call
0928 10:44:15.151332 (+6684116us) ts_tablet_manager.cc:1145] Deleting tablet 2eded874aa094054b0c2e7c2e592dba1
0928 10:44:15.151343 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.238587 (+ 87244us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.242031 (+ 3444us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.295890 (+ 53859us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6683918}
I20260928 10:44:15.296661 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 796) took 6770 ms. Trace:
I20260928 10:44:15.296794 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 2eded874aa094054b0c2e7c2e592dba1 (table default.Table_a76680616cce463084d329ce2930c487 [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]) successfully deleted
I20260928 10:44:15.296792 6269 rpcz_store.cc:276] 0928 10:44:08.525796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.581160 (+ 55364us) service_pool.cc:227] Handling call
0928 10:44:15.296531 (+6715371us) ts_tablet_manager.cc:1145] Deleting tablet 73c8f859a3ac4a4b89f1bb2929aa3c92
0928 10:44:15.296541 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.296644 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6715205}
W20260928 10:44:15.297415 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73c8f859a3ac4a4b89f1bb2929aa3c92 already in progress: creating tablet
I20260928 10:44:15.297912 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 797) took 6772 ms. Trace:
I20260928 10:44:15.298036 6269 rpcz_store.cc:276] 0928 10:44:08.525871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.581334 (+ 55463us) service_pool.cc:227] Handling call
0928 10:44:15.297788 (+6716454us) ts_tablet_manager.cc:1145] Deleting tablet bc8b8b3a518c42ad9e3c76c9743e361b
0928 10:44:15.297799 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.297894 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6716341}
W20260928 10:44:15.298573 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet bc8b8b3a518c42ad9e3c76c9743e361b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8b8b3a518c42ad9e3c76c9743e361b already in progress: creating tablet
I20260928 10:44:15.298995 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 798) took 6773 ms. Trace:
I20260928 10:44:15.299124 6269 rpcz_store.cc:276] 0928 10:44:08.525936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.581448 (+ 55512us) service_pool.cc:227] Handling call
0928 10:44:15.298876 (+6717428us) ts_tablet_manager.cc:1145] Deleting tablet c90c3e290377422385a15e23a0e7dd9a
0928 10:44:15.298887 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.298978 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6717337}
W20260928 10:44:15.299576 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c90c3e290377422385a15e23a0e7dd9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90c3e290377422385a15e23a0e7dd9a already in progress: creating tablet
I20260928 10:44:15.300002 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 801) took 6773 ms. Trace:
I20260928 10:44:15.300150 6269 rpcz_store.cc:276] 0928 10:44:08.526200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.609442 (+ 83242us) service_pool.cc:227] Handling call
0928 10:44:15.299893 (+6690451us) ts_tablet_manager.cc:1145] Deleting tablet 9a94c95e55fa46d2a8badd9229f55cf7
0928 10:44:15.299904 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.299986 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6690208}
W20260928 10:44:15.300767 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9a94c95e55fa46d2a8badd9229f55cf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a94c95e55fa46d2a8badd9229f55cf7 already in progress: creating tablet
I20260928 10:44:15.302742 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 804) took 6761 ms. Trace:
I20260928 10:44:15.304454 6269 rpcz_store.cc:276] 0928 10:44:08.541278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:08.622542 (+ 81264us) service_pool.cc:227] Handling call
0928 10:44:15.301147 (+6678605us) ts_tablet_manager.cc:1145] Deleting tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d
0928 10:44:15.301160 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.302397 (+ 1237us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6678143}
W20260928 10:44:15.308225 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b2e2fe7f7f34c2a91224c9cb86bb65d already in progress: creating tablet
I20260928 10:44:15.324632 6154 raft_consensus.cc:3037] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.325256 6148 raft_consensus.cc:3037] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.325443 6142 raft_consensus.cc:3037] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.328509 7365 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.328670 7365 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.329301 7365 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.329579 7455 raft_consensus.cc:482] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.329736 7455 raft_consensus.cc:504] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.329847 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.329977 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.330248 5878 raft_consensus.cc:2454] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.330376 7455 leader_election.cc:288] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.330544 7455 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.330690 7455 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.330753 5957 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.331033 7474 raft_consensus.cc:2781] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.331108 7474 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.331166 7474 raft_consensus.cc:3037] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.331156 7455 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.331310 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.331730 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.333945 7474 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:15.336858 6091 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:15.330399 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.340927 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.341952 5881 raft_consensus.cc:2454] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:15.344739 6091 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.348941 7474 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.354776 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.355131 5884 raft_consensus.cc:3037] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.361364 6269 tablet_replica.cc:330] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:15.361716 6269 raft_consensus.cc:2229] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.362011 6269 raft_consensus.cc:2258] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.371688 6269 ts_tablet_manager.cc:1905] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.364853 6273 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:15.374734 6273 ts_tablet_manager.cc:1397] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.434s user 0.007s sys 0.008s
I20260928 10:44:15.376238 6273 raft_consensus.cc:348] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.377697 5884 raft_consensus.cc:2454] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:15.376591 6273 raft_consensus.cc:374] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.378293 6273 raft_consensus.cc:729] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.378337 5957 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.378626 7469 raft_consensus.cc:2781] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.378790 7469 raft_consensus.cc:686] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.379036 7469 consensus_queue.cc:237] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.379073 6273 consensus_queue.cc:260] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.383203 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6eb4514772cd4d52acbd6f76f0dc0304"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.383810 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6eb4514772cd4d52acbd6f76f0dc0304 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.385041 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_953f97aea2a646c58e4604ffbe233e1e" } new_table_name: "default.Table_17dd613f305e45edb706a04a93c7b222" modify_external_catalogs: true
I20260928 10:44:15.388167 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.389539 7490 raft_consensus.cc:482] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.389750 7490 raft_consensus.cc:504] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.390394 7490 leader_election.cc:288] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.390859 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25a2f20766024978a16b6bccd366a848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.391317 5818 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.395246 6273 ts_tablet_manager.cc:1428] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260928 10:44:15.398093 7445 raft_consensus.cc:482] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.398391 7445 raft_consensus.cc:504] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.399384 7445 leader_election.cc:288] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.400144 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.400414 6273 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.400421 5884 raft_consensus.cc:2454] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.401444 5957 leader_election.cc:302] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.406212 6270 ts_tablet_manager.cc:1918] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.407845 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.408247 7445 raft_consensus.cc:2781] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.408358 7445 raft_consensus.cc:482] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.408762 7445 raft_consensus.cc:3037] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:15.409163 5817 leader_election.cc:341] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.409332 5817 leader_election.cc:302] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.409826 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d5121db2d34ea99c851595c395f3be" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.410602 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.410931 7443 raft_consensus.cc:2781] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.408564 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.411638 7445 raft_consensus.cc:504] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.410566 6148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.413892 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc50ec106e9b4137b64bf6ce71487979" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.414865 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.415091 6013 raft_consensus.cc:2454] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:15.415647 5955 consensus_peers.cc:487] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffa971239a2b4ac6bc309dfbacdbe12e. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:15.416608 7365 consensus_queue.cc:1035] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.416992 7365 consensus_queue.cc:1035] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.417299 7365 consensus_queue.cc:1035] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:15.418833 5955 leader_election.cc:341] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.419562 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e1f8a63fed4c82ac95c2fbb7bc633d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.419757 6013 raft_consensus.cc:2454] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
W20260928 10:44:15.421090 5955 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.421376 5955 leader_election.cc:341] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.421586 5955 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.421882 7474 raft_consensus.cc:482] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.422008 7474 raft_consensus.cc:504] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.422567 7474 leader_election.cc:288] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.422712 7474 consensus_queue.cc:1035] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:15.422959 5817 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.423084 5817 leader_election.cc:302] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.423311 7381 raft_consensus.cc:2726] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.423447 7381 raft_consensus.cc:2726] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:15.423729 5817 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.423816 5817 leader_election.cc:302] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.423990 7381 raft_consensus.cc:2726] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:15.424117 5957 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:15.424381 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.425253 6270 log.cc:1196] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9e05cdd590894adcb987ef3ac78bf416
I20260928 10:44:15.426430 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:15.427518 5817 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.427656 5817 leader_election.cc:302] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.427994 7490 raft_consensus.cc:2726] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.428479 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.429078 6271 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.429338 6271 ts_tablet_manager.cc:1397] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.194s user 0.022s sys 0.019s
I20260928 10:44:15.430230 6271 raft_consensus.cc:348] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.430783 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6037e24ee6ba4399b6100ab27c4ed621
I20260928 10:44:15.431269 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 6037e24ee6ba4399b6100ab27c4ed621 deleted and replaced by tablet 45814bb909ed4a15a39a0819973042d2
I20260928 10:44:15.432572 6271 raft_consensus.cc:374] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.432646 6271 raft_consensus.cc:729] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.433096 6271 consensus_queue.cc:260] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.433651 6271 ts_tablet_manager.cc:1428] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:44:15.433905 6271 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.436030 6271 tablet_bootstrap.cc:654] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.436530 6270 ts_tablet_manager.cc:1939] T 9e05cdd590894adcb987ef3ac78bf416 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:15.438297 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 with delete_type TABLET_DATA_DELETED (replaced by tablet 45814bb909ed4a15a39a0819973042d2) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.438582 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.439004 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.439284 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25a2f20766024978a16b6bccd366a848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.439622 7443 raft_consensus.cc:482] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.439764 7443 raft_consensus.cc:3037] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.443003 6271 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.443154 6271 ts_tablet_manager.cc:1397] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260928 10:44:15.443392 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 with delete_type TABLET_DATA_DELETED (replaced by tablet 45814bb909ed4a15a39a0819973042d2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.445278 6271 raft_consensus.cc:348] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.445816 6271 raft_consensus.cc:374] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.446031 6271 raft_consensus.cc:729] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.446677 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 with delete_type TABLET_DATA_DELETED (replaced by tablet 45814bb909ed4a15a39a0819973042d2) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:15.446692 6271 consensus_queue.cc:260] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:15.447500 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6037e24ee6ba4399b6100ab27c4ed621 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6037e24ee6ba4399b6100ab27c4ed621 already in progress: creating tablet
I20260928 10:44:15.447945 6271 ts_tablet_manager.cc:1428] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 10:44:15.448444 6271 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.448824 6273 tablet_bootstrap.cc:654] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.442445 7443 raft_consensus.cc:504] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.449540 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 856) took 4254 ms. Trace:
I20260928 10:44:15.450210 6153 raft_consensus.cc:2379] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate 4dab87557ec9445dbe35ea05e3561a94 in this term.
I20260928 10:44:15.451174 7443 leader_election.cc:288] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.450184 6270 rpcz_store.cc:276] 0928 10:44:11.194795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.199853 (+ 5058us) service_pool.cc:227] Handling call
0928 10:44:15.287618 (+4087765us) ts_tablet_manager.cc:1145] Deleting tablet 9e05cdd590894adcb987ef3ac78bf416
0928 10:44:15.287634 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.352500 (+ 64866us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.403890 (+ 51390us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.449358 (+ 45468us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4087564}
I20260928 10:44:15.452540 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9e05cdd590894adcb987ef3ac78bf416 (table default.Table_9513354e0c5245fb9138ab1c1532f91d [id=762e3b05eb2344508466e80633dced94]) successfully deleted
I20260928 10:44:15.454342 6271 tablet_bootstrap.cc:654] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.454769 7468 raft_consensus.cc:482] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.454918 7468 raft_consensus.cc:504] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.455762 7468 leader_election.cc:288] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:15.454123 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 862) took 4213 ms. Trace:
I20260928 10:44:15.456116 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.456367 5884 raft_consensus.cc:2454] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.456908 5957 leader_election.cc:302] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.457175 7468 raft_consensus.cc:2781] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.457274 7468 raft_consensus.cc:482] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.457345 7468 raft_consensus.cc:3037] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.460132 7468 raft_consensus.cc:504] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.461367 7468 leader_election.cc:288] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:15.461844 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.462055 5884 raft_consensus.cc:3037] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.456280 6270 rpcz_store.cc:276] 0928 10:44:11.240254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.240731 (+ 477us) service_pool.cc:227] Handling call
0928 10:44:15.453078 (+4212347us) ts_tablet_manager.cc:1145] Deleting tablet bc5d744dbc904525858a39c27636443e
0928 10:44:15.453094 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.453942 (+ 848us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4207216}
W20260928 10:44:15.463285 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bc5d744dbc904525858a39c27636443e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5d744dbc904525858a39c27636443e already in progress: creating tablet
I20260928 10:44:15.464143 6269 ts_tablet_manager.cc:1918] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:15.464252 6269 log.cc:1196] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/b6d5121db2d34ea99c851595c395f3be
I20260928 10:44:15.464612 6269 ts_tablet_manager.cc:1939] T b6d5121db2d34ea99c851595c395f3be P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.464704 5884 raft_consensus.cc:2454] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:15.465145 6271 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.465512 6271 ts_tablet_manager.cc:1397] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260928 10:44:15.465737 5957 leader_election.cc:302] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.466584 6271 raft_consensus.cc:348] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.467674 6271 raft_consensus.cc:374] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.467732 7365 raft_consensus.cc:2781] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.468504 7365 raft_consensus.cc:686] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.468529 7438 tablet.cc:1722] T 593015cc3f8547b5a08043d2c016ec91 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:15.468922 7447 tablet.cc:1722] T 593015cc3f8547b5a08043d2c016ec91 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:15.468427 6090 leader_election.cc:302] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.468775 7365 consensus_queue.cc:237] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:15.472960 6090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 44624us
I20260928 10:44:15.473431 7443 raft_consensus.cc:2726] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.474874 6090 leader_election.cc:302] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.475337 7443 raft_consensus.cc:2726] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.477964 6090 leader_election.cc:302] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.478423 6090 leader_election.cc:302] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.478693 7494 raft_consensus.cc:2726] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.478789 6090 leader_election.cc:302] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.478960 7455 raft_consensus.cc:2781] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.479043 7455 raft_consensus.cc:482] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.479100 7455 raft_consensus.cc:3037] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.479585 7494 raft_consensus.cc:2781] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.479697 7494 raft_consensus.cc:482] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.479883 7494 raft_consensus.cc:3037] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.480218 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.480734 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 861) took 4240 ms. Trace:
W20260928 10:44:15.481863 5955 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.483587 6271 raft_consensus.cc:729] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.484017 6271 consensus_queue.cc:260] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.484799 7455 raft_consensus.cc:504] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.480917 6270 rpcz_store.cc:276] 0928 10:44:11.240121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.240899 (+ 778us) service_pool.cc:227] Handling call
0928 10:44:15.463047 (+4222148us) ts_tablet_manager.cc:1145] Deleting tablet ddd0439f5f6d4323978bb5fe2d039f75
0928 10:44:15.480026 (+ 16979us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.480719 (+ 693us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4204439}
I20260928 10:44:15.485342 7455 leader_election.cc:288] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.485435 6271 ts_tablet_manager.cc:1428] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
W20260928 10:44:15.485656 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ddd0439f5f6d4323978bb5fe2d039f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd0439f5f6d4323978bb5fe2d039f75 already in progress: creating tablet
I20260928 10:44:15.486431 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.487596 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 810) took 6508 ms. Trace:
I20260928 10:44:15.490520 6269 rpcz_store.cc:276] 0928 10:44:08.978689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.026562 (+ 47873us) service_pool.cc:227] Handling call
0928 10:44:15.361272 (+6334710us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:15.361306 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.400362 (+ 39056us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.464011 (+ 63649us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.487573 (+ 23562us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6283423}
I20260928 10:44:15.491036 6271 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.492606 6271 tablet_bootstrap.cc:654] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.495666 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 863) took 4230 ms. Trace:
I20260928 10:44:15.495772 6270 rpcz_store.cc:276] 0928 10:44:11.265165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.266056 (+ 891us) service_pool.cc:227] Handling call
0928 10:44:15.485971 (+4219915us) ts_tablet_manager.cc:1145] Deleting tablet 4a5564088c5e45788794f130134b5ba5
0928 10:44:15.495502 (+ 9531us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.495641 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4219730}
W20260928 10:44:15.496297 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4a5564088c5e45788794f130134b5ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a5564088c5e45788794f130134b5ba5 already in progress: creating tablet
I20260928 10:44:15.497597 6150 raft_consensus.cc:3037] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.498035 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 864) took 4183 ms. Trace:
I20260928 10:44:15.498930 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:15.498157 6270 rpcz_store.cc:276] 0928 10:44:11.315055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.315472 (+ 417us) service_pool.cc:227] Handling call
0928 10:44:15.497889 (+4182417us) ts_tablet_manager.cc:1145] Deleting tablet 88f81c47745142568f7a4dd30d468220
0928 10:44:15.497901 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.498010 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4182199}
W20260928 10:44:15.499635 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 88f81c47745142568f7a4dd30d468220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88f81c47745142568f7a4dd30d468220 already in progress: creating tablet
W20260928 10:44:15.499696 5955 leader_election.cc:341] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:15.499794 5955 leader_election.cc:302] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:15.500586 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 865) took 4086 ms. Trace:
I20260928 10:44:15.500615 7469 raft_consensus.cc:2726] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 10:44:15.501214 5955 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.502144 5955 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.501405 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e1f8a63fed4c82ac95c2fbb7bc633d" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.502560 6013 raft_consensus.cc:3037] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.505416 6013 raft_consensus.cc:2454] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:15.506188 6144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c1a1c5e22e455d91de92f0aa3535c7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.506283 6090 leader_election.cc:302] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:15.506735 5955 leader_election.cc:341] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.507135 6270 rpcz_store.cc:276] 0928 10:44:11.414441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.414523 (+ 82us) service_pool.cc:227] Handling call
0928 10:44:15.500460 (+4085937us) ts_tablet_manager.cc:1145] Deleting tablet b6bf7ae81883467095a04ff22fe0c7f8
0928 10:44:15.500472 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.500564 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4085712}
I20260928 10:44:15.507345 7455 raft_consensus.cc:2781] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.507606 7455 raft_consensus.cc:686] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.507916 7455 consensus_queue.cc:237] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.488001 7494 raft_consensus.cc:504] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:15.509631 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b6bf7ae81883467095a04ff22fe0c7f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6bf7ae81883467095a04ff22fe0c7f8 already in progress: creating tablet
I20260928 10:44:15.510102 6270 tablet_replica.cc:330] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:15.510742 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet b6d5121db2d34ea99c851595c395f3be (table default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]) successfully deleted
I20260928 10:44:15.511036 6270 raft_consensus.cc:2229] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.511224 6269 tablet_replica.cc:330] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:15.511680 6269 raft_consensus.cc:2229] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.512079 6270 raft_consensus.cc:2258] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.512521 6269 raft_consensus.cc:2258] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.513219 6270 ts_tablet_manager.cc:1905] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.513230 7490 raft_consensus.cc:482] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.513669 7490 raft_consensus.cc:504] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.514276 7490 leader_election.cc:288] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.514700 6269 ts_tablet_manager.cc:1905] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.516770 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.517422 5818 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.534098 7494 leader_election.cc:288] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.534735 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44bc6831f9354ddb81212bc107efdf68" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.534957 6013 raft_consensus.cc:3037] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.537569 6013 raft_consensus.cc:2454] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:15.538338 6090 leader_election.cc:302] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:15.538792 7494 raft_consensus.cc:2781] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.539027 7494 raft_consensus.cc:686] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.539429 6275 tablet_bootstrap.cc:492] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:15.539564 6275 ts_tablet_manager.cc:1397] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.379s user 0.005s sys 0.007s
I20260928 10:44:15.539347 7494 consensus_queue.cc:237] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.541086 6275 raft_consensus.cc:348] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.545751 7445 leader_election.cc:288] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.546391 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d22260b5f20d47ad99d612ed5a7c022c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.546657 5884 raft_consensus.cc:3037] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:15.548921 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 (table default.Table_bd415a38e4344ac0a4f2bfb479d01b58 [id=01274b7dde224a98ae1da73c01701045], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 consensus state has no leader
I20260928 10:44:15.549448 5884 raft_consensus.cc:2454] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:15.550177 5957 leader_election.cc:302] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.555644 7469 raft_consensus.cc:2781] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.555801 7469 raft_consensus.cc:686] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.556032 7469 consensus_queue.cc:237] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.557108 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5fad44d7253f493788268121109a5671" } modify_external_catalogs: true
I20260928 10:44:15.557343 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5fad44d7253f493788268121109a5671" } modify_external_catalogs: true
I20260928 10:44:15.557928 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1e683ae5f18643d0ab62f09323a0b6e2" } new_table_name: "default.Table_fdf4f0f1779b41c1810a5abed52b624e" modify_external_catalogs: true
I20260928 10:44:15.559100 7490 raft_consensus.cc:482] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.559252 7490 raft_consensus.cc:504] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.559867 7490 leader_election.cc:288] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.560382 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.560945 5818 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.566393 7490 raft_consensus.cc:482] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.566589 7490 raft_consensus.cc:504] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.567239 7490 leader_election.cc:288] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.567747 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.568408 5818 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.569240 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:15.570889 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db62e1bb84fe46c0815e12dfbac03c3a consensus state has no leader
I20260928 10:44:15.572808 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9320d3128971494699408a9aada2c5ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.573395 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9320d3128971494699408a9aada2c5ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.577836 6275 raft_consensus.cc:374] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.578032 6275 raft_consensus.cc:729] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.578326 6275 consensus_queue.cc:260] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.578941 6275 ts_tablet_manager.cc:1428] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260928 10:44:15.579245 6275 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:15.581444 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b5a6d41f4804a04804e4c52ceda0f74 has no consensus state
I20260928 10:44:15.583418 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_681e7c813bba489da7db3c3fcc2407bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.583963 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_681e7c813bba489da7db3c3fcc2407bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.573666 7535 tablet.cc:1722] T 593015cc3f8547b5a08043d2c016ec91 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:15.590291 6275 tablet_bootstrap.cc:654] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:15.593918 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 consensus state has no leader
I20260928 10:44:15.590727 7536 tablet.cc:1722] T 3168fb311ee64931bd326b043a397ea1 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:15.602090 6271 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.602244 6271 ts_tablet_manager.cc:1397] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.011s
I20260928 10:44:15.602983 6271 raft_consensus.cc:348] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.603219 6271 raft_consensus.cc:374] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.603269 6271 raft_consensus.cc:729] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.603453 6271 consensus_queue.cc:260] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.604004 6271 ts_tablet_manager.cc:1428] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:15.604264 6271 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.607998 6273 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:15.608162 6273 ts_tablet_manager.cc:1397] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.208s user 0.006s sys 0.009s
I20260928 10:44:15.608843 6273 raft_consensus.cc:348] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.609076 6273 raft_consensus.cc:374] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.609131 6273 raft_consensus.cc:729] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.609326 6273 consensus_queue.cc:260] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.613099 6273 ts_tablet_manager.cc:1428] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 10:44:15.614415 6273 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.616132 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e2f20bc701dc4831bb6f8585b1aaa29c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.616794 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2f20bc701dc4831bb6f8585b1aaa29c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.618155 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8bef3f43e8474ffdae2e4a41ced429df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.618741 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bef3f43e8474ffdae2e4a41ced429df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.620016 6273 tablet_bootstrap.cc:654] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.630829 6273 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:15.631000 6273 ts_tablet_manager.cc:1397] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20260928 10:44:15.631886 6273 raft_consensus.cc:348] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.632166 6273 raft_consensus.cc:374] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.632223 6273 raft_consensus.cc:729] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.632423 6273 consensus_queue.cc:260] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.633054 6273 ts_tablet_manager.cc:1428] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:15.633354 6273 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.635757 6273 tablet_bootstrap.cc:654] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.636762 7536 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 10:44:15.638872 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 914ea799da554974960e7bf142a407b1 consensus state has no leader
I20260928 10:44:15.639261 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet c1a659100a124506a411c929ddc31f10 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:15.639961 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dd052dd428ef430f9974abef93a23742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.640587 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd052dd428ef430f9974abef93a23742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.644006 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eb68eaf68a9f47efba2de9cb77271827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.644668 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb68eaf68a9f47efba2de9cb77271827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.645413 7490 raft_consensus.cc:482] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.645553 7490 raft_consensus.cc:504] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:15.646128 7490 leader_election.cc:288] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:15.646814 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.647403 5818 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.654914 5817 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.655086 5817 leader_election.cc:302] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.655344 7490 raft_consensus.cc:2726] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:15.655807 5817 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.655931 5817 leader_election.cc:302] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.656276 7490 raft_consensus.cc:2726] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.668982 6271 tablet_bootstrap.cc:654] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.681069 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bdcfca3d91844b9c9defbe8d1d008484" } modify_external_catalogs: true
I20260928 10:44:15.681296 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bdcfca3d91844b9c9defbe8d1d008484" } modify_external_catalogs: true
W20260928 10:44:15.684402 5817 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.684540 5817 leader_election.cc:302] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.684784 7490 raft_consensus.cc:2726] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.686093 6273 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:15.686208 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d3985cb736ef4d5ea6c413cd992d0f34" } modify_external_catalogs: true
I20260928 10:44:15.686385 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d3985cb736ef4d5ea6c413cd992d0f34" } modify_external_catalogs: true
I20260928 10:44:15.686458 6273 ts_tablet_manager.cc:1397] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260928 10:44:15.687403 6273 raft_consensus.cc:348] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.687668 6273 raft_consensus.cc:374] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.687770 6273 raft_consensus.cc:729] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.688045 6273 consensus_queue.cc:260] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.688323 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a00a2c4692459cbdd0628af0184f09" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.688549 5884 raft_consensus.cc:2379] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:15.688815 6273 ts_tablet_manager.cc:1428] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:15.689143 6273 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.690793 6273 tablet_bootstrap.cc:654] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.693099 6275 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:15.693291 6275 ts_tablet_manager.cc:1397] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.009s
I20260928 10:44:15.694031 6275 raft_consensus.cc:348] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.694300 6275 raft_consensus.cc:374] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.694396 6275 raft_consensus.cc:729] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.694687 6275 consensus_queue.cc:260] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.695397 6275 ts_tablet_manager.cc:1428] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:15.695731 6275 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:15.699429 6275 tablet_bootstrap.cc:654] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.687039 6271 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.710759 6271 ts_tablet_manager.cc:1397] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.008s
I20260928 10:44:15.711663 6271 raft_consensus.cc:348] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.711913 6271 raft_consensus.cc:374] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.711966 6271 raft_consensus.cc:729] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.712177 6271 consensus_queue.cc:260] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.712756 6271 ts_tablet_manager.cc:1428] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:15.713040 6271 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.670466 6270 ts_tablet_manager.cc:1918] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.713919 6270 log.cc:1196] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9f2c5590c0fd47fdbf44e5217b8d0be6
I20260928 10:44:15.714279 6270 ts_tablet_manager.cc:1939] T 9f2c5590c0fd47fdbf44e5217b8d0be6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:15.714730 6271 tablet_bootstrap.cc:654] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.720394 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 866) took 4292 ms. Trace:
I20260928 10:44:15.720523 6270 rpcz_store.cc:276] 0928 10:44:11.428360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.428417 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:15.510040 (+4081623us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5590c0fd47fdbf44e5217b8d0be6
0928 10:44:15.510052 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.521702 (+ 11650us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.670351 (+148649us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.720366 (+ 50015us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4081387}
I20260928 10:44:15.721062 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9f2c5590c0fd47fdbf44e5217b8d0be6 (table default.Table_fb25cc33ccfb474ca51b0db8e1b167f7 [id=620121bbc5c641b792d823560616b120]) successfully deleted
I20260928 10:44:15.724134 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0df7a20f80d44aa9817bbe59ae3a0888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.724841 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0df7a20f80d44aa9817bbe59ae3a0888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.731428 6271 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.731681 6271 ts_tablet_manager.cc:1397] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260928 10:44:15.732546 6271 raft_consensus.cc:348] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.732867 6271 raft_consensus.cc:374] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.732988 6271 raft_consensus.cc:729] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.733332 6271 consensus_queue.cc:260] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.734607 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3bbdfde366124ee2b57a8e1eaca2e658" } modify_external_catalogs: true
I20260928 10:44:15.734833 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3bbdfde366124ee2b57a8e1eaca2e658" } modify_external_catalogs: true
I20260928 10:44:15.733449 6270 tablet_replica.cc:330] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:15.733989 6271 ts_tablet_manager.cc:1428] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:15.735934 6270 raft_consensus.cc:2229] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.736123 6271 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.737329 6270 raft_consensus.cc:2258] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.739878 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_10db3860b70e4b5ba9d48103a5772cc2" } modify_external_catalogs: true
I20260928 10:44:15.740097 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_10db3860b70e4b5ba9d48103a5772cc2" } modify_external_catalogs: true
I20260928 10:44:15.738818 6271 tablet_bootstrap.cc:654] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.749743 6270 ts_tablet_manager.cc:1905] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.751582 5700 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 14e5ac71c56143848336769c1602fdf0
I20260928 10:44:15.752023 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2df45c20e4924018a625dfdac71f1560" } new_table_name: "default.Table_f4c52cb7dec54b089da45cb49733dd44" modify_external_catalogs: true
I20260928 10:44:15.761548 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae29b7319f547f38e0e9c3f8639ef5a (DEFAULT_TABLE table=default.Table_c22c186f038a4468a6683ce26452d411 [id=e2bc80f7fbd04b7587f3e6d11399e554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.762012 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae29b7319f547f38e0e9c3f8639ef5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.769982 6271 tablet_bootstrap.cc:492] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.770272 6271 ts_tablet_manager.cc:1397] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.000s
I20260928 10:44:15.771097 6271 raft_consensus.cc:348] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.771375 6271 raft_consensus.cc:374] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.771459 6271 raft_consensus.cc:729] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.771745 6271 consensus_queue.cc:260] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.772430 6271 ts_tablet_manager.cc:1428] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:15.772744 6271 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.772351 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae29b7319f547f38e0e9c3f8639ef5a (DEFAULT_TABLE table=default.Table_c22c186f038a4468a6683ce26452d411 [id=e2bc80f7fbd04b7587f3e6d11399e554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.774346 6271 tablet_bootstrap.cc:654] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.774647 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae29b7319f547f38e0e9c3f8639ef5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.779001 6269 ts_tablet_manager.cc:1918] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.780526 7455 raft_consensus.cc:482] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.780671 7455 raft_consensus.cc:504] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.780947 6269 log.cc:1196] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/16510244612242f796910cf28e367da9
I20260928 10:44:15.781306 7455 leader_election.cc:288] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.781967 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.782219 6013 raft_consensus.cc:2454] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:15.782723 6090 leader_election.cc:302] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:15.783059 7455 raft_consensus.cc:2781] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.783146 7455 raft_consensus.cc:482] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.783198 7455 raft_consensus.cc:3037] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.785531 7455 raft_consensus.cc:504] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.785565 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae29b7319f547f38e0e9c3f8639ef5a (DEFAULT_TABLE table=default.Table_c22c186f038a4468a6683ce26452d411 [id=e2bc80f7fbd04b7587f3e6d11399e554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.785941 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae29b7319f547f38e0e9c3f8639ef5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.786708 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.786926 6013 raft_consensus.cc:3037] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.789323 6013 raft_consensus.cc:2454] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:15.791925 6090 leader_election.cc:302] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:15.792222 7494 raft_consensus.cc:2781] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.792331 7494 raft_consensus.cc:686] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.792533 7494 consensus_queue.cc:237] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.792604 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 4297f5d615074e28965ea88204aa007c (DEFAULT_TABLE table=default.Table_833e6a9969bb4181a615685d78f21112 [id=6f12317ff4b34848903b0e8e9b171d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.792979 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4297f5d615074e28965ea88204aa007c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.794577 7455 leader_election.cc:288] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.799352 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.808333 6271 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.808549 6271 ts_tablet_manager.cc:1397] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260928 10:44:15.808482 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 4297f5d615074e28965ea88204aa007c (DEFAULT_TABLE table=default.Table_833e6a9969bb4181a615685d78f21112 [id=6f12317ff4b34848903b0e8e9b171d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.809070 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4297f5d615074e28965ea88204aa007c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.809469 6271 raft_consensus.cc:348] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.809756 6271 raft_consensus.cc:374] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.809861 6271 raft_consensus.cc:729] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.810127 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.810101 6271 consensus_queue.cc:260] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.810710 6271 ts_tablet_manager.cc:1428] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:15.810994 6271 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.812041 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae85d945b0242c289e2e930d1485758 (DEFAULT_TABLE table=default.Table_bbdcc310aed44e3688cf170f1d20ea55 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.812477 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae85d945b0242c289e2e930d1485758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.812565 6271 tablet_bootstrap.cc:654] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.814215 6269 ts_tablet_manager.cc:1939] T 16510244612242f796910cf28e367da9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.815251 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 809) took 6837 ms. Trace:
I20260928 10:44:15.816617 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.817727 6271 tablet_bootstrap.cc:492] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.817687 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.817929 6271 ts_tablet_manager.cc:1397] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260928 10:44:15.819587 6271 raft_consensus.cc:348] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.819825 6271 raft_consensus.cc:374] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.819902 6271 raft_consensus.cc:729] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:15.819173 5817 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.820101 5817 leader_election.cc:302] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.820129 6271 consensus_queue.cc:260] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.820453 7490 raft_consensus.cc:2726] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.819342 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.819780 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f29acce3604e458d1981aad87f2eb9" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.820624 6271 ts_tablet_manager.cc:1428] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 10:44:15.820649 5881 raft_consensus.cc:2454] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:15.820915 6271 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.821152 6269 rpcz_store.cc:276] 0928 10:44:08.978130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.026817 (+ 48687us) service_pool.cc:227] Handling call
0928 10:44:15.510466 (+6483649us) ts_tablet_manager.cc:1145] Deleting tablet 16510244612242f796910cf28e367da9
0928 10:44:15.511176 (+ 710us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.607313 (+ 96137us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.778899 (+171586us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.815232 (+ 36333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6483427}
I20260928 10:44:15.822403 6271 tablet_bootstrap.cc:654] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.822897 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 16510244612242f796910cf28e367da9 (table default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]) successfully deleted
W20260928 10:44:15.824394 5817 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.824510 5817 leader_election.cc:302] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.824833 7490 raft_consensus.cc:2726] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.825171 6269 tablet_replica.cc:330] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:15.826319 5817 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.826428 5817 leader_election.cc:302] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.826786 7490 raft_consensus.cc:2726] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.827309 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 4297f5d615074e28965ea88204aa007c (DEFAULT_TABLE table=default.Table_833e6a9969bb4181a615685d78f21112 [id=6f12317ff4b34848903b0e8e9b171d34]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:15.828303 5817 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.828406 5817 leader_election.cc:302] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.828557 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae85d945b0242c289e2e930d1485758 (DEFAULT_TABLE table=default.Table_bbdcc310aed44e3688cf170f1d20ea55 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.829025 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae85d945b0242c289e2e930d1485758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.830682 7490 raft_consensus.cc:2726] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.832501 6269 raft_consensus.cc:2229] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.836382 7438 tablet.cc:1722] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:15.836824 7447 tablet.cc:1722] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:15.837684 6269 raft_consensus.cc:2258] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.837818 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae85d945b0242c289e2e930d1485758 (DEFAULT_TABLE table=default.Table_bbdcc310aed44e3688cf170f1d20ea55 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.838227 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae85d945b0242c289e2e930d1485758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.838732 6271 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.838892 6271 ts_tablet_manager.cc:1397] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260928 10:44:15.839675 6271 raft_consensus.cc:348] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.839917 6271 raft_consensus.cc:374] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.840018 6271 raft_consensus.cc:729] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.840236 6271 consensus_queue.cc:260] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.842546 6269 ts_tablet_manager.cc:1905] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:15.846510 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 81481.1us
I20260928 10:44:15.846845 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4297f5d615074e28965ea88204aa007c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.849730 7536 tablet.cc:1722] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:15.838809 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 52811a69061f40f9b2bf7b148362c78d (DEFAULT_TABLE table=default.Table_da36fa7394844e8ea5977ef66e6879b2 [id=72c70af203e3405a95ad5783b8e568ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.851284 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52811a69061f40f9b2bf7b148362c78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.851470 6271 ts_tablet_manager.cc:1428] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260928 10:44:15.851830 6271 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:15.852492 7438 tablet.cc:1717] T 3c957158dbd949e88554e70fe6146089 P 2f6ffbf4f0534383bf89d15aa37e3027: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:15.853462 6271 tablet_bootstrap.cc:654] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.857748 7447 tablet.cc:1717] T 3c957158dbd949e88554e70fe6146089 P ab770e77cb704ea38b5ca8cff97dc73b: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:15.860042 6273 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:15.860345 6275 tablet_bootstrap.cc:492] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:15.860549 6275 ts_tablet_manager.cc:1397] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.165s user 0.026s sys 0.018s
I20260928 10:44:15.860759 6273 ts_tablet_manager.cc:1397] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.172s user 0.007s sys 0.040s
I20260928 10:44:15.861523 6275 raft_consensus.cc:348] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.862442 6273 raft_consensus.cc:348] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.862767 6275 raft_consensus.cc:374] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.862880 6273 raft_consensus.cc:374] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:15.862983 6275 raft_consensus.cc:729] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.863130 6273 raft_consensus.cc:729] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:15.863351 7455 raft_consensus.cc:482] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.863529 7536 tablet.cc:1717] T 3c957158dbd949e88554e70fe6146089 P 4dab87557ec9445dbe35ea05e3561a94: Skipping requested alter to schema version 3, tablet already version 3
I20260928 10:44:15.863461 7455 raft_consensus.cc:504] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.863514 6275 consensus_queue.cc:260] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:15.863816 6273 consensus_queue.cc:260] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.864054 7455 leader_election.cc:288] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.864809 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.865042 6013 raft_consensus.cc:2454] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:15.865525 6090 leader_election.cc:302] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:15.865787 7443 raft_consensus.cc:2781] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.865851 7443 raft_consensus.cc:482] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.865899 7443 raft_consensus.cc:3037] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.868371 7443 raft_consensus.cc:504] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.868940 7443 leader_election.cc:288] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.838915 6091 leader_election.cc:302] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:15.870229 6091 leader_election.cc:341] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:15.870463 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:15.870683 6013 raft_consensus.cc:3037] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.873318 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 0b79696d384f426181caac9a7c20273b (DEFAULT_TABLE table=default.Table_9fbab8d6361e4b5c911c8025224cec8f [id=55344d03455740a6b888a607ff233b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.873759 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b79696d384f426181caac9a7c20273b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.874159 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 5640b425dd9945539dbdf658994c7918 (DEFAULT_TABLE table=default.Table_bef25f1d1cbf4967b518fdda6253dfe3 [id=4bbf261621734febb112f8a3691ea0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.874374 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 52811a69061f40f9b2bf7b148362c78d (DEFAULT_TABLE table=default.Table_da36fa7394844e8ea5977ef66e6879b2 [id=72c70af203e3405a95ad5783b8e568ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.874533 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5640b425dd9945539dbdf658994c7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.874817 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4 (DEFAULT_TABLE table=default.Table_91563e9fb1494076938af89a1515a23a [id=507250db03fe44179ed5d146f369f6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.875128 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.878756 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4 (DEFAULT_TABLE table=default.Table_91563e9fb1494076938af89a1515a23a [id=507250db03fe44179ed5d146f369f6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.879115 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.881016 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 5640b425dd9945539dbdf658994c7918 (DEFAULT_TABLE table=default.Table_bef25f1d1cbf4967b518fdda6253dfe3 [id=4bbf261621734febb112f8a3691ea0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.881319 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5640b425dd9945539dbdf658994c7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.882762 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 0b79696d384f426181caac9a7c20273b (DEFAULT_TABLE table=default.Table_9fbab8d6361e4b5c911c8025224cec8f [id=55344d03455740a6b888a607ff233b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.883103 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b79696d384f426181caac9a7c20273b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.886632 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 8b67c64d751a4118babeaac6ca19e2f7 (DEFAULT_TABLE table=default.Table_b155950aea474e6183a91c170817945b [id=dc4742d02cf848f0b12554ad8a3c7b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.886933 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b67c64d751a4118babeaac6ca19e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.887585 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5a6d41f4804a04804e4c52ceda0f74 (DEFAULT_TABLE table=default.Table_d8e6782bc6994b32b03164e6193a10dc [id=46f1086e15184d73a804edc8f57dbdaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.887856 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5a6d41f4804a04804e4c52ceda0f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.890787 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 8b67c64d751a4118babeaac6ca19e2f7 (DEFAULT_TABLE table=default.Table_b155950aea474e6183a91c170817945b [id=dc4742d02cf848f0b12554ad8a3c7b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.891147 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b67c64d751a4118babeaac6ca19e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.893143 6269 ts_tablet_manager.cc:1918] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.893720 6269 log.cc:1196] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/67f29acce3604e458d1981aad87f2eb9
I20260928 10:44:15.895499 6269 ts_tablet_manager.cc:1939] T 67f29acce3604e458d1981aad87f2eb9 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.896557 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 0b79696d384f426181caac9a7c20273b (DEFAULT_TABLE table=default.Table_9fbab8d6361e4b5c911c8025224cec8f [id=55344d03455740a6b888a607ff233b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.896503 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4 (DEFAULT_TABLE table=default.Table_91563e9fb1494076938af89a1515a23a [id=507250db03fe44179ed5d146f369f6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.896670 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 5640b425dd9945539dbdf658994c7918 (DEFAULT_TABLE table=default.Table_bef25f1d1cbf4967b518fdda6253dfe3 [id=4bbf261621734febb112f8a3691ea0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.896854 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 8b67c64d751a4118babeaac6ca19e2f7 (DEFAULT_TABLE table=default.Table_b155950aea474e6183a91c170817945b [id=dc4742d02cf848f0b12554ad8a3c7b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.897161 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b79696d384f426181caac9a7c20273b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.897394 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b67c64d751a4118babeaac6ca19e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.898633 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52811a69061f40f9b2bf7b148362c78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.901153 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5640b425dd9945539dbdf658994c7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.905807 7168 raft_consensus.cc:482] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.905966 7168 raft_consensus.cc:504] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.907078 7168 leader_election.cc:288] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.873015 6013 raft_consensus.cc:2454] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:15.907557 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.907785 5884 raft_consensus.cc:2454] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:15.907924 7443 raft_consensus.cc:2726] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.908361 6090 leader_election.cc:302] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:15.908596 5957 leader_election.cc:302] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:15.908687 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d991dcc6f142c5ad11c27f6eb0bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.908800 7443 raft_consensus.cc:2781] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.908836 7168 raft_consensus.cc:2781] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:15.908924 7168 raft_consensus.cc:482] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:15.908926 7443 raft_consensus.cc:686] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:15.909003 7168 raft_consensus.cc:3037] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.908946 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.909157 7443 consensus_queue.cc:237] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.911504 7168 raft_consensus.cc:504] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.912457 7168 leader_election.cc:288] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.913046 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.913249 5884 raft_consensus.cc:3037] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:15.916519 5955 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.916815 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6db38f77f64cfe9a7802d5307aa949" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:15.916940 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 46714.3us
W20260928 10:44:15.917204 6091 leader_election.cc:341] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:15.917393 5884 raft_consensus.cc:2454] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:15.920792 5955 leader_election.cc:341] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.924156 6013 raft_consensus.cc:1261] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: Refusing update from remote peer 4dab87557ec9445dbe35ea05e3561a94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 10:44:15.924428 6013 pending_rounds.cc:76] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting all ops after (but not including) 0
I20260928 10:44:15.924569 6013 pending_rounds.cc:97] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 10:44:15.924813 6013 raft_consensus.cc:2866] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 10:44:15.925563 7455 consensus_queue.cc:1035] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:15.933430 7455 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.933625 7455 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.934240 7455 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:15.942368 6275 ts_tablet_manager.cc:1428] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20260928 10:44:15.942802 7490 raft_consensus.cc:482] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.942780 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.942939 7490 raft_consensus.cc:504] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.943318 7381 raft_consensus.cc:482] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:15.943440 7381 raft_consensus.cc:504] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.943536 7490 leader_election.cc:288] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.943953 7381 leader_election.cc:288] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.944242 5957 leader_election.cc:302] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:15.944540 7168 raft_consensus.cc:2781] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:15.944690 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.944770 7168 raft_consensus.cc:686] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:15.944867 5884 raft_consensus.cc:2454] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:15.945115 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9956318fe8ef4d1cbc92eda9caa98602" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:15.945036 7168 consensus_queue.cc:237] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:15.945261 5878 raft_consensus.cc:3037] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:15.948130 5878 raft_consensus.cc:2454] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:15.948788 6273 ts_tablet_manager.cc:1428] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.087s user 0.002s sys 0.000s
I20260928 10:44:15.949087 6273 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:15.950587 6275 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:15.949406 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 821) took 6836 ms. Trace:
I20260928 10:44:15.951131 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d762e03b384d85b4e04be8331474a4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:15.952553 6269 rpcz_store.cc:276] 0928 10:44:09.112918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.112969 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:15.823749 (+6710780us) ts_tablet_manager.cc:1145] Deleting tablet 67f29acce3604e458d1981aad87f2eb9
0928 10:44:15.823938 (+ 189us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.875046 (+ 51108us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.892755 (+ 17709us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.949384 (+ 56629us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44262,"tablet-delete.queue_time_us":6710385}
I20260928 10:44:15.952972 6269 tablet_replica.cc:330] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:15.953161 6269 raft_consensus.cc:2229] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.953243 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 67f29acce3604e458d1981aad87f2eb9 (table default.Table_a766cb0490244b6794f67a154e92eb96 [id=ae18f339d30546ddad1a25f939345b78]) successfully deleted
I20260928 10:44:15.953325 6269 raft_consensus.cc:2258] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.953351 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:15.953926 6269 ts_tablet_manager.cc:1905] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:15.954262 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:15.954632 5818 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:15.955050 5957 consensus_peers.cc:487] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2eded874aa094054b0c2e7c2e592dba1. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:15.955276 5818 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:15.955428 5878 raft_consensus.cc:2379] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:15.947304 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:15.958084 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5a6d41f4804a04804e4c52ceda0f74 (DEFAULT_TABLE table=default.Table_d8e6782bc6994b32b03164e6193a10dc [id=46f1086e15184d73a804edc8f57dbdaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.958568 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5a6d41f4804a04804e4c52ceda0f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.962061 6269 ts_tablet_manager.cc:1918] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:15.962294 6269 log.cc:1196] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/45a00a2c4692459cbdd0628af0184f09
I20260928 10:44:15.962677 6269 ts_tablet_manager.cc:1939] T 45a00a2c4692459cbdd0628af0184f09 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:15.963045 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 820) took 6850 ms. Trace:
I20260928 10:44:15.963208 6269 rpcz_store.cc:276] 0928 10:44:09.112776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.112944 (+ 168us) service_pool.cc:227] Handling call
0928 10:44:15.952925 (+6839981us) ts_tablet_manager.cc:1145] Deleting tablet 45a00a2c4692459cbdd0628af0184f09
0928 10:44:15.952936 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.958742 (+ 5806us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.961972 (+ 3230us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.963026 (+ 1054us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6835554}
I20260928 10:44:15.963788 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 45a00a2c4692459cbdd0628af0184f09 (table default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]) successfully deleted
I20260928 10:44:15.964270 6269 tablet_replica.cc:330] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:15.964533 6269 raft_consensus.cc:2229] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:15.964767 6269 raft_consensus.cc:2258] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:15.965369 6269 ts_tablet_manager.cc:1905] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:15.966552 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cda7121a474493ea13937ffa5004bb9 consensus state has no leader
I20260928 10:44:15.967049 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_433c4dbf74304d2bbfb69b9fb75ac08a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.967777 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_433c4dbf74304d2bbfb69b9fb75ac08a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.968379 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5a6d41f4804a04804e4c52ceda0f74 (DEFAULT_TABLE table=default.Table_d8e6782bc6994b32b03164e6193a10dc [id=46f1086e15184d73a804edc8f57dbdaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.968626 5994 tablet_service.cc:1467] Processing CreateTablet for tablet d998e26f6eaf4edb8bd463954eedf745 (DEFAULT_TABLE table=default.Table_763294cebd5a42a0b63f77c38ccd2663 [id=a14078a9022646c59b7ce5973d41cb67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.968932 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5a6d41f4804a04804e4c52ceda0f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.968998 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d998e26f6eaf4edb8bd463954eedf745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.972846 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 50d66d697f2740a98138a08fc6ef9b60
I20260928 10:44:15.973474 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_390c5c14b5094f9b85d960886548562f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:15.974089 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_390c5c14b5094f9b85d960886548562f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:15.975684 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:15.976511 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:15.977026 6122 tablet_service.cc:1467] Processing CreateTablet for tablet d998e26f6eaf4edb8bd463954eedf745 (DEFAULT_TABLE table=default.Table_763294cebd5a42a0b63f77c38ccd2663 [id=a14078a9022646c59b7ce5973d41cb67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.977444 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d998e26f6eaf4edb8bd463954eedf745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:15.978271 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d66d697f2740a98138a08fc6ef9b60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:15.988112 6273 tablet_bootstrap.cc:654] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:15.990674 6270 ts_tablet_manager.cc:1918] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:15.992712 5862 tablet_service.cc:1467] Processing CreateTablet for tablet d998e26f6eaf4edb8bd463954eedf745 (DEFAULT_TABLE table=default.Table_763294cebd5a42a0b63f77c38ccd2663 [id=a14078a9022646c59b7ce5973d41cb67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:15.994361 5851 tablet_service.cc:1467] Processing CreateTablet for tablet c0f3216655cc4c7f8fff383bb1f22740 (DEFAULT_TABLE table=default.Table_3c20aca5a38e43809461b0427df9b5f3 [id=329a8efe2b21431eb330b99f7886ac29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.002465 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f3216655cc4c7f8fff383bb1f22740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.004818 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19
I20260928 10:44:16.005581 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5d2ec8c1f2634e4bb1e6d2991bdab314" } new_table_name: "default.Table_00f1b1fb917e465aa505a76dd09873e3" modify_external_catalogs: true
I20260928 10:44:16.006956 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d998e26f6eaf4edb8bd463954eedf745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.008553 7381 raft_consensus.cc:482] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.008693 7381 raft_consensus.cc:504] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.009325 7381 leader_election.cc:288] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:15.992028 6271 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:15.993544 5994 tablet_service.cc:1467] Processing CreateTablet for tablet c0f3216655cc4c7f8fff383bb1f22740 (DEFAULT_TABLE table=default.Table_3c20aca5a38e43809461b0427df9b5f3 [id=329a8efe2b21431eb330b99f7886ac29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.016896 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.016896 6131 tablet_service.cc:1467] Processing CreateTablet for tablet c0f3216655cc4c7f8fff383bb1f22740 (DEFAULT_TABLE table=default.Table_3c20aca5a38e43809461b0427df9b5f3 [id=329a8efe2b21431eb330b99f7886ac29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.017323 6135 tablet_service.cc:1467] Processing CreateTablet for tablet eaebc067027e4151b8a46eac9d31b05b (DEFAULT_TABLE table=default.Table_fdda0fc49458417eaecd5e00951687e9 [id=981b245e4a28472cb1bdf5e2eefafa94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.017347 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f3216655cc4c7f8fff383bb1f22740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.016927 7556 raft_consensus.cc:482] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.017642 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaebc067027e4151b8a46eac9d31b05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.017601 6091 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:16.017628 7556 raft_consensus.cc:504] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.018428 7556 leader_election.cc:288] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.018591 7556 raft_consensus.cc:3037] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.019400 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd65a860b00d4a7ba8ae92dde5818212" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.019932 5817 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.020073 5817 leader_election.cc:302] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.020426 7381 raft_consensus.cc:2726] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.022086 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.022282 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:16.023406 5817 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.023837 7556 raft_consensus.cc:2726] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:15.996978 6069 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
W20260928 10:44:16.024101 5817 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.024194 5817 leader_election.cc:302] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.024590 7381 raft_consensus.cc:2726] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:16.025025 6091 consensus_peers.cc:487] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16510244612242f796910cf28e367da9. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:16.025338 6091 consensus_peers.cc:487] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:16.025782 6091 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:16.024190 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.031868 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6026e5e88aba49ef8dbe476f7a0bb0f9
I20260928 10:44:16.032394 5696 catalog_manager.cc:6565] ReplaceTablet: tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 deleted and replaced by tablet ab30bcc780e14445b04fe9ffa7678a0d
I20260928 10:44:16.032666 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 7db49404752e4501a594608fc325ebe9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:16.033267 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_84e9d3f88eec46678082f982b74ca6bf" } new_table_name: "default.Table_7b74e902a0a44f6d8518ac38ad0cd9dd" modify_external_catalogs: true
I20260928 10:44:16.038060 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 with delete_type TABLET_DATA_DELETED (replaced by tablet ab30bcc780e14445b04fe9ffa7678a0d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.039867 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 7b876b30dca04b758f8f540bf86426ef (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.040320 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b876b30dca04b758f8f540bf86426ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.043028 5864 tablet_service.cc:1467] Processing CreateTablet for tablet d90ed9e1379c434d8345f83019b209ab (DEFAULT_TABLE table=default.Table_ef5e35d63c67441396a87acc85e89775 [id=42b6b6b29be94d78b22118c48222e27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.043416 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90ed9e1379c434d8345f83019b209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.048437 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b40b1b2d2377425d8e0a78da3f1c43a8
I20260928 10:44:16.050274 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c957158dbd949e88554e70fe6146089 (table default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b]). Expected version 3 got 0
I20260928 10:44:16.050583 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:16.050793 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:16.050981 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:16.051216 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13]). Expected version 2 got 0
I20260928 10:44:16.051411 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:16.051759 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:16.054036 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:16.054322 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:16.054602 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:16.054764 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:16.054801 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 112544a97042482e848b85b9dca84ca2 (DEFAULT_TABLE table=default.Table_ab3769f0805b4970b30845f5f978e14a [id=dd3ffcff3b0341028fe1d062bb5aba90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.054920 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:16.055454 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112544a97042482e848b85b9dca84ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.055472 5702 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8] alter complete (version 1)
W20260928 10:44:16.055764 5702 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.65:39775 (request call id 159) took 1245 ms (client timeout 1000 ms). Trace:
W20260928 10:44:16.055896 5702 rpcz_store.cc:269] 0928 10:44:14.810041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.823376 (+ 13335us) service_pool.cc:227] Handling call
0928 10:44:14.827842 (+ 4466us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:16.055724 (+1227882us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:15.390700 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:15.392780 (+ 2080us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:15.392785 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:15.392788 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:15.392862 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:15.392870 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:15.392874 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:15.392917 (+ 43us) tablet.cc:699] Row locks acquired
0928 10:44:15.392919 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:15.392946 (+ 27us) write_op.cc:270] Start()
0928 10:44:15.392971 (+ 25us) write_op.cc:276] Timestamp: P: 1790592255392914 usec, L: 0
0928 10:44:15.392974 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:15.393101 (+ 127us) log.cc:842] Serialized 356 byte log entry
0928 10:44:15.428004 (+ 34903us) op_driver.cc:444] REPLICATION: finished
0928 10:44:15.429732 (+ 1728us) write_op.cc:301] APPLY: starting
0928 10:44:15.429741 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:15.429764 (+ 23us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:15.429784 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:15.429811 (+ 27us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:15.429834 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:15.429841 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:15.429888 (+ 47us) log.cc:842] Serialized 23 byte log entry
0928 10:44:15.429922 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:15.429935 (+ 13us) write_op.cc:454] Released schema lock
0928 10:44:15.429940 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:15.429979 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:15.429983 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":7988480,"child_traces":[["op",{"apply.queue_time_us":1699,"apply.run_cpu_time_us":286,"apply.run_wall_time_us":286,"num_ops":1,"prepare.queue_time_us":212578,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":83589,"raft.queue_time_us":269,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"replication_time_us":35013,"thread_start_us":128608,"threads_started":1}]]}
I20260928 10:44:16.056351 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 112544a97042482e848b85b9dca84ca2 (DEFAULT_TABLE table=default.Table_ab3769f0805b4970b30845f5f978e14a [id=dd3ffcff3b0341028fe1d062bb5aba90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.056802 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204] alter complete (version 1)
I20260928 10:44:16.057045 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112544a97042482e848b85b9dca84ca2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:16.058209 5697 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.67:50395 (request call id 160) took 1254 ms (client timeout 1000 ms). Trace:
I20260928 10:44:16.058564 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 with delete_type TABLET_DATA_DELETED (replaced by tablet ab30bcc780e14445b04fe9ffa7678a0d) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:16.058319 5697 rpcz_store.cc:269] 0928 10:44:14.803676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.804445 (+ 769us) service_pool.cc:227] Handling call
0928 10:44:16.058149 (+1253704us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:15.389275 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:15.389356 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:15.389361 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:15.389363 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:15.389441 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:15.389450 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:15.389454 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:15.389503 (+ 49us) tablet.cc:699] Row locks acquired
0928 10:44:15.389505 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:15.389533 (+ 28us) write_op.cc:270] Start()
0928 10:44:15.389571 (+ 38us) write_op.cc:276] Timestamp: P: 1790592255389501 usec, L: 0
0928 10:44:15.389575 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:15.389701 (+ 126us) log.cc:842] Serialized 356 byte log entry
0928 10:44:15.427689 (+ 37988us) op_driver.cc:444] REPLICATION: finished
0928 10:44:15.429359 (+ 1670us) write_op.cc:301] APPLY: starting
0928 10:44:15.429368 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:15.429394 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:15.429430 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:15.429465 (+ 35us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:15.429489 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:15.429495 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:15.429539 (+ 44us) log.cc:842] Serialized 23 byte log entry
0928 10:44:15.429586 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:15.429597 (+ 11us) write_op.cc:454] Released schema lock
0928 10:44:15.429602 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:15.429647 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:15.429650 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":1644,"apply.run_cpu_time_us":343,"apply.run_wall_time_us":343,"num_ops":1,"prepare.queue_time_us":212369,"prepare.run_cpu_time_us":518,"prepare.run_wall_time_us":1389,"raft.queue_time_us":349,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":38103}]]}
I20260928 10:44:16.059371 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 76a47129ab5444dcab0a3f92a16046db
I20260928 10:44:16.059818 5698 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1169) took 1019 ms. Trace:
I20260928 10:44:16.059919 5698 rpcz_store.cc:276] 0928 10:44:15.040204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.432004 (+391800us) service_pool.cc:227] Handling call
0928 10:44:15.557042 (+125038us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05ff2e6 00007fa6d78f2126 00007fa6d78f1e55 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:15.557470 (+ 428us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:15.557606 (+ 136us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:15.557673 (+ 67us) catalog_manager.cc:2761] Locking tablets
0928 10:44:15.758252 (+200579us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:16.048145 (+289893us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:16.048240 (+ 95us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:16.059322 (+ 11082us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:16.059762 (+ 440us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:16.031115 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:16.031225 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:16.031231 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:16.031233 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:16.031347 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:16.031359 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:16.031365 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:16.031493 (+ 128us) tablet.cc:699] Row locks acquired
0928 10:44:16.031496 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:16.031536 (+ 40us) write_op.cc:270] Start()
0928 10:44:16.031569 (+ 33us) write_op.cc:276] Timestamp: P: 1790592256031464 usec, L: 0
0928 10:44:16.031651 (+ 82us) op_driver.cc:331] REPLICATION: starting
0928 10:44:16.031904 (+ 253us) log.cc:842] Serialized 759 byte log entry
0928 10:44:16.046528 (+ 14624us) op_driver.cc:444] REPLICATION: finished
0928 10:44:16.046834 (+ 306us) write_op.cc:301] APPLY: starting
0928 10:44:16.046851 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:16.046899 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:16.046929 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:16.046990 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:16.047026 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:16.047033 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:16.047105 (+ 72us) log.cc:842] Serialized 29 byte log entry
0928 10:44:16.047168 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:16.047186 (+ 18us) write_op.cc:454] Released schema lock
0928 10:44:16.047193 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:16.047246 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:16.047249 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":287011072,"child_traces":[["op",{"apply.queue_time_us":251,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":464,"num_ops":2,"prepare.queue_time_us":272269,"prepare.run_cpu_time_us":785,"prepare.run_wall_time_us":861,"replication_time_us":14847}]]}
I20260928 10:44:16.060979 6118 tablet_service.cc:1467] Processing CreateTablet for tablet d90ed9e1379c434d8345f83019b209ab (DEFAULT_TABLE table=default.Table_ef5e35d63c67441396a87acc85e89775 [id=42b6b6b29be94d78b22118c48222e27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.061388 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90ed9e1379c434d8345f83019b209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.061652 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 42e54c9cecc6420aa753725820b39e3c (DEFAULT_TABLE table=default.Table_55d599e766904a868f70b08efe31eb95 [id=3577369c80cc40d59a6185994c138058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.062000 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42e54c9cecc6420aa753725820b39e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.061400 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 7b876b30dca04b758f8f540bf86426ef (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.069447 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b876b30dca04b758f8f540bf86426ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:16.069568 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 50d66d697f2740a98138a08fc6ef9b60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50d66d697f2740a98138a08fc6ef9b60 already in progress: creating tablet
I20260928 10:44:16.070611 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet 76a47129ab5444dcab0a3f92a16046db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.070948 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.069433 5859 tablet_service.cc:1467] Processing CreateTablet for tablet eaebc067027e4151b8a46eac9d31b05b (DEFAULT_TABLE table=default.Table_fdda0fc49458417eaecd5e00951687e9 [id=981b245e4a28472cb1bdf5e2eefafa94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.074021 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaebc067027e4151b8a46eac9d31b05b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:16.075043 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 already in progress: creating tablet
W20260928 10:44:16.075547 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 already in progress: creating tablet
I20260928 10:44:16.076191 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.076159 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.076687 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet d64c1af58d6a4dfcabd6eecb8c75d572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.001061 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 52811a69061f40f9b2bf7b148362c78d (DEFAULT_TABLE table=default.Table_da36fa7394844e8ea5977ef66e6879b2 [id=72c70af203e3405a95ad5783b8e568ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.003948 7168 raft_consensus.cc:482] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.077658 7557 tablet_replica.cc:330] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:16.077975 7557 raft_consensus.cc:2229] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:16.078294 7557 pending_rounds.cc:62] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:16.078394 7557 pending_rounds.cc:68] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265878573002752 op_type: NO_OP noop_request { }
I20260928 10:44:16.078636 7557 raft_consensus.cc:2866] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:16.078773 7557 raft_consensus.cc:2258] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.079241 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.079530 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0f3216655cc4c7f8fff383bb1f22740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.080516 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 112544a97042482e848b85b9dca84ca2 (DEFAULT_TABLE table=default.Table_ab3769f0805b4970b30845f5f978e14a [id=dd3ffcff3b0341028fe1d062bb5aba90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.081162 5986 tablet_service.cc:1467] Processing CreateTablet for tablet d90ed9e1379c434d8345f83019b209ab (DEFAULT_TABLE table=default.Table_ef5e35d63c67441396a87acc85e89775 [id=42b6b6b29be94d78b22118c48222e27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.081513 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.081630 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 42e54c9cecc6420aa753725820b39e3c (DEFAULT_TABLE table=default.Table_55d599e766904a868f70b08efe31eb95 [id=3577369c80cc40d59a6185994c138058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.081802 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 76a47129ab5444dcab0a3f92a16046db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:16.082350 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b40b1b2d2377425d8e0a78da3f1c43a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40b1b2d2377425d8e0a78da3f1c43a8 already in progress: creating tablet
I20260928 10:44:16.086337 6270 log.cc:1196] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/122fbbe54c174c4ea9cf38698debcb27
I20260928 10:44:16.086812 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 42e54c9cecc6420aa753725820b39e3c (DEFAULT_TABLE table=default.Table_55d599e766904a868f70b08efe31eb95 [id=3577369c80cc40d59a6185994c138058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.087541 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42e54c9cecc6420aa753725820b39e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.092888 6271 ts_tablet_manager.cc:1397] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.160s user 0.020s sys 0.015s
I20260928 10:44:16.092804 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.098424 6012 raft_consensus.cc:2454] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:16.099005 6090 leader_election.cc:302] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:16.098488 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd65a860b00d4a7ba8ae92dde5818212" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.099721 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 with delete_type TABLET_DATA_DELETED (replaced by tablet ab30bcc780e14445b04fe9ffa7678a0d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.099721 6271 raft_consensus.cc:348] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:16.100296 5818 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.100441 5818 leader_election.cc:302] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.100832 7381 raft_consensus.cc:2726] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.101080 6273 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:16.101264 6273 ts_tablet_manager.cc:1397] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.152s user 0.003s sys 0.001s
I20260928 10:44:16.101536 7558 raft_consensus.cc:2781] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.102203 7558 raft_consensus.cc:482] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.102159 6273 raft_consensus.cc:348] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.102360 6273 raft_consensus.cc:374] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.102378 7558 raft_consensus.cc:3037] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.102407 6273 raft_consensus.cc:729] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.103575 6269 ts_tablet_manager.cc:1918] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.103682 6269 log.cc:1196] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d64c1af58d6a4dfcabd6eecb8c75d572
I20260928 10:44:16.103950 6269 ts_tablet_manager.cc:1939] T d64c1af58d6a4dfcabd6eecb8c75d572 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:16.105139 7557 ts_tablet_manager.cc:1905] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.105666 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112544a97042482e848b85b9dca84ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.106034 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90ed9e1379c434d8345f83019b209ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.106571 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet b40b1b2d2377425d8e0a78da3f1c43a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.106760 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 76a47129ab5444dcab0a3f92a16046db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.106887 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7b876b30dca04b758f8f540bf86426ef (DEFAULT_TABLE table=default.Table_775f9213815e44df87fd2479869dd76b [id=cd1ba049756b458e9e594cbcea4fbef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.107125 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42e54c9cecc6420aa753725820b39e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.107275 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b876b30dca04b758f8f540bf86426ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.107823 7381 raft_consensus.cc:482] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.107956 7381 raft_consensus.cc:504] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.108608 7381 leader_election.cc:288] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.108798 7469 consensus_queue.cc:1035] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260928 10:44:16.109298 6271 raft_consensus.cc:374] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.109380 6271 raft_consensus.cc:729] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.111738 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.112403 5817 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.112855 7381 raft_consensus.cc:482] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.112984 7381 raft_consensus.cc:504] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.112908 7558 raft_consensus.cc:504] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.113670 7381 leader_election.cc:288] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.114950 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.115561 5817 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.116214 6091 leader_election.cc:341] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:16.116568 7381 raft_consensus.cc:482] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.116514 5991 tablet_service.cc:1467] Processing CreateTablet for tablet eaebc067027e4151b8a46eac9d31b05b (DEFAULT_TABLE table=default.Table_fdda0fc49458417eaecd5e00951687e9 [id=981b245e4a28472cb1bdf5e2eefafa94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.116714 7381 raft_consensus.cc:504] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.117311 7381 leader_election.cc:288] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.118026 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.118494 5817 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.118854 7558 leader_election.cc:288] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:16.121734 5817 consensus_peers.cc:487] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.124954 7469 raft_consensus.cc:482] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.132586 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.132815 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:16.133586 5818 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.133728 5818 leader_election.cc:302] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.133939 7381 raft_consensus.cc:2726] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:16.134133 5818 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.134238 5818 leader_election.cc:302] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.134409 7381 raft_consensus.cc:2726] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.125123 7469 raft_consensus.cc:504] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.135504 7469 leader_election.cc:288] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.136080 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.136286 5878 raft_consensus.cc:2454] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.136654 5957 leader_election.cc:302] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:16.139405 6270 ts_tablet_manager.cc:1939] T 122fbbe54c174c4ea9cf38698debcb27 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.148168 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.149183 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a8f5241dd14684b5544e47d6cec9cc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:16.149399 6013 raft_consensus.cc:3037] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.126751 7168 raft_consensus.cc:504] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.132586 6271 consensus_queue.cc:260] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.157490 6271 ts_tablet_manager.cc:1428] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.064s user 0.001s sys 0.001s
I20260928 10:44:16.157817 6271 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.158063 7469 raft_consensus.cc:2781] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.158141 7469 raft_consensus.cc:482] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.158193 7469 raft_consensus.cc:3037] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.158635 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.158861 5878 raft_consensus.cc:2454] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.159309 5957 leader_election.cc:302] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:16.159837 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 867) took 4730 ms. Trace:
I20260928 10:44:16.160434 7469 raft_consensus.cc:504] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.161007 7469 leader_election.cc:288] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.161249 7469 raft_consensus.cc:2781] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.161304 7469 raft_consensus.cc:482] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.161352 7469 raft_consensus.cc:3037] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.161520 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.161718 5878 raft_consensus.cc:3037] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.156965 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.159924 6270 rpcz_store.cc:276] 0928 10:44:11.429601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.429669 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:15.733391 (+4303722us) ts_tablet_manager.cc:1145] Deleting tablet 122fbbe54c174c4ea9cf38698debcb27
0928 10:44:15.733404 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.941181 (+207777us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:15.990532 (+ 49351us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.159820 (+169288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4303535}
I20260928 10:44:16.162971 6270 tablet_replica.cc:330] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.163162 6270 raft_consensus.cc:2229] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.163304 6270 raft_consensus.cc:2258] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.163833 6270 ts_tablet_manager.cc:1905] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:16.165952 5818 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.166074 5818 leader_election.cc:302] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.168376 5878 raft_consensus.cc:2454] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.168920 5957 leader_election.cc:302] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:16.170745 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 122fbbe54c174c4ea9cf38698debcb27 (table default.Table_4f6a4e302e974b1eb5f7a129221e1d6f [id=bc26bd768fd748d8ae36fbf0087561df]) successfully deleted
I20260928 10:44:16.171052 7381 raft_consensus.cc:2726] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.177642 6275 tablet_bootstrap.cc:654] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.194339 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c42035571654826a6030f15b2816992 consensus state has no leader
I20260928 10:44:16.195873 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_79deab792b4344e281995d6a3cf65486" } new_table_name: "default.Table_a94782135cfc47238d8c70e24a6d4dd5" modify_external_catalogs: true
I20260928 10:44:16.196487 7469 raft_consensus.cc:504] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.197167 7469 leader_election.cc:288] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.197332 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_569d20faf098464ba7d2f757927af5cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.197928 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_569d20faf098464ba7d2f757927af5cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.199280 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52811a69061f40f9b2bf7b148362c78d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:16.201447 5955 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.201711 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 52754.7us
I20260928 10:44:16.202306 7445 raft_consensus.cc:482] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.202415 7445 raft_consensus.cc:504] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.203662 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.203737 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.203966 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.204342 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_942a770217f24831a97388ce947c5ae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.204959 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_942a770217f24831a97388ce947c5ae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.206270 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dadadc27cb47481fac861cc24bd236c0" } new_table_name: "default.Table_cb4e3194b662485989b3c444b225b8fa" modify_external_catalogs: true
I20260928 10:44:16.207729 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7fa5b056e17743188a2e90bc2a0f692e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.208282 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fa5b056e17743188a2e90bc2a0f692e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.209530 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
I20260928 10:44:16.210624 7168 leader_election.cc:288] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:16.211825 5955 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.214525 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 819) took 7101 ms. Trace:
I20260928 10:44:16.209853 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:16.214634 6269 rpcz_store.cc:276] 0928 10:44:09.112637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.158272 (+ 45635us) service_pool.cc:227] Handling call
0928 10:44:15.964207 (+6805935us) ts_tablet_manager.cc:1145] Deleting tablet d64c1af58d6a4dfcabd6eecb8c75d572
0928 10:44:15.964225 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:15.984165 (+ 19940us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.103461 (+119296us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.214500 (+111039us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6805384}
I20260928 10:44:16.214977 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:16.215222 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d64c1af58d6a4dfcabd6eecb8c75d572 (table default.Table_8062a54a93234807a39d7ff0f8787f73 [id=2d4736814acb47298c4f96e849f840f6]) successfully deleted
I20260928 10:44:16.215354 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:16.215531 6269 tablet_replica.cc:330] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:16.210505 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2d2de8e3559749c5ab798a0483f89892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.215781 6269 raft_consensus.cc:2229] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.215936 6269 raft_consensus.cc:2258] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:16.216102 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d2de8e3559749c5ab798a0483f89892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.216498 6269 ts_tablet_manager.cc:1905] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.219825 7445 leader_election.cc:288] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:16.230304 7445 raft_consensus.cc:482] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.232079 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaebc067027e4151b8a46eac9d31b05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.233289 7469 raft_consensus.cc:482] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.233465 7469 raft_consensus.cc:504] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.234195 7469 leader_election.cc:288] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.230557 7445 raft_consensus.cc:504] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.236163 6271 tablet_bootstrap.cc:654] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:16.251312 6013 raft_consensus.cc:2454] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:16.254830 6090 leader_election.cc:302] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:16.260141 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 91224.2us
I20260928 10:44:16.260286 7565 raft_consensus.cc:2781] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.260425 7565 raft_consensus.cc:686] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.260658 7565 consensus_queue.cc:237] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.261560 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab439922c6e4ffea8d8cdb6b7d8d8d7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.261735 7168 raft_consensus.cc:482] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.261844 5881 raft_consensus.cc:3037] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.261907 7168 raft_consensus.cc:504] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:16.262238 5955 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.262434 7168 leader_election.cc:288] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.262419 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:16.262558 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 50558us
I20260928 10:44:16.262621 5880 raft_consensus.cc:2454] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:16.262773 5955 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.262832 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.262982 5883 raft_consensus.cc:2454] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:16.263092 5955 consensus_peers.cc:487] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.263823 7445 leader_election.cc:288] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.264482 5881 raft_consensus.cc:2454] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.266165 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.266418 6270 ts_tablet_manager.cc:1918] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.266549 6270 log.cc:1196] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/440a50034c6b4110b74b1531a6b7790d
I20260928 10:44:16.266625 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.266826 6270 ts_tablet_manager.cc:1939] T 440a50034c6b4110b74b1531a6b7790d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.267095 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 868) took 4831 ms. Trace:
I20260928 10:44:16.267402 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.268656 6270 rpcz_store.cc:276] 0928 10:44:11.435405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.435453 (+ 48us) service_pool.cc:227] Handling call
0928 10:44:16.162923 (+4727470us) ts_tablet_manager.cc:1145] Deleting tablet 440a50034c6b4110b74b1531a6b7790d
0928 10:44:16.162934 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.258555 (+ 95621us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.266314 (+ 7759us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.267079 (+ 765us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4727192}
I20260928 10:44:16.269251 6270 tablet_replica.cc:330] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:16.267356 5955 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.269668 5955 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.269804 5955 leader_election.cc:341] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.269865 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 440a50034c6b4110b74b1531a6b7790d (table default.Table_dadadc27cb47481fac861cc24bd236c0 [id=9f353ac79b55463da1daedc2523f6cd1]) successfully deleted
I20260928 10:44:16.270076 6270 raft_consensus.cc:2229] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.270210 6270 pending_rounds.cc:62] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:16.270243 6270 pending_rounds.cc:68] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265868310765568 op_type: NO_OP noop_request { }
I20260928 10:44:16.270344 6270 raft_consensus.cc:2866] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:16.270416 6270 raft_consensus.cc:2258] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.268450 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.270977 6270 ts_tablet_manager.cc:1905] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.273168 7494 raft_consensus.cc:2781] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.273402 7494 raft_consensus.cc:686] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:16.273746 7494 consensus_queue.cc:237] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:16.275046 5955 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.278884 7443 consensus_queue.cc:1035] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.278800 6273 consensus_queue.cc:260] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.283959 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
W20260928 10:44:16.285250 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba5fb83b301e487f993ca6fd8f5dd515 consensus state has no leader
I20260928 10:44:16.286865 5694 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_003e601167904dcd8816bb3be11c926a [id=6c4f8a03470949939c8e51847b52ce13] alter complete (version 2)
I20260928 10:44:16.289265 6273 ts_tablet_manager.cc:1428] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.188s user 0.002s sys 0.000s
I20260928 10:44:16.290041 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.290290 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a973a1d20e3437c87ad889c723e7ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:57 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:16.290335 5701 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 158) took 1074 ms (client timeout 1000 ms). Trace:
I20260928 10:44:16.290513 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:16.290427 5701 rpcz_store.cc:269] 0928 10:44:15.215183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.231789 (+ 16606us) service_pool.cc:227] Handling call
0928 10:44:15.381548 (+149759us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:16.290029 (+908481us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":341977344}
I20260928 10:44:16.290889 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.291743 6273 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:16.293996 6270 ts_tablet_manager.cc:1918] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:16.294097 6270 log.cc:1196] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/54b78fbf508f4e47bd31661e05dcaa16
I20260928 10:44:16.293923 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_99ae64c5eee24cc189fb1f54cbe4ad75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.294391 6270 ts_tablet_manager.cc:1939] T 54b78fbf508f4e47bd31661e05dcaa16 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:16.294577 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ae64c5eee24cc189fb1f54cbe4ad75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.295588 7381 raft_consensus.cc:482] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.295737 7381 raft_consensus.cc:504] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.296074 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_667eb87198d94c5fa00a0298e6bbf859"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.296361 7381 leader_election.cc:288] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:16.296609 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_667eb87198d94c5fa00a0298e6bbf859 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.296926 6275 tablet_bootstrap.cc:492] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:16.297889 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5bf0412c2a814aecae606e549920a767"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.297307 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.298440 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bf0412c2a814aecae606e549920a767 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.298524 6275 ts_tablet_manager.cc:1397] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.348s user 0.002s sys 0.006s
W20260928 10:44:16.298954 5817 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.311466 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.311738 5882 raft_consensus.cc:2454] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.312424 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.312629 5881 raft_consensus.cc:2454] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.314353 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.314951 5957 leader_election.cc:302] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.315702 5957 leader_election.cc:302] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.315896 7168 raft_consensus.cc:2781] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.316334 7168 raft_consensus.cc:482] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.316427 7168 raft_consensus.cc:3037] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.316532 5957 leader_election.cc:302] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.316910 5957 leader_election.cc:302] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.317375 7569 raft_consensus.cc:2781] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.317446 7569 raft_consensus.cc:482] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.317503 7569 raft_consensus.cc:3037] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.318959 7168 raft_consensus.cc:504] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.319509 7168 leader_election.cc:288] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:16.319669 7168 raft_consensus.cc:2781] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.319752 7168 raft_consensus.cc:686] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.319936 7168 consensus_queue.cc:237] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.320461 7569 raft_consensus.cc:504] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.320963 7569 leader_election.cc:288] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.321090 7569 consensus_queue.cc:1035] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.321424 7569 raft_consensus.cc:2781] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.321488 7569 raft_consensus.cc:482] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.321590 7569 raft_consensus.cc:3037] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.323971 5957 leader_election.cc:302] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.324209 7445 raft_consensus.cc:2781] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.324292 7445 raft_consensus.cc:482] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.324348 7445 raft_consensus.cc:3037] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.327029 7445 raft_consensus.cc:504] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.327616 7445 leader_election.cc:288] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.329972 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.330578 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.331450 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:16.331785 5818 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.331908 5818 leader_election.cc:302] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.332150 7381 raft_consensus.cc:2726] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:16.332264 5955 leader_election.cc:341] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.332438 5955 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.332712 5955 leader_election.cc:341] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.332981 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.333178 5882 raft_consensus.cc:3037] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.335742 6273 tablet_bootstrap.cc:654] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:16.336063 5882 raft_consensus.cc:2454] T 502d275d161945ce86626594ab0d89b3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.336431 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.336638 5881 raft_consensus.cc:3037] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.339587 5881 raft_consensus.cc:2454] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.343276 7567 raft_consensus.cc:482] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.343430 7567 raft_consensus.cc:504] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.302313 6275 raft_consensus.cc:348] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.344172 7567 leader_election.cc:288] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.344199 6275 raft_consensus.cc:374] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.344395 6275 raft_consensus.cc:729] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.345063 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.345569 5955 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.348452 7469 consensus_queue.cc:1035] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.348577 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.348752 5883 raft_consensus.cc:3037] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.348809 7348 consensus_queue.cc:1035] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.349123 7348 consensus_queue.cc:1035] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.349902 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.350097 5882 raft_consensus.cc:2454] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.351379 5883 raft_consensus.cc:2454] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.351953 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 869) took 4915 ms. Trace:
I20260928 10:44:16.352098 6270 rpcz_store.cc:276] 0928 10:44:11.436313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.436461 (+ 148us) service_pool.cc:227] Handling call
0928 10:44:16.269209 (+4832748us) ts_tablet_manager.cc:1145] Deleting tablet 54b78fbf508f4e47bd31661e05dcaa16
0928 10:44:16.269220 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.288634 (+ 19414us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.293900 (+ 5266us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.351936 (+ 58036us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4832552}
I20260928 10:44:16.352650 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 54b78fbf508f4e47bd31661e05dcaa16 (table default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]) successfully deleted
I20260928 10:44:16.352778 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 870) took 4894 ms. Trace:
I20260928 10:44:16.352849 6270 rpcz_store.cc:276] 0928 10:44:11.458005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.458059 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:16.352650 (+4894591us) ts_tablet_manager.cc:1145] Deleting tablet e9c596f9cd28453883d0299e698fba31
0928 10:44:16.352662 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.352761 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4894348}
W20260928 10:44:16.353226 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e9c596f9cd28453883d0299e698fba31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9c596f9cd28453883d0299e698fba31 already in progress: creating tablet
I20260928 10:44:16.348146 5957 leader_election.cc:302] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.356853 5957 leader_election.cc:302] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.357115 7567 raft_consensus.cc:2781] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.357272 7567 raft_consensus.cc:686] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.357537 7567 consensus_queue.cc:237] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.357807 7574 raft_consensus.cc:2781] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.357909 7574 raft_consensus.cc:686] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.357662 5957 leader_election.cc:302] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.358956 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b8e5fedeb2f242fca078d64788bf6c33" } modify_external_catalogs: true
I20260928 10:44:16.359190 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b8e5fedeb2f242fca078d64788bf6c33" } modify_external_catalogs: true
I20260928 10:44:16.360242 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:16.360705 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 1 got 0
I20260928 10:44:16.360729 7557 ts_tablet_manager.cc:1918] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:16.360877 7557 log.cc:1196] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:16.360944 5700 catalog_manager.cc:5495] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:16.361518 7557 ts_tablet_manager.cc:1939] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:16.361490 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:16.361802 5700 catalog_manager.cc:5495] T 5e0ca8630f134d5fba6e87bd901df70b P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:16.362300 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:16.362623 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:16.362694 7557 tablet_replica.cc:330] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:16.363016 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:16.363016 7557 raft_consensus.cc:2229] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 LEADER]: Raft consensus shutting down.
I20260928 10:44:16.363225 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c322d11fab43499f82e077fd8a8c02f3 (table default.Table_0796215bba1f4ecc85937aef3b01bee7 [id=07eac26ccf134fb5b9bcc53ba57eb067]). Expected version 1 got 0
I20260928 10:44:16.363781 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 943db4a7f3fe4283a67defd68e744e33 (table default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e]). Expected version 1 got 0
W20260928 10:44:16.384995 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a229207ce7cc475c8f4492e62d122721 consensus state has no leader
I20260928 10:44:16.385329 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 263b9844bdf6465fa7894ddcf2809f24 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:16.385968 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e24f9f19bc504923acb59085c2e0c114"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.386924 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7aea1e0968d41238ad1618262f7c374" } modify_external_catalogs: true
I20260928 10:44:16.387140 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7aea1e0968d41238ad1618262f7c374" } modify_external_catalogs: true
W20260928 10:44:16.389385 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e24f9f19bc504923acb59085c2e0c114 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.397531 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_246184c33447431eaeb718fe8ce2708d" } new_table_name: "default.Table_54e271ad351447519fa4dc1f7514d96f" modify_external_catalogs: true
I20260928 10:44:16.399642 7381 raft_consensus.cc:482] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.399857 7381 raft_consensus.cc:504] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.400473 7381 leader_election.cc:288] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.400885 7583 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:16.406301 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 871) took 4545 ms. Trace:
I20260928 10:44:16.406430 6270 rpcz_store.cc:276] 0928 10:44:11.860449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.860509 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:16.406109 (+4545600us) ts_tablet_manager.cc:1145] Deleting tablet 00b7e26971914613a2372476b348b702
0928 10:44:16.406128 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.406267 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4515216}
I20260928 10:44:16.407094 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 872) took 4525 ms. Trace:
I20260928 10:44:16.407222 6270 rpcz_store.cc:276] 0928 10:44:11.881877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.881934 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:16.406967 (+4525033us) ts_tablet_manager.cc:1145] Deleting tablet 19f68e9f9bf44cf09fc87f102de60f28
0928 10:44:16.406979 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.407079 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4515810}
W20260928 10:44:16.407274 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 00b7e26971914613a2372476b348b702 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b7e26971914613a2372476b348b702 already in progress: creating tablet
I20260928 10:44:16.407519 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 882) took 4357 ms. Trace:
W20260928 10:44:16.407965 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 19f68e9f9bf44cf09fc87f102de60f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f68e9f9bf44cf09fc87f102de60f28 already in progress: creating tablet
I20260928 10:44:16.411775 5694 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_05e9e2f2253945c286361ae7fb235dfe [id=78c21cb16c8e4745b67eb1700a404525] alter complete (version 2)
I20260928 10:44:16.412266 5695 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_2b41839e03984bf8ba1380b19cb1327a [id=a7c3de60394d49dfb609e35027411cc7] alter complete (version 1)
I20260928 10:44:16.415521 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 with delete_type TABLET_DATA_DELETED (replaced by tablet 7834a54e59114a77b4e54e9190049a47) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.416082 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet f5a00b74133a406996820adcb71194df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.416924 7381 raft_consensus.cc:482] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.417061 7381 raft_consensus.cc:504] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.417697 7381 leader_election.cc:288] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.414383 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a3443d4c6674342b4124156414dcc13 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:16.418882 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_093d6eb485344036802223ce544f483a" } modify_external_catalogs: true
I20260928 10:44:16.419111 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_093d6eb485344036802223ce544f483a" } modify_external_catalogs: true
I20260928 10:44:16.414383 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed22e348552243ee9081c6889957158c" } modify_external_catalogs: true
I20260928 10:44:16.421489 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed22e348552243ee9081c6889957158c" } modify_external_catalogs: true
I20260928 10:44:16.425045 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.425741 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e0bac650904b8f81474ba2dac9c04f with delete_type TABLET_DATA_DELETED (replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.407075 7445 raft_consensus.cc:2781] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.426384 7445 raft_consensus.cc:482] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.426508 7445 raft_consensus.cc:3037] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.407606 6270 rpcz_store.cc:276] 0928 10:44:12.050340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.050409 (+ 69us) service_pool.cc:227] Handling call
0928 10:44:16.407421 (+4357012us) ts_tablet_manager.cc:1145] Deleting tablet 29b6d18cf0304edc8b3ca1d4d106decb
0928 10:44:16.407431 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.407503 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4356764}
I20260928 10:44:16.427007 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 883) took 4376 ms. Trace:
I20260928 10:44:16.427109 6270 rpcz_store.cc:276] 0928 10:44:12.050436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.050535 (+ 99us) service_pool.cc:227] Handling call
0928 10:44:16.426870 (+4376335us) ts_tablet_manager.cc:1145] Deleting tablet 25a2f20766024978a16b6bccd366a848
0928 10:44:16.426882 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.426986 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4376133}
I20260928 10:44:16.427448 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 886) took 4351 ms. Trace:
I20260928 10:44:16.427520 6270 rpcz_store.cc:276] 0928 10:44:12.075567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.075618 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:16.427337 (+4351719us) ts_tablet_manager.cc:1145] Deleting tablet 46490066d50847ceb2362e35dce84f31
0928 10:44:16.427347 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.427431 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4351508}
I20260928 10:44:16.427677 7569 raft_consensus.cc:504] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.427793 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 889) took 4319 ms. Trace:
I20260928 10:44:16.427862 6270 rpcz_store.cc:276] 0928 10:44:12.108560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.108618 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:16.427699 (+4319081us) ts_tablet_manager.cc:1145] Deleting tablet 6bfcdaa9d8bf45c98411cf0e6febd294
0928 10:44:16.427709 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.427779 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4318881}
I20260928 10:44:16.428143 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 890) took 4307 ms. Trace:
I20260928 10:44:16.428236 7569 leader_election.cc:288] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.428237 6270 rpcz_store.cc:276] 0928 10:44:12.120815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.120873 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:16.428036 (+4307163us) ts_tablet_manager.cc:1145] Deleting tablet a3b0ec0cf3bc4a09b0aaa15d18873f70
0928 10:44:16.428044 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.428128 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4306948}
W20260928 10:44:16.428785 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 29b6d18cf0304edc8b3ca1d4d106decb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b6d18cf0304edc8b3ca1d4d106decb already in progress: creating tablet
I20260928 10:44:16.428879 6270 tablet_replica.cc:330] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:16.429057 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 25a2f20766024978a16b6bccd366a848 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25a2f20766024978a16b6bccd366a848 already in progress: creating tablet
W20260928 10:44:16.429297 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 46490066d50847ceb2362e35dce84f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46490066d50847ceb2362e35dce84f31 already in progress: creating tablet
W20260928 10:44:16.429483 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bfcdaa9d8bf45c98411cf0e6febd294 already in progress: creating tablet
I20260928 10:44:16.429602 7569 consensus_queue.cc:1035] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:16.429724 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 already in progress: creating tablet
I20260928 10:44:16.431804 6270 raft_consensus.cc:2229] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.431983 6270 raft_consensus.cc:2258] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.437331 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4b1852b320ff47f0abc2c8d9de920f98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.437955 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b1852b320ff47f0abc2c8d9de920f98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.439293 6273 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:16.439478 6273 ts_tablet_manager.cc:1397] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.148s user 0.004s sys 0.000s
I20260928 10:44:16.440297 6273 raft_consensus.cc:348] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.440753 6273 raft_consensus.cc:374] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.440856 6273 raft_consensus.cc:729] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.441123 6273 consensus_queue.cc:260] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.441702 6273 ts_tablet_manager.cc:1428] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:16.442016 6273 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:16.358121 7574 consensus_queue.cc:237] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.448860 6270 ts_tablet_manager.cc:1905] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.450958 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bdd5c076fa3043b8b40005418342a901" } modify_external_catalogs: true
I20260928 10:44:16.451208 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bdd5c076fa3043b8b40005418342a901" } modify_external_catalogs: true
W20260928 10:44:16.454624 5955 consensus_peers.cc:487] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.458567 7445 raft_consensus.cc:504] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.459218 7445 leader_election.cc:288] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.461367 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8092cd377a6548a1bce299cf5ce8f4dd
I20260928 10:44:16.462138 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5607fa1f3fd0455abf4c687e67afde0e" } new_table_name: "default.Table_516bd0195afa484681570b1f84d17ee4" modify_external_catalogs: true
I20260928 10:44:16.462206 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_84eec5f79a7e4d24a08b9a1f0754cc42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.462854 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84eec5f79a7e4d24a08b9a1f0754cc42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.469108 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:16.479828 6273 tablet_bootstrap.cc:654] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.485152 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da06864105a64b42a1c9701c07a241b8 consensus state has no leader
I20260928 10:44:16.482003 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.487913 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ba84b52ee40c448da886f41dc6516b8c" } new_table_name: "default.Table_05ed87ef944048409833b57116a4c103" modify_external_catalogs: true
I20260928 10:44:16.490523 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a0de9e5daf1c46889988bd66f01f11be
I20260928 10:44:16.492050 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_21e16de584264e87b52eb815094c2d0c" } new_table_name: "default.Table_29655c7bf88a4b96b81be7070a2839ca" modify_external_catalogs: true
I20260928 10:44:16.494542 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet a0de9e5daf1c46889988bd66f01f11be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.495582 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.497820 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 882f017dc1df42c89495b4d06bb9f563
I20260928 10:44:16.499749 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 882f017dc1df42c89495b4d06bb9f563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.500114 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 882f017dc1df42c89495b4d06bb9f563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.503252 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet a0de9e5daf1c46889988bd66f01f11be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:16.516600 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 158931us
I20260928 10:44:16.516904 5957 leader_election.cc:302] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.517712 7584 raft_consensus.cc:2781] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.517844 7584 raft_consensus.cc:686] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
W20260928 10:44:16.530544 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c22cc964ceb741febfd3d1322ae05289 consensus state has no leader
I20260928 10:44:16.531689 7584 consensus_queue.cc:237] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.533967 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.534219 5880 raft_consensus.cc:3037] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.537101 5880 raft_consensus.cc:2454] T 190cd281b1ad41aab2564744c282bcab P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.537930 7381 raft_consensus.cc:482] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.538095 7381 raft_consensus.cc:504] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.538887 7381 leader_election.cc:288] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.538965 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.539150 5880 raft_consensus.cc:3037] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.541980 5880 raft_consensus.cc:2454] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.543990 5700 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_e93cadb12e6c4f88b9d44f1c0d43d522 [id=c8d4a6587af14ea39b7ace0ce005588b] alter complete (version 3)
I20260928 10:44:16.544150 6270 ts_tablet_manager.cc:1918] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.544269 6270 log.cc:1196] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/db824b43256640e9bfef44da1ccf8e1a
I20260928 10:44:16.544562 6270 ts_tablet_manager.cc:1939] T db824b43256640e9bfef44da1ccf8e1a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.544891 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 893) took 4371 ms. Trace:
I20260928 10:44:16.544970 6270 rpcz_store.cc:276] 0928 10:44:12.173854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.174030 (+ 176us) service_pool.cc:227] Handling call
0928 10:44:16.428837 (+4254807us) ts_tablet_manager.cc:1145] Deleting tablet db824b43256640e9bfef44da1ccf8e1a
0928 10:44:16.428845 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.512227 (+ 83382us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.544030 (+ 31803us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.544873 (+ 843us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4254602}
I20260928 10:44:16.545441 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet db824b43256640e9bfef44da1ccf8e1a (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
I20260928 10:44:16.546043 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.546564 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.546996 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.547402 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.548014 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.548476 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.548893 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.549304 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f29acce3604e458d1981aad87f2eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.549714 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.551755 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.551888 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.551872 6270 tablet_replica.cc:330] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:16.558462 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet da06864105a64b42a1c9701c07a241b8 (table default.Table_54e271ad351447519fa4dc1f7514d96f [id=593c83175526474a82856f4fbc6a6432], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet da06864105a64b42a1c9701c07a241b8 consensus state has no leader
I20260928 10:44:16.559487 6270 raft_consensus.cc:2229] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.559757 6270 raft_consensus.cc:2258] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.561004 6271 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:16.561187 6271 ts_tablet_manager.cc:1397] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.403s user 0.009s sys 0.061s
I20260928 10:44:16.561429 6270 ts_tablet_manager.cc:1905] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:16.561671 5818 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.561563 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2da17aac467c432899b53a16ba53b3c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.561965 5818 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.562247 5957 leader_election.cc:302] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:16.562503 5957 leader_election.cc:302] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
W20260928 10:44:16.562731 5957 consensus_peers.cc:487] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6d5121db2d34ea99c851595c395f3be. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:16.562806 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db50601fa874f219d1c093a86f080c1 consensus state has no leader
I20260928 10:44:16.563105 7569 raft_consensus.cc:2781] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.563210 7569 raft_consensus.cc:686] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.563215 7168 raft_consensus.cc:2781] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:16.563352 7168 raft_consensus.cc:686] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:16.563354 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6e34e07962c64df98e43a6f5bb6fd281"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.563537 7168 consensus_queue.cc:237] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.564519 7381 consensus_queue.cc:1035] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:16.567864 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c683d17d41e243e798cf9837fa88a4c9 consensus state has no leader
I20260928 10:44:16.560765 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:16.569756 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e34e07962c64df98e43a6f5bb6fd281 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:16.570927 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2da17aac467c432899b53a16ba53b3c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.575210 7348 raft_consensus.cc:482] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.575400 7348 raft_consensus.cc:504] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.575971 7348 leader_election.cc:288] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.581984 7445 consensus_queue.cc:1035] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:16.581455 5955 consensus_peers.cc:487] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.585098 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b7976063024775b9dde91b32010754 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:16.585613 5955 consensus_peers.cc:487] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.589157 7381 raft_consensus.cc:482] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.589300 7381 raft_consensus.cc:504] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.590598 7381 leader_election.cc:288] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.563409 7569 consensus_queue.cc:237] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.593600 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51fa355050b247adafc45bb9f179041c" } new_table_name: "default.Table_e7c7255a349a41febd0f10821dff155a" modify_external_catalogs: true
I20260928 10:44:16.593875 6271 raft_consensus.cc:348] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.594094 6271 raft_consensus.cc:374] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.594142 6271 raft_consensus.cc:729] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.601038 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01a0de136e404eb4a264a0eeb4b60fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.594306 6271 consensus_queue.cc:260] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:16.601670 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01a0de136e404eb4a264a0eeb4b60fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.602026 6271 ts_tablet_manager.cc:1428] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260928 10:44:16.602309 6271 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.604200 6271 tablet_bootstrap.cc:654] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.606746 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45814bb909ed4a15a39a0819973042d2 has no consensus state
I20260928 10:44:16.609225 7381 raft_consensus.cc:482] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.609380 7381 raft_consensus.cc:504] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.610123 7381 leader_election.cc:288] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.611738 6270 ts_tablet_manager.cc:1918] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.613018 6270 log.cc:1196] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/847b18c212474456ac9b40eee055dbd0
I20260928 10:44:16.613610 6270 ts_tablet_manager.cc:1939] T 847b18c212474456ac9b40eee055dbd0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.614395 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 894) took 4440 ms. Trace:
I20260928 10:44:16.615015 6270 rpcz_store.cc:276] 0928 10:44:12.173980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.174274 (+ 294us) service_pool.cc:227] Handling call
0928 10:44:16.551831 (+4377557us) ts_tablet_manager.cc:1145] Deleting tablet 847b18c212474456ac9b40eee055dbd0
0928 10:44:16.551841 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.599364 (+ 47523us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.611615 (+ 12251us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.614376 (+ 2761us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4377434}
I20260928 10:44:16.617340 7585 raft_consensus.cc:482] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.619271 7585 raft_consensus.cc:504] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.619477 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 847b18c212474456ac9b40eee055dbd0 (table default.Table_f0821d260af54eb2a7eb3cb19f94df64 [id=f0c8d3a675f345389434e9530f4ed05a]) successfully deleted
I20260928 10:44:16.620003 7585 leader_election.cc:288] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.620214 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 895) took 4303 ms. Trace:
I20260928 10:44:16.622617 7381 raft_consensus.cc:482] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.622758 7381 raft_consensus.cc:504] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:16.623871 5955 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:16.624596 7381 leader_election.cc:288] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.373037 6275 consensus_queue.cc:260] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.626971 7557 raft_consensus.cc:2258] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.627173 6275 ts_tablet_manager.cc:1428] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.328s user 0.001s sys 0.001s
I20260928 10:44:16.627487 6275 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:16.627990 7557 ts_tablet_manager.cc:1905] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.393896 7582 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:16.404371 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.415696 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.415817 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a00a2c4692459cbdd0628af0184f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.415896 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 16510244612242f796910cf28e367da9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c07d2f6a5c1402c9768b84177f52fc2) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.415979 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 9956318fe8ef4d1cbc92eda9caa98602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.416102 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d762e03b384d85b4e04be8331474a4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.416190 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:16.629562 5817 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.629688 5817 leader_election.cc:302] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.422967 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.430042 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.462050 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1072cf156cdf4c2a8c9d9764de110c6d" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:16.467908 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 8092cd377a6548a1bce299cf5ce8f4dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.491914 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet a0de9e5daf1c46889988bd66f01f11be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.499269 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 882f017dc1df42c89495b4d06bb9f563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.539319 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.583727 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.590173 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0584d6b80e43eb913c3932256cd89e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.610765 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.623725 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.632596 5817 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.632814 5817 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.632944 5817 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.633065 5817 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.633284 7381 raft_consensus.cc:2726] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.633930 6269 ts_tablet_manager.cc:1918] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:16.634056 6269 log.cc:1196] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/15931372e469401ab22422677bd90d1f
W20260928 10:44:16.634712 5817 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.634836 5817 leader_election.cc:302] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.635195 7381 raft_consensus.cc:2726] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.635231 6275 tablet_bootstrap.cc:654] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.635663 5955 leader_election.cc:341] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.635962 5955 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.637426 5955 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.638091 5818 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.638196 5818 leader_election.cc:302] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.638628 7381 raft_consensus.cc:2726] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.638813 7455 consensus_queue.cc:1035] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.639923 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.640113 5882 raft_consensus.cc:2454] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.644045 6269 ts_tablet_manager.cc:1939] T 15931372e469401ab22422677bd90d1f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:16.644856 7574 raft_consensus.cc:482] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.645090 7574 raft_consensus.cc:504] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.645829 7574 leader_election.cc:288] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.646727 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_67313132092d4048940149ae175780e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.647264 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.647322 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0584d6b80e43eb913c3932256cd89e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.647681 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.647825 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 822) took 7452 ms. Trace:
I20260928 10:44:16.646377 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_72ab1b3d84434465bd1df4388c822a90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.647929 6269 rpcz_store.cc:276] 0928 10:44:09.195750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.195812 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:16.215480 (+7019668us) ts_tablet_manager.cc:1145] Deleting tablet 15931372e469401ab22422677bd90d1f
0928 10:44:16.215493 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.222112 (+ 6619us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.633800 (+411688us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.647806 (+ 14006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7019473}
I20260928 10:44:16.648415 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 15931372e469401ab22422677bd90d1f (table default.Table_c2164ee9e1054e77849d3bcd8c58ccba [id=17494134f909487faaee68b8b9a52097]) successfully deleted
W20260928 10:44:16.648437 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72ab1b3d84434465bd1df4388c822a90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.648660 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 824) took 7206 ms. Trace:
I20260928 10:44:16.648751 6269 rpcz_store.cc:276] 0928 10:44:09.442761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.442957 (+ 196us) service_pool.cc:227] Handling call
0928 10:44:16.648543 (+7205586us) ts_tablet_manager.cc:1145] Deleting tablet 85f90d3cbc724e289f525c2a89296ce4
0928 10:44:16.648554 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.648643 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7205328}
W20260928 10:44:16.649204 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 85f90d3cbc724e289f525c2a89296ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f90d3cbc724e289f525c2a89296ce4 already in progress: creating tablet
I20260928 10:44:16.649633 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 825) took 7206 ms. Trace:
I20260928 10:44:16.649879 6269 rpcz_store.cc:276] 0928 10:44:09.442902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.444230 (+ 1328us) service_pool.cc:227] Handling call
0928 10:44:16.649473 (+7205243us) ts_tablet_manager.cc:1145] Deleting tablet f799021aca384269bfcd67829f3a7db5
0928 10:44:16.649483 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.649615 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7205011}
I20260928 10:44:16.649966 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b09f4f6e9c904fb88555bb00b9910e6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.650311 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet f799021aca384269bfcd67829f3a7db5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799021aca384269bfcd67829f3a7db5 already in progress: creating tablet
W20260928 10:44:16.650925 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b09f4f6e9c904fb88555bb00b9910e6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.651700 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:16.620839 6270 rpcz_store.cc:276] 0928 10:44:12.317165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.317221 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:16.619934 (+4302713us) ts_tablet_manager.cc:1145] Deleting tablet b257d722a42e44f4ac554b1ebe7d8e31
0928 10:44:16.619948 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.620190 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4302499}
W20260928 10:44:16.654557 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b257d722a42e44f4ac554b1ebe7d8e31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b257d722a42e44f4ac554b1ebe7d8e31 already in progress: creating tablet
W20260928 10:44:16.654099 5955 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.655508 6270 tablet_replica.cc:330] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.656184 6270 raft_consensus.cc:2229] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.657490 6270 raft_consensus.cc:2258] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.658746 6270 ts_tablet_manager.cc:1905] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.662181 7381 raft_consensus.cc:482] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.662356 7381 raft_consensus.cc:504] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.663130 7381 leader_election.cc:288] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.663772 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.664594 5817 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.594889 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_369a1bc5f44f41e58a6f28a71a3b731e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.665690 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_369a1bc5f44f41e58a6f28a71a3b731e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.665666 7600 tablet.cc:1722] T 1677f971c9384d519f1ce94da1b7ef2a P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:16.665867 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67313132092d4048940149ae175780e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.671257 6271 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:16.671707 6271 ts_tablet_manager.cc:1397] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.005s
W20260928 10:44:16.672247 7266 log.cc:924] Time spent T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Append to log took a long time: real 0.083s user 0.002s sys 0.000s
I20260928 10:44:16.672956 6271 raft_consensus.cc:348] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.673467 6271 raft_consensus.cc:374] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.673666 6271 raft_consensus.cc:729] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.673949 6271 consensus_queue.cc:260] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.674894 6271 ts_tablet_manager.cc:1428] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:16.675271 7266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=683 overwritten=0 applied=683 ignored=0} inserts{seen=636 ignored=0} mutations{seen=797 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 10:44:16.675580 6271 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.678689 7266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Bootstrap complete.
I20260928 10:44:16.680413 5957 leader_election.cc:302] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.682945 7585 raft_consensus.cc:2781] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.683091 7585 raft_consensus.cc:482] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.683238 7585 raft_consensus.cc:3037] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.685837 7585 raft_consensus.cc:504] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.688099 7585 leader_election.cc:288] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:16.688458 5957 consensus_peers.cc:487] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45a00a2c4692459cbdd0628af0184f09. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:16.693615 5957 leader_election.cc:341] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:16.698680 6269 tablet_replica.cc:330] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:16.700508 6269 raft_consensus.cc:2229] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.701084 5957 leader_election.cc:302] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:16.702278 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0ef1eb1e0e8e4160aeca25ae64460b48" } new_table_name: "default.Table_358000093d1848528bbca905762e5384" modify_external_catalogs: true
I20260928 10:44:16.703766 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e1ac09d1496a4872a1200c7b5a277c41" } modify_external_catalogs: true
I20260928 10:44:16.703943 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e1ac09d1496a4872a1200c7b5a277c41" } modify_external_catalogs: true
I20260928 10:44:16.704525 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bef25f1d1cbf4967b518fdda6253dfe3" } modify_external_catalogs: true
I20260928 10:44:16.704672 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bef25f1d1cbf4967b518fdda6253dfe3" } modify_external_catalogs: true
I20260928 10:44:16.705338 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2d2de8e3559749c5ab798a0483f89892" } modify_external_catalogs: true
I20260928 10:44:16.705490 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2d2de8e3559749c5ab798a0483f89892" } modify_external_catalogs: true
I20260928 10:44:16.705384 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f32fe38bfa5b45aab2858e07e4f14d8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.705992 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f32fe38bfa5b45aab2858e07e4f14d8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.693879 7585 consensus_queue.cc:1035] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.708313 6269 raft_consensus.cc:2258] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.708823 6271 tablet_bootstrap.cc:654] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:16.709309 7584 raft_consensus.cc:2726] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:16.710932 6270 ts_tablet_manager.cc:1918] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.711246 6273 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:16.711369 6270 log.cc:1196] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:16.711809 6270 ts_tablet_manager.cc:1939] T 95e1f8a63fed4c82ac95c2fbb7bc633d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.712049 6273 ts_tablet_manager.cc:1397] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.270s user 0.009s sys 0.005s
I20260928 10:44:16.713310 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:16.718601 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfe5dbc497224077aa1462c6a9409ee0 consensus state has no leader
I20260928 10:44:16.718585 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet f1a8f5241dd14684b5544e47d6cec9cc from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:16.720027 6269 ts_tablet_manager.cc:1905] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.721699 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ab3cfb6419ef479580e7915b4fe6b5af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.721977 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 897) took 4190 ms. Trace:
I20260928 10:44:16.722092 6270 rpcz_store.cc:276] 0928 10:44:12.531450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.531933 (+ 483us) service_pool.cc:227] Handling call
0928 10:44:16.655446 (+4123513us) ts_tablet_manager.cc:1145] Deleting tablet 95e1f8a63fed4c82ac95c2fbb7bc633d
0928 10:44:16.655461 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.664896 (+ 9435us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.710826 (+ 45930us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.721954 (+ 11128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4123258}
W20260928 10:44:16.722262 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3cfb6419ef479580e7915b4fe6b5af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.722558 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 95e1f8a63fed4c82ac95c2fbb7bc633d (table default.Table_60470bf7130b4650bf7042a36ed9fb00 [id=efb3b0eb2a024f329d39ce6f1d6a6afb]) successfully deleted
I20260928 10:44:16.722972 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 898) took 4191 ms. Trace:
I20260928 10:44:16.723079 6270 rpcz_store.cc:276] 0928 10:44:12.531543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.532229 (+ 686us) service_pool.cc:227] Handling call
0928 10:44:16.722861 (+4190632us) ts_tablet_manager.cc:1145] Deleting tablet 734c3196929d4814b77bce7938bf598e
0928 10:44:16.722873 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.722953 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4190504}
W20260928 10:44:16.723462 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 734c3196929d4814b77bce7938bf598e because the tablet was not found. No further retry: Not found: Tablet not found: 734c3196929d4814b77bce7938bf598e
I20260928 10:44:16.724678 6270 tablet_replica.cc:330] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.724889 6270 raft_consensus.cc:2229] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.725052 6270 raft_consensus.cc:2258] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.725601 6270 ts_tablet_manager.cc:1905] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:16.725654 6091 consensus_peers.cc:487] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67f29acce3604e458d1981aad87f2eb9. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.726239 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:16.728919 7455 consensus_queue.cc:1035] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.729065 6271 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:16.729470 6271 ts_tablet_manager.cc:1397] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
W20260928 10:44:16.730742 5955 leader_election.cc:341] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.731371 5955 consensus_peers.cc:487] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.736104 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f46a81b5d00a440f8139ef39c5f912c6" } new_table_name: "default.Table_d17662a87a684d779f6532f8447ae7b7" modify_external_catalogs: true
I20260928 10:44:16.739511 7455 consensus_queue.cc:1035] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.740370 7584 consensus_queue.cc:1035] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:16.741562 6271 raft_consensus.cc:348] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.741762 6271 raft_consensus.cc:374] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.741818 6271 raft_consensus.cc:729] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.741988 6271 consensus_queue.cc:260] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.742511 6271 ts_tablet_manager.cc:1428] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 10:44:16.742789 6271 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.743175 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c2f078ae6d2b498d8c5af90afba887ad
I20260928 10:44:16.744151 6271 tablet_bootstrap.cc:654] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:16.744362 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f078ae6d2b498d8c5af90afba887ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.745919 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_51fa060d9bae490292fbd4d249570f9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.747251 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51fa060d9bae490292fbd4d249570f9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.759580 5699 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 3a33226f7c7c4b1eae0104cd81108ccf
I20260928 10:44:16.765385 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6760d86bc4a84628ab87cad7bfb0731c" } new_table_name: "default.Table_4764de124c924233a6206159bf2e65c2" modify_external_catalogs: true
W20260928 10:44:16.771539 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 43710.5us
I20260928 10:44:16.771770 6270 ts_tablet_manager.cc:1918] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.771894 6270 log.cc:1196] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c1e7257c8b114e80853ff0a108d2998a
I20260928 10:44:16.772198 6270 ts_tablet_manager.cc:1939] T c1e7257c8b114e80853ff0a108d2998a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.772531 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 899) took 4240 ms. Trace:
I20260928 10:44:16.772679 6270 rpcz_store.cc:276] 0928 10:44:12.531625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.532376 (+ 751us) service_pool.cc:227] Handling call
0928 10:44:16.724631 (+4192255us) ts_tablet_manager.cc:1145] Deleting tablet c1e7257c8b114e80853ff0a108d2998a
0928 10:44:16.724643 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.732791 (+ 8148us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.735866 (+ 3075us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.772515 (+ 36649us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4192152}
I20260928 10:44:16.773180 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c1e7257c8b114e80853ff0a108d2998a (table default.Table_8ab5057a6dd44d16a05cf47c02e20582 [id=82ed1b095a4749ab85883b6d75bf0f46]) successfully deleted
I20260928 10:44:16.773175 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.773546 6270 tablet_replica.cc:330] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.773757 6270 raft_consensus.cc:2229] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.773926 6270 raft_consensus.cc:2258] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.774425 6270 ts_tablet_manager.cc:1905] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:16.775195 5955 consensus_peers.cc:487] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:16.776296 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b511e6944bb54de49970e8c6fee87274" } new_table_name: "default.Table_226ff7d33a1c46a3b36d31fbaffdb304" modify_external_catalogs: true
I20260928 10:44:16.758431 7266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:44:16.783082 7266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1529a7b0d7479db7dabebf471795b5, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.783987 6271 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:16.783878 7266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 683, Last appended: 1.683, Last appended by leader: 683, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:44:16.784247 6271 ts_tablet_manager.cc:1397] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.006s
I20260928 10:44:16.731583 6273 raft_consensus.cc:348] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.787237 6273 raft_consensus.cc:374] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.770426 7381 raft_consensus.cc:482] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.787371 6273 raft_consensus.cc:729] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.787432 7381 raft_consensus.cc:504] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.787593 6273 consensus_queue.cc:260] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.787979 7381 leader_election.cc:288] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:16.788486 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_01a1276cec1443f49ff9d9cf34436ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.788798 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.789069 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01a1276cec1443f49ff9d9cf34436ac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:16.789425 5817 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:16.772166 5818 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.789712 5818 leader_election.cc:302] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.790149 7381 raft_consensus.cc:2726] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.745806 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f078ae6d2b498d8c5af90afba887ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.790736 6271 raft_consensus.cc:348] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.790927 6271 raft_consensus.cc:374] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.790982 6271 raft_consensus.cc:729] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:16.791795 5818 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.791894 5818 leader_election.cc:302] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:16.792169 5818 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.792248 5818 leader_election.cc:302] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.792497 7381 raft_consensus.cc:2726] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.792448 6271 consensus_queue.cc:260] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.792625 7381 raft_consensus.cc:2726] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.795979 6275 tablet_bootstrap.cc:492] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:16.796782 6270 ts_tablet_manager.cc:1918] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.799935 6275 ts_tablet_manager.cc:1397] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.173s user 0.002s sys 0.009s
I20260928 10:44:16.800946 6275 raft_consensus.cc:348] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.801357 6275 raft_consensus.cc:374] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.801532 6275 raft_consensus.cc:729] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.801821 6275 consensus_queue.cc:260] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.803468 6275 ts_tablet_manager.cc:1428] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:16.803880 6275 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:16.809099 7266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 10:44:16.807334 7613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:16.810336 7613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:44:16.810492 6270 log.cc:1196] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/efa178fc1e344069b086003d39f1b848
I20260928 10:44:16.806730 6271 ts_tablet_manager.cc:1428] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260928 10:44:16.810882 6270 ts_tablet_manager.cc:1939] T efa178fc1e344069b086003d39f1b848 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.815136 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 900) took 4283 ms. Trace:
I20260928 10:44:16.815388 6270 rpcz_store.cc:276] 0928 10:44:12.531711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.532495 (+ 784us) service_pool.cc:227] Handling call
0928 10:44:16.773478 (+4240983us) ts_tablet_manager.cc:1145] Deleting tablet efa178fc1e344069b086003d39f1b848
0928 10:44:16.773489 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.777445 (+ 3956us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.796658 (+ 19213us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.815089 (+ 18431us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4240880}
I20260928 10:44:16.815963 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet efa178fc1e344069b086003d39f1b848 (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]) successfully deleted
I20260928 10:44:16.816416 6270 tablet_replica.cc:330] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.816718 6270 raft_consensus.cc:2229] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.816963 6270 raft_consensus.cc:2258] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.817631 6270 ts_tablet_manager.cc:1905] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.827425 6271 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.829300 6271 tablet_bootstrap.cc:654] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.830552 5818 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.834205 5818 leader_election.cc:302] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.835302 7615 raft_consensus.cc:2726] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:16.836535 6270 ts_tablet_manager.cc:1918] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.840488 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.840728 5883 raft_consensus.cc:2454] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.849104 6270 log.cc:1196] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9afe3c828c9747958a7c558716643007
I20260928 10:44:16.850790 6270 ts_tablet_manager.cc:1939] T 9afe3c828c9747958a7c558716643007 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.853062 7585 raft_consensus.cc:482] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.853449 7585 raft_consensus.cc:504] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.854504 7585 leader_election.cc:288] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.855728 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 901) took 4323 ms. Trace:
I20260928 10:44:16.855918 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:16.856112 5880 raft_consensus.cc:3037] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.856635 6270 rpcz_store.cc:276] 0928 10:44:12.531800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.532615 (+ 815us) service_pool.cc:227] Handling call
0928 10:44:16.816336 (+4283721us) ts_tablet_manager.cc:1145] Deleting tablet 9afe3c828c9747958a7c558716643007
0928 10:44:16.816350 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.821111 (+ 4761us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.836366 (+ 15255us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.855671 (+ 19305us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4283620}
I20260928 10:44:16.857155 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9afe3c828c9747958a7c558716643007 (table default.Table_72fa42e53bb14b278e9f91b8c5276960 [id=b9fd4743707c40a9bbfb44b1d14bfe90]) successfully deleted
I20260928 10:44:16.859145 5880 raft_consensus.cc:2454] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:16.861092 6270 tablet_replica.cc:330] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.861423 6270 raft_consensus.cc:2229] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.861708 6270 raft_consensus.cc:2258] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.862344 6270 ts_tablet_manager.cc:1905] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.867792 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cfc6ba341cb0497d9f0dd2749da2265b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.868426 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfc6ba341cb0497d9f0dd2749da2265b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:16.868479 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d85cb2a30f8342ed946f7d773bf8227e consensus state has no leader
I20260928 10:44:16.868913 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f63c073e55804622a62b0e1468ed6ba3" } new_table_name: "default.Table_696f6f8bc9574782a58c3712bb2a0604" modify_external_catalogs: true
I20260928 10:44:16.871261 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:16.872627 5693 catalog_manager.cc:5495] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:16.872852 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 9daef33708ad4eae9b45282d120c87aa (DEFAULT_TABLE table=default.Table_0df7a20f80d44aa9817bbe59ae3a0888 [id=dc778eac6b364f7e82f3caae9ab1d92d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.873072 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:16.873374 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9daef33708ad4eae9b45282d120c87aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.873369 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:16.873608 5693 catalog_manager.cc:5495] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:16.875293 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 9daef33708ad4eae9b45282d120c87aa (DEFAULT_TABLE table=default.Table_0df7a20f80d44aa9817bbe59ae3a0888 [id=dc778eac6b364f7e82f3caae9ab1d92d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.875362 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 7b36ee1848c643b984ae95d80d361021 (DEFAULT_TABLE table=default.Table_e2f20bc701dc4831bb6f8585b1aaa29c [id=1d6aa931cc594817b82be6615e3cbe6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.875698 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b36ee1848c643b984ae95d80d361021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.875747 5862 tablet_service.cc:1467] Processing CreateTablet for tablet e32ad4fd44444041a6b17db68a639858 (DEFAULT_TABLE table=default.Table_dd052dd428ef430f9974abef93a23742 [id=ec31954d87b849eaba193d597c55405c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.876035 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32ad4fd44444041a6b17db68a639858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.878777 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9daef33708ad4eae9b45282d120c87aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.879313 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet c322d11fab43499f82e077fd8a8c02f3 (table default.Table_0796215bba1f4ecc85937aef3b01bee7 [id=07eac26ccf134fb5b9bcc53ba57eb067]). Expected version 1 got 0
I20260928 10:44:16.879576 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet cc50ec106e9b4137b64bf6ce71487979 (table default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e]). Expected version 1 got 0
I20260928 10:44:16.879902 5983 tablet_service.cc:1467] Processing CreateTablet for tablet e32ad4fd44444041a6b17db68a639858 (DEFAULT_TABLE table=default.Table_dd052dd428ef430f9974abef93a23742 [id=ec31954d87b849eaba193d597c55405c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.880275 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32ad4fd44444041a6b17db68a639858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.882925 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 7b36ee1848c643b984ae95d80d361021 (DEFAULT_TABLE table=default.Table_e2f20bc701dc4831bb6f8585b1aaa29c [id=1d6aa931cc594817b82be6615e3cbe6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.883267 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b36ee1848c643b984ae95d80d361021. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:16.893321 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aefce878fd0459c9c6502cfd226e2c7 consensus state has no leader
I20260928 10:44:16.893740 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6cc4bdae4768448b9b6598d8ab40ec6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.894287 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cc4bdae4768448b9b6598d8ab40ec6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.897269 6273 ts_tablet_manager.cc:1428] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.185s user 0.003s sys 0.003s
I20260928 10:44:16.898358 6273 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:16.900346 6273 tablet_bootstrap.cc:654] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:16.900892 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9fd5e4e404df4305a5e7168e2ae71306 consensus state has no leader
I20260928 10:44:16.901378 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5e048035283140fe883a18642f50d8f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.902001 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e048035283140fe883a18642f50d8f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.904201 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 069469d23ccf446284e67d970ffd6efa
I20260928 10:44:16.905810 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 069469d23ccf446284e67d970ffd6efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.905917 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2f19371535ab4a63a437b9503eeb8c3f (DEFAULT_TABLE table=default.Table_5e977c789e184021b9821dd9eb1da987 [id=44953159c2ea47c9873a9f2083b6df1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.906652 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f19371535ab4a63a437b9503eeb8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.909601 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_46da627f37a140bc842d319c71955e03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.910321 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46da627f37a140bc842d319c71955e03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.890877 6270 ts_tablet_manager.cc:1918] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.913043 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2eac1662a03a4d3e994d1dc575325c8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:16.913369 6270 log.cc:1196] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/5f42d5aef2424b3aacc8564d98cd3b67
I20260928 10:44:16.913764 6270 ts_tablet_manager.cc:1939] T 5f42d5aef2424b3aacc8564d98cd3b67 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:16.913743 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eac1662a03a4d3e994d1dc575325c8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.914125 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 896) took 4382 ms. Trace:
I20260928 10:44:16.914258 6271 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:16.914418 6271 ts_tablet_manager.cc:1397] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260928 10:44:16.916473 6271 raft_consensus.cc:348] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.917112 6271 raft_consensus.cc:374] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:16.917456 5991 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c3a6e992a4a35ab73c05a57d16a60 (DEFAULT_TABLE table=default.Table_12b41558208a45519e9cc26f4bf5b1ae [id=47448e76edec4fa9b7b355b26555bcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.917912 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c3a6e992a4a35ab73c05a57d16a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.921584 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebdaf28aff942df9289981612bb94cc (DEFAULT_TABLE table=default.Table_eed9a56bf4674e4a834e316bc9af0e73 [id=60ce987352f549df9abfc265f42e9bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.926147 6271 raft_consensus.cc:729] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:16.926182 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:16.904222 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 2f19371535ab4a63a437b9503eeb8c3f (DEFAULT_TABLE table=default.Table_5e977c789e184021b9821dd9eb1da987 [id=44953159c2ea47c9873a9f2083b6df1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.926959 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f19371535ab4a63a437b9503eeb8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.905187 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 069469d23ccf446284e67d970ffd6efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.918148 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:16.927405 5884 raft_consensus.cc:2454] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:16.927536 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0e149cdb22cc4c60b012c2d87868827b
I20260928 10:44:16.928267 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7abf708f047242498f827cce03ce3342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:16.928894 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7abf708f047242498f827cce03ce3342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:16.921187 5850 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c3a6e992a4a35ab73c05a57d16a60 (DEFAULT_TABLE table=default.Table_12b41558208a45519e9cc26f4bf5b1ae [id=47448e76edec4fa9b7b355b26555bcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.931048 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c3a6e992a4a35ab73c05a57d16a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.931459 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e149cdb22cc4c60b012c2d87868827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.927523 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebdaf28aff942df9289981612bb94cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.944391 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 13455c14a9834156bd5e45179f5d3f41 (DEFAULT_TABLE table=default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7 [id=4ab4489ba1bc48468ddcb9bca1f0700e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.944888 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13455c14a9834156bd5e45179f5d3f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.946642 5991 tablet_service.cc:1467] Processing CreateTablet for tablet a394005c7160467c80dc18c85d756834 (DEFAULT_TABLE table=default.Table_143d8d94dda84b9d8857beb53cae399d [id=0e424cbce80242bb8127da5038ae3fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.947113 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a394005c7160467c80dc18c85d756834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.930521 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e149cdb22cc4c60b012c2d87868827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.927548 6270 rpcz_store.cc:276] 0928 10:44:12.531357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.551960 (+ 20603us) service_pool.cc:227] Handling call
0928 10:44:16.861000 (+4309040us) ts_tablet_manager.cc:1145] Deleting tablet 5f42d5aef2424b3aacc8564d98cd3b67
0928 10:44:16.861014 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.870206 (+ 9192us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.890732 (+ 20526us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.914089 (+ 23357us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4308120}
I20260928 10:44:16.926460 6271 consensus_queue.cc:260] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:16.948266 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 903) took 4064 ms. Trace:
I20260928 10:44:16.948398 6270 rpcz_store.cc:276] 0928 10:44:12.883657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.883736 (+ 79us) service_pool.cc:227] Handling call
0928 10:44:16.948087 (+4064351us) ts_tablet_manager.cc:1145] Deleting tablet daf7a87b82424e25ae47d3f61c2ddb7f
0928 10:44:16.948099 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.948211 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4004384}
I20260928 10:44:16.948525 6271 ts_tablet_manager.cc:1428] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260928 10:44:16.948764 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 904) took 4054 ms. Trace:
I20260928 10:44:16.948894 6270 rpcz_store.cc:276] 0928 10:44:12.894094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.894155 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:16.948616 (+4054461us) ts_tablet_manager.cc:1145] Deleting tablet a36ae00e0f664d4da444a6a4a17bcbca
0928 10:44:16.948627 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.948723 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4003734}
I20260928 10:44:16.949203 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 905) took 4014 ms. Trace:
I20260928 10:44:16.949149 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebdaf28aff942df9289981612bb94cc (DEFAULT_TABLE table=default.Table_eed9a56bf4674e4a834e316bc9af0e73 [id=60ce987352f549df9abfc265f42e9bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.949335 6270 rpcz_store.cc:276] 0928 10:44:12.934321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.934389 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:16.949078 (+4014689us) ts_tablet_manager.cc:1145] Deleting tablet 8b167fd6cdbd4b829d962ebafeee0272
0928 10:44:16.949088 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.949164 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4003501}
I20260928 10:44:16.949585 6270 tablet_replica.cc:330] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:16.949856 6270 raft_consensus.cc:2229] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:16.950031 6270 raft_consensus.cc:2258] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:16.951632 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 5f42d5aef2424b3aacc8564d98cd3b67 (table default.Table_868c82ae2401426fae6d2aea18ca318b [id=7d91230c80fd4951adc2206362b423ec]) successfully deleted
W20260928 10:44:16.951912 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet daf7a87b82424e25ae47d3f61c2ddb7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daf7a87b82424e25ae47d3f61c2ddb7f already in progress: creating tablet
W20260928 10:44:16.952092 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a36ae00e0f664d4da444a6a4a17bcbca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ae00e0f664d4da444a6a4a17bcbca already in progress: creating tablet
W20260928 10:44:16.952320 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8b167fd6cdbd4b829d962ebafeee0272 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b167fd6cdbd4b829d962ebafeee0272 already in progress: creating tablet
I20260928 10:44:16.952229 5986 tablet_service.cc:1467] Processing CreateTablet for tablet fd6fe87e1f9e42258519c562dc8a1a94 (DEFAULT_TABLE table=default.Table_390c5c14b5094f9b85d960886548562f [id=d22890a513854fea84d8781aa9849dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.952702 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6fe87e1f9e42258519c562dc8a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.955603 6269 ts_tablet_manager.cc:1918] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.955844 6269 log.cc:1196] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/cd65a860b00d4a7ba8ae92dde5818212
I20260928 10:44:16.956256 6269 ts_tablet_manager.cc:1939] T cd65a860b00d4a7ba8ae92dde5818212 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:16.948799 6271 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:16.962723 6270 ts_tablet_manager.cc:1905] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:16.963220 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5640b425dd9945539dbdf658994c7918
I20260928 10:44:16.963845 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8ca6e9f8325340a98cbba1bd1df669d9" } new_table_name: "default.Table_955c8d7144fa470abeeb140f145a01d1" modify_external_catalogs: true
I20260928 10:44:16.966900 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 9a80c5aa5e8548799a7d4ab54932bda8 (DEFAULT_TABLE table=default.Table_b1d6629390ff446f954502b32d093231 [id=bed6e1331aee4a31b8f14b48f2951118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.968276 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 5640b425dd9945539dbdf658994c7918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:16.939145 5957 leader_election.cc:302] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:16.969606 7168 raft_consensus.cc:2781] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:16.969723 7168 raft_consensus.cc:482] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:16.969830 7168 raft_consensus.cc:3037] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:16.970221 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a19b71a335045819bf7d07c19b45929" } modify_external_catalogs: true
I20260928 10:44:16.970422 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8a19b71a335045819bf7d07c19b45929" } modify_external_catalogs: true
I20260928 10:44:16.972278 7168 raft_consensus.cc:504] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:16.972932 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 069469d23ccf446284e67d970ffd6efa (DEFAULT_TABLE table=default.Table_bdd5c076fa3043b8b40005418342a901 [id=81ea5ccd7da5455a9cb335c3b8d3b049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.973218 7168 leader_election.cc:288] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.974861 6270 ts_tablet_manager.cc:1918] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:16.974956 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebdaf28aff942df9289981612bb94cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.975739 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 069469d23ccf446284e67d970ffd6efa (DEFAULT_TABLE table=default.Table_bdd5c076fa3043b8b40005418342a901 [id=81ea5ccd7da5455a9cb335c3b8d3b049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.975916 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 13455c14a9834156bd5e45179f5d3f41 (DEFAULT_TABLE table=default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7 [id=4ab4489ba1bc48468ddcb9bca1f0700e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.976070 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069469d23ccf446284e67d970ffd6efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.976338 5854 tablet_service.cc:1467] Processing CreateTablet for tablet fd6fe87e1f9e42258519c562dc8a1a94 (DEFAULT_TABLE table=default.Table_390c5c14b5094f9b85d960886548562f [id=d22890a513854fea84d8781aa9849dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.976620 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6fe87e1f9e42258519c562dc8a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.978387 6270 log.cc:1196] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/39cbecd1c19541f28bd32b7c46f2df61
I20260928 10:44:16.978574 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 5640b425dd9945539dbdf658994c7918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:16.978700 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 9a80c5aa5e8548799a7d4ab54932bda8 (DEFAULT_TABLE table=default.Table_b1d6629390ff446f954502b32d093231 [id=bed6e1331aee4a31b8f14b48f2951118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.978822 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13455c14a9834156bd5e45179f5d3f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.978813 6270 ts_tablet_manager.cc:1939] T 39cbecd1c19541f28bd32b7c46f2df61 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:16.978957 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a80c5aa5e8548799a7d4ab54932bda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.982612 7168 raft_consensus.cc:482] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:16.982800 7168 raft_consensus.cc:504] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:16.983590 7168 leader_election.cc:288] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:16.985194 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.985728 5955 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.985913 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b (DEFAULT_TABLE table=default.Table_53b45401a11d480983d2e28849b9ec52 [id=802816d7ee264c068863bf2236c415a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.987375 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a80c5aa5e8548799a7d4ab54932bda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.987798 6119 tablet_service.cc:1467] Processing CreateTablet for tablet e32ad4fd44444041a6b17db68a639858 (DEFAULT_TABLE table=default.Table_dd052dd428ef430f9974abef93a23742 [id=ec31954d87b849eaba193d597c55405c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.988117 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f078ae6d2b498d8c5af90afba887ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.988271 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 7b36ee1848c643b984ae95d80d361021 (DEFAULT_TABLE table=default.Table_e2f20bc701dc4831bb6f8585b1aaa29c [id=1d6aa931cc594817b82be6615e3cbe6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.988404 7455 consensus_queue.cc:1035] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260928 10:44:16.988790 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 9daef33708ad4eae9b45282d120c87aa (DEFAULT_TABLE table=default.Table_0df7a20f80d44aa9817bbe59ae3a0888 [id=dc778eac6b364f7e82f3caae9ab1d92d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.988955 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a8f5241dd14684b5544e47d6cec9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.989127 7600 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:16.990286 6135 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c3a6e992a4a35ab73c05a57d16a60 (DEFAULT_TABLE table=default.Table_12b41558208a45519e9cc26f4bf5b1ae [id=47448e76edec4fa9b7b355b26555bcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.990309 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 2f19371535ab4a63a437b9503eeb8c3f (DEFAULT_TABLE table=default.Table_5e977c789e184021b9821dd9eb1da987 [id=44953159c2ea47c9873a9f2083b6df1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.990911 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a0b0e9216404d80f439b9c0c5dcca (DEFAULT_TABLE table=default.Table_433c4dbf74304d2bbfb69b9fb75ac08a [id=9a54704d30004a1aaad8c6302f85b2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.991266 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a0b0e9216404d80f439b9c0c5dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.994105 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:16.994760 5955 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.995663 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:16.996255 5955 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:16.999058 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32ad4fd44444041a6b17db68a639858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.999197 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b (DEFAULT_TABLE table=default.Table_78b4faac9b3840ad92ad3350a8777a44 [id=c00a148a1df14b0192afd556f6863aa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.999241 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 868f5eeb1b8046419ff98fc5d6b1f670 (DEFAULT_TABLE table=default.Table_c12b8a90ee4a4c99a8e28da7f3788bc9 [id=68b7da23a40342f8ade338cf038dd368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.999403 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c3a6e992a4a35ab73c05a57d16a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:16.999437 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 069469d23ccf446284e67d970ffd6efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:16.999601 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.999626 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebdaf28aff942df9289981612bb94cc (DEFAULT_TABLE table=default.Table_eed9a56bf4674e4a834e316bc9af0e73 [id=60ce987352f549df9abfc265f42e9bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:16.999977 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebdaf28aff942df9289981612bb94cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.002684 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b36ee1848c643b984ae95d80d361021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.002622 5991 tablet_service.cc:1467] Processing CreateTablet for tablet aefeefbce8de4661a4426937ec28f8dc (DEFAULT_TABLE table=default.Table_8bef3f43e8474ffdae2e4a41ced429df [id=79149ed8fd244e8f998b2b409cf5673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.003093 6131 tablet_service.cc:1467] Processing CreateTablet for tablet a394005c7160467c80dc18c85d756834 (DEFAULT_TABLE table=default.Table_143d8d94dda84b9d8857beb53cae399d [id=0e424cbce80242bb8127da5038ae3fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.006294 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 32f24476c63549e79975ef4102a248e1 (DEFAULT_TABLE table=default.Table_681e7c813bba489da7db3c3fcc2407bf [id=fe1cda10ef714c62a7236f6ca29282a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.007534 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 45814bb909ed4a15a39a0819973042d2 (DEFAULT_TABLE table=default.Table_e7c7255a349a41febd0f10821dff155a [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.008797 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb9d2a9df0d4582be7ff58debd1c9df (DEFAULT_TABLE table=default.Table_eb68eaf68a9f47efba2de9cb77271827 [id=1d458a1bd34f4750ae02aaaa7ce9affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.012897 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf (DEFAULT_TABLE table=default.Table_6eb4514772cd4d52acbd6f76f0dc0304 [id=b7fce02efdbc49e1b1d3c993073da420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.013793 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049def79ba394ccd8d2a29d7d55e5e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.014104 5998 tablet_service.cc:1467] Processing CreateTablet for tablet ab30bcc780e14445b04fe9ffa7678a0d (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.014554 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab30bcc780e14445b04fe9ffa7678a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.019093 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a394005c7160467c80dc18c85d756834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.019953 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 13455c14a9834156bd5e45179f5d3f41 (DEFAULT_TABLE table=default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7 [id=4ab4489ba1bc48468ddcb9bca1f0700e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.020385 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13455c14a9834156bd5e45179f5d3f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.023070 5862 tablet_service.cc:1467] Processing CreateTablet for tablet a394005c7160467c80dc18c85d756834 (DEFAULT_TABLE table=default.Table_143d8d94dda84b9d8857beb53cae399d [id=0e424cbce80242bb8127da5038ae3fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.025264 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 9a80c5aa5e8548799a7d4ab54932bda8 (DEFAULT_TABLE table=default.Table_b1d6629390ff446f954502b32d093231 [id=bed6e1331aee4a31b8f14b48f2951118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.026407 7557 ts_tablet_manager.cc:1918] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 10:44:17.026964 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 069469d23ccf446284e67d970ffd6efa (DEFAULT_TABLE table=default.Table_bdd5c076fa3043b8b40005418342a901 [id=81ea5ccd7da5455a9cb335c3b8d3b049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.027412 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e149cdb22cc4c60b012c2d87868827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.028226 7584 raft_consensus.cc:482] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.030505 7582 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:17.031745 6275 tablet_bootstrap.cc:654] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.034631 5698 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_a94782135cfc47238d8c70e24a6d4dd5 [id=688359adeeea4de79516ab81770bb710] alter complete (version 3)
I20260928 10:44:17.037233 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9daef33708ad4eae9b45282d120c87aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.038516 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cea632558fd546a0a7ef17c050973ebc consensus state has no leader
I20260928 10:44:17.038802 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 4a5564088c5e45788794f130134b5ba5 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:17.040280 7455 raft_consensus.cc:482] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.040464 7455 raft_consensus.cc:504] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.040802 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f19371535ab4a63a437b9503eeb8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.041131 7455 leader_election.cc:288] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.041203 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069469d23ccf446284e67d970ffd6efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.043699 7557 log.cc:1196] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d64c1af58d6a4dfcabd6eecb8c75d572
I20260928 10:44:17.046972 7584 raft_consensus.cc:504] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.047463 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eded874aa094054b0c2e7c2e592dba1" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.047709 7584 leader_election.cc:288] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.048480 6271 tablet_bootstrap.cc:654] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.051085 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b (DEFAULT_TABLE table=default.Table_78b4faac9b3840ad92ad3350a8777a44 [id=c00a148a1df14b0192afd556f6863aa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.051196 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 45814bb909ed4a15a39a0819973042d2 (DEFAULT_TABLE table=default.Table_e7c7255a349a41febd0f10821dff155a [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.051785 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2046ebde9440e8a5ce572172366877 (DEFAULT_TABLE table=default.Table_f01023aa1540413faac360ea5703e6ca [id=b53c281664514f229beac578325f9cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.052268 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 868f5eeb1b8046419ff98fc5d6b1f670 (DEFAULT_TABLE table=default.Table_c12b8a90ee4a4c99a8e28da7f3788bc9 [id=68b7da23a40342f8ade338cf038dd368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.052593 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb9d2a9df0d4582be7ff58debd1c9df (DEFAULT_TABLE table=default.Table_eb68eaf68a9f47efba2de9cb77271827 [id=1d458a1bd34f4750ae02aaaa7ce9affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.052702 6130 tablet_service.cc:1467] Processing CreateTablet for tablet aefeefbce8de4661a4426937ec28f8dc (DEFAULT_TABLE table=default.Table_8bef3f43e8474ffdae2e4a41ced429df [id=79149ed8fd244e8f998b2b409cf5673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.060278 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a0b0e9216404d80f439b9c0c5dcca (DEFAULT_TABLE table=default.Table_433c4dbf74304d2bbfb69b9fb75ac08a [id=9a54704d30004a1aaad8c6302f85b2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.060500 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 32f24476c63549e79975ef4102a248e1 (DEFAULT_TABLE table=default.Table_681e7c813bba489da7db3c3fcc2407bf [id=fe1cda10ef714c62a7236f6ca29282a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.060663 6118 tablet_service.cc:1467] Processing CreateTablet for tablet fd6fe87e1f9e42258519c562dc8a1a94 (DEFAULT_TABLE table=default.Table_390c5c14b5094f9b85d960886548562f [id=d22890a513854fea84d8781aa9849dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.060927 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a80c5aa5e8548799a7d4ab54932bda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.061206 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45814bb909ed4a15a39a0819973042d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.061264 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.061414 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f24476c63549e79975ef4102a248e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.061604 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049def79ba394ccd8d2a29d7d55e5e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.061738 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.062160 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb9d2a9df0d4582be7ff58debd1c9df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.062891 5955 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.064203 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6fe87e1f9e42258519c562dc8a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.066555 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 868f5eeb1b8046419ff98fc5d6b1f670. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.072331 5955 consensus_peers.cc:487] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.078310 7557 ts_tablet_manager.cc:1939] T d64c1af58d6a4dfcabd6eecb8c75d572 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:17.082806 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2046ebde9440e8a5ce572172366877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.083096 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aefeefbce8de4661a4426937ec28f8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.067663 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf (DEFAULT_TABLE table=default.Table_6eb4514772cd4d52acbd6f76f0dc0304 [id=b7fce02efdbc49e1b1d3c993073da420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.084677 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9d8fe2a3cf6d4876baa28468029c3157"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.085276 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d8fe2a3cf6d4876baa28468029c3157 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.085707 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.086534 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d96e1b0fcf9e4fe199708e8b2427c477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.087044 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d96e1b0fcf9e4fe199708e8b2427c477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.087477 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 868f5eeb1b8046419ff98fc5d6b1f670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.092432 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 924) took 3728 ms. Trace:
I20260928 10:44:17.092532 6270 rpcz_store.cc:276] 0928 10:44:13.364376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.364422 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:16.949520 (+3585098us) ts_tablet_manager.cc:1145] Deleting tablet 39cbecd1c19541f28bd32b7c46f2df61
0928 10:44:16.949530 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.966130 (+ 16600us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.974732 (+ 8602us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.092414 (+117682us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3442032}
I20260928 10:44:17.093152 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 39cbecd1c19541f28bd32b7c46f2df61 (table default.Table_96c0113a38234d5fa727f275b4dde281 [id=0e2cd69449224ba0a1d4cae1da393956]) successfully deleted
I20260928 10:44:17.093242 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec5581fdc4ad587185cd5bb8a35fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.093619 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2046ebde9440e8a5ce572172366877 (DEFAULT_TABLE table=default.Table_f01023aa1540413faac360ea5703e6ca [id=b53c281664514f229beac578325f9cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.094044 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2046ebde9440e8a5ce572172366877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.093896 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c0854bf35562488b9269fe6813ea878c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.094389 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0854bf35562488b9269fe6813ea878c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.095021 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7a26d53dfe2c44d2be4451fde7f892b4" } modify_external_catalogs: true
I20260928 10:44:17.095225 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7a26d53dfe2c44d2be4451fde7f892b4" } modify_external_catalogs: true
I20260928 10:44:17.096597 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aefeefbce8de4661a4426937ec28f8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.092931 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 923) took 3728 ms. Trace:
I20260928 10:44:17.097087 6270 rpcz_store.cc:276] 0928 10:44:13.364290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.365134 (+ 844us) service_pool.cc:227] Handling call
0928 10:44:17.092808 (+3727674us) ts_tablet_manager.cc:1145] Deleting tablet 1c7131f9259a404382e86ad06c52b584
0928 10:44:17.092818 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.092914 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3,"tablet-delete.queue_time_us":3585302}
I20260928 10:44:17.097437 6270 tablet_replica.cc:330] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.097608 6270 raft_consensus.cc:2229] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.097899 6270 raft_consensus.cc:2258] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.099682 6270 ts_tablet_manager.cc:1905] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.102044 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f24476c63549e79975ef4102a248e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.102533 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1c7131f9259a404382e86ad06c52b584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c7131f9259a404382e86ad06c52b584 already in progress: creating tablet
I20260928 10:44:17.107158 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45814bb909ed4a15a39a0819973042d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.107368 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.109695 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b (DEFAULT_TABLE table=default.Table_53b45401a11d480983d2e28849b9ec52 [id=802816d7ee264c068863bf2236c415a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.110106 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.110605 6270 ts_tablet_manager.cc:1918] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.110682 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069469d23ccf446284e67d970ffd6efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.110708 6270 log.cc:1196] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:17.110963 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a394005c7160467c80dc18c85d756834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.111045 6270 ts_tablet_manager.cc:1939] T f7d762e03b384d85b4e04be8331474a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.111333 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 942) took 3450 ms. Trace:
I20260928 10:44:17.111413 6270 rpcz_store.cc:276] 0928 10:44:13.661192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.661651 (+ 459us) service_pool.cc:227] Handling call
0928 10:44:17.097394 (+3435743us) ts_tablet_manager.cc:1145] Deleting tablet f7d762e03b384d85b4e04be8331474a4
0928 10:44:17.097406 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.102540 (+ 5134us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.110523 (+ 7983us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.111319 (+ 796us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3435225}
I20260928 10:44:17.111775 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 943) took 3449 ms. Trace:
I20260928 10:44:17.111842 6270 rpcz_store.cc:276] 0928 10:44:13.662830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.663146 (+ 316us) service_pool.cc:227] Handling call
0928 10:44:17.111659 (+3448513us) ts_tablet_manager.cc:1145] Deleting tablet b1cdff9f01974354a81179dd9bd5a26e
0928 10:44:17.111668 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.111762 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3448175}
I20260928 10:44:17.112097 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 944) took 3440 ms. Trace:
I20260928 10:44:17.112166 6270 rpcz_store.cc:276] 0928 10:44:13.671399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.684471 (+ 13072us) service_pool.cc:227] Handling call
0928 10:44:17.112020 (+3427549us) ts_tablet_manager.cc:1145] Deleting tablet d1b89a8edd5645afa41693f5bca42f8d
0928 10:44:17.112028 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.112086 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3427363}
I20260928 10:44:17.112426 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 945) took 3416 ms. Trace:
I20260928 10:44:17.112489 6270 rpcz_store.cc:276] 0928 10:44:13.695751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.695824 (+ 73us) service_pool.cc:227] Handling call
0928 10:44:17.112335 (+3416511us) ts_tablet_manager.cc:1145] Deleting tablet de99da54941a4eaf9107f4b2efca5c7b
0928 10:44:17.112343 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.112411 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3416337}
I20260928 10:44:17.112736 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 946) took 3411 ms. Trace:
I20260928 10:44:17.112903 6270 rpcz_store.cc:276] 0928 10:44:13.701113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.701759 (+ 646us) service_pool.cc:227] Handling call
0928 10:44:17.112654 (+3410895us) ts_tablet_manager.cc:1145] Deleting tablet c2af1c83c4544bc68c67f7002742b2cd
0928 10:44:17.112662 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.112725 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3410710}
I20260928 10:44:17.113164 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 947) took 3382 ms. Trace:
I20260928 10:44:17.113226 6270 rpcz_store.cc:276] 0928 10:44:13.730842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.731438 (+ 596us) service_pool.cc:227] Handling call
0928 10:44:17.113068 (+3381630us) ts_tablet_manager.cc:1145] Deleting tablet bb4590c83aa24745af278fcac0a9d518
0928 10:44:17.113077 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.113151 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3381372}
I20260928 10:44:17.113471 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 949) took 3313 ms. Trace:
I20260928 10:44:17.113574 6270 rpcz_store.cc:276] 0928 10:44:13.800360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.802578 (+ 2218us) service_pool.cc:227] Handling call
0928 10:44:17.113400 (+3310822us) ts_tablet_manager.cc:1145] Deleting tablet c2635c7c47ba4383b6b0f07cd3b42f74
0928 10:44:17.113408 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.113457 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3310548}
I20260928 10:44:17.113776 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb9d2a9df0d4582be7ff58debd1c9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.115458 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 823) took 7699 ms. Trace:
I20260928 10:44:17.115767 6269 rpcz_store.cc:276] 0928 10:44:09.416233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.518691 (+102458us) service_pool.cc:227] Handling call
0928 10:44:16.650456 (+7131765us) ts_tablet_manager.cc:1145] Deleting tablet cd65a860b00d4a7ba8ae92dde5818212
0928 10:44:16.650465 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.838027 (+187562us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.955493 (+117466us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.115400 (+159907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7131532}
I20260928 10:44:17.116572 6269 tablet_replica.cc:330] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:17.117053 6269 raft_consensus.cc:2229] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.118340 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f7d762e03b384d85b4e04be8331474a4 (table default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]) successfully deleted
W20260928 10:44:17.120859 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b1cdff9f01974354a81179dd9bd5a26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1cdff9f01974354a81179dd9bd5a26e already in progress: creating tablet
I20260928 10:44:17.120959 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a0b0e9216404d80f439b9c0c5dcca (DEFAULT_TABLE table=default.Table_433c4dbf74304d2bbfb69b9fb75ac08a [id=9a54704d30004a1aaad8c6302f85b2c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:17.121104 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d1b89a8edd5645afa41693f5bca42f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1b89a8edd5645afa41693f5bca42f8d already in progress: creating tablet
W20260928 10:44:17.121294 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet de99da54941a4eaf9107f4b2efca5c7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de99da54941a4eaf9107f4b2efca5c7b already in progress: creating tablet
I20260928 10:44:17.121359 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a0b0e9216404d80f439b9c0c5dcca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.121464 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c2af1c83c4544bc68c67f7002742b2cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2af1c83c4544bc68c67f7002742b2cd already in progress: creating tablet
W20260928 10:44:17.121631 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet bb4590c83aa24745af278fcac0a9d518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb4590c83aa24745af278fcac0a9d518 already in progress: creating tablet
W20260928 10:44:17.121815 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c2635c7c47ba4383b6b0f07cd3b42f74 because the tablet was not found. No further retry: Not found: Tablet not found: c2635c7c47ba4383b6b0f07cd3b42f74
I20260928 10:44:17.113787 6270 tablet_replica.cc:330] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.123217 6270 raft_consensus.cc:2229] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.123595 6270 raft_consensus.cc:2258] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.124235 6270 ts_tablet_manager.cc:1905] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.126807 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 868f5eeb1b8046419ff98fc5d6b1f670 (DEFAULT_TABLE table=default.Table_c12b8a90ee4a4c99a8e28da7f3788bc9 [id=68b7da23a40342f8ade338cf038dd368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.127203 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 868f5eeb1b8046419ff98fc5d6b1f670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.127810 5854 tablet_service.cc:1467] Processing CreateTablet for tablet aefeefbce8de4661a4426937ec28f8dc (DEFAULT_TABLE table=default.Table_8bef3f43e8474ffdae2e4a41ced429df [id=79149ed8fd244e8f998b2b409cf5673e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.128144 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aefeefbce8de4661a4426937ec28f8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.129451 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.129778 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec5581fdc4ad587185cd5bb8a35fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.136482 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b (DEFAULT_TABLE table=default.Table_53b45401a11d480983d2e28849b9ec52 [id=802816d7ee264c068863bf2236c415a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.136845 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 5640b425dd9945539dbdf658994c7918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.136991 6275 tablet_bootstrap.cc:492] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:17.137112 6275 ts_tablet_manager.cc:1397] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.333s user 0.004s sys 0.000s
I20260928 10:44:17.137818 6275 raft_consensus.cc:348] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.137944 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1000) took 1057 ms. Trace:
I20260928 10:44:17.138026 6275 raft_consensus.cc:374] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.138082 6275 raft_consensus.cc:729] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.138288 6275 consensus_queue.cc:260] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.138041 7557 rpcz_store.cc:276] 0928 10:44:16.076603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.076645 (+ 42us) service_pool.cc:227] Handling call
0928 10:44:16.362628 (+285983us) ts_tablet_manager.cc:1145] Deleting tablet d64c1af58d6a4dfcabd6eecb8c75d572
0928 10:44:16.362641 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:16.654331 (+291690us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:16.998732 (+344401us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.133757 (+135025us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":285717}
I20260928 10:44:17.138710 7557 tablet_replica.cc:330] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:17.138887 6275 ts_tablet_manager.cc:1428] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:17.139027 7557 raft_consensus.cc:2229] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.139304 6131 tablet_service.cc:1467] Processing CreateTablet for tablet ab30bcc780e14445b04fe9ffa7678a0d (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.120501 6269 raft_consensus.cc:2258] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.143215 6269 ts_tablet_manager.cc:1905] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.155957 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf (DEFAULT_TABLE table=default.Table_6eb4514772cd4d52acbd6f76f0dc0304 [id=b7fce02efdbc49e1b1d3c993073da420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.156425 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.156343 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb9d2a9df0d4582be7ff58debd1c9df (DEFAULT_TABLE table=default.Table_eb68eaf68a9f47efba2de9cb77271827 [id=1d458a1bd34f4750ae02aaaa7ce9affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.157411 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet cd65a860b00d4a7ba8ae92dde5818212 (table default.Table_5cb651a795e04fc59d29bd7535556cbf [id=cfdc4695a4d8442b88b15f1a81a95c5b]) successfully deleted
I20260928 10:44:17.158320 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a0b0e9216404d80f439b9c0c5dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.158289 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 45814bb909ed4a15a39a0819973042d2 (DEFAULT_TABLE table=default.Table_e7c7255a349a41febd0f10821dff155a [id=1b8945bb5a134afda7e060bee5a2fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.158596 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.159634 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 32f24476c63549e79975ef4102a248e1 (DEFAULT_TABLE table=default.Table_681e7c813bba489da7db3c3fcc2407bf [id=fe1cda10ef714c62a7236f6ca29282a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.160018 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2046ebde9440e8a5ce572172366877 (DEFAULT_TABLE table=default.Table_f01023aa1540413faac360ea5703e6ca [id=b53c281664514f229beac578325f9cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.160382 5860 tablet_service.cc:1467] Processing CreateTablet for tablet ab30bcc780e14445b04fe9ffa7678a0d (DEFAULT_TABLE table=default.Table_dacd9275d37d45dd8c5d16dbd0ddc5e6 [id=c17859785a5e48fb9712b936cdde1336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.162086 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb9d2a9df0d4582be7ff58debd1c9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.163551 6275 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:17.139312 7557 raft_consensus.cc:2258] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.173143 7557 ts_tablet_manager.cc:1905] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.189285 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380ec5581fdc4ad587185cd5bb8a35fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.189939 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d64c1af58d6a4dfcabd6eecb8c75d572 (table default.Table_8062a54a93234807a39d7ff0f8787f73 [id=2d4736814acb47298c4f96e849f840f6]) successfully deleted
I20260928 10:44:17.187919 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eded874aa094054b0c2e7c2e592dba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.194494 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab30bcc780e14445b04fe9ffa7678a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.195768 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab30bcc780e14445b04fe9ffa7678a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.203712 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45814bb909ed4a15a39a0819973042d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.212558 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f24476c63549e79975ef4102a248e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.213088 6270 ts_tablet_manager.cc:1918] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.216477 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2046ebde9440e8a5ce572172366877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.221047 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.223774 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.224107 6270 log.cc:1196] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/b6d5121db2d34ea99c851595c395f3be
I20260928 10:44:17.224709 6270 ts_tablet_manager.cc:1939] T b6d5121db2d34ea99c851595c395f3be P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.225140 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 950) took 3424 ms. Trace:
I20260928 10:44:17.225023 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b (DEFAULT_TABLE table=default.Table_78b4faac9b3840ad92ad3350a8777a44 [id=c00a148a1df14b0192afd556f6863aa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.225328 6270 rpcz_store.cc:276] 0928 10:44:13.800483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.802903 (+ 2420us) service_pool.cc:227] Handling call
0928 10:44:17.113752 (+3310849us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:17.113760 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.209749 (+ 95989us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.212986 (+ 3237us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.225111 (+ 12125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3310726}
I20260928 10:44:17.225957 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049def79ba394ccd8d2a29d7d55e5e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.226015 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet b6d5121db2d34ea99c851595c395f3be (table default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]) successfully deleted
I20260928 10:44:17.226521 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 951) took 3425 ms. Trace:
I20260928 10:44:17.226655 6270 rpcz_store.cc:276] 0928 10:44:13.800633 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.803060 (+ 2427us) service_pool.cc:227] Handling call
0928 10:44:17.226361 (+3423301us) ts_tablet_manager.cc:1145] Deleting tablet 3d5b422c70a84cc0bc9f8a686f4e2c82
0928 10:44:17.226374 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.226466 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3423183}
W20260928 10:44:17.227210 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3d5b422c70a84cc0bc9f8a686f4e2c82 because the tablet was not found. No further retry: Not found: Tablet not found: 3d5b422c70a84cc0bc9f8a686f4e2c82
I20260928 10:44:17.227595 6270 tablet_replica.cc:330] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.227833 6270 raft_consensus.cc:2229] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.228065 6270 raft_consensus.cc:2258] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.228940 6270 ts_tablet_manager.cc:1905] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.232707 6273 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.232923 6273 ts_tablet_manager.cc:1397] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.335s user 0.016s sys 0.020s
I20260928 10:44:17.233780 6273 raft_consensus.cc:348] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.234086 6273 raft_consensus.cc:374] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.234179 6273 raft_consensus.cc:729] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.234462 6273 consensus_queue.cc:260] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.236359 6270 ts_tablet_manager.cc:1918] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.237926 6273 ts_tablet_manager.cc:1428] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 10:44:17.240636 6270 log.cc:1196] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:17.241027 6270 ts_tablet_manager.cc:1939] T 44bc6831f9354ddb81212bc107efdf68 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.241366 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 948) took 3441 ms. Trace:
I20260928 10:44:17.241448 6270 rpcz_store.cc:276] 0928 10:44:13.800239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.804764 (+ 4525us) service_pool.cc:227] Handling call
0928 10:44:17.227545 (+3422781us) ts_tablet_manager.cc:1145] Deleting tablet 44bc6831f9354ddb81212bc107efdf68
0928 10:44:17.227557 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.233403 (+ 5846us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.236255 (+ 2852us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.241346 (+ 5091us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3422552}
I20260928 10:44:17.241936 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 44bc6831f9354ddb81212bc107efdf68 (table default.Table_ccc54fc0e3d24f22a89149b227256f81 [id=7e99e684b74f47279b22e18c1cf09935]) successfully deleted
I20260928 10:44:17.242285 6270 tablet_replica.cc:330] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.254817 6273 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.256417 6273 tablet_bootstrap.cc:654] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.257476 6275 tablet_bootstrap.cc:654] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.258069 6271 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.263094 6271 ts_tablet_manager.cc:1397] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.314s user 0.004s sys 0.004s
I20260928 10:44:17.265280 6271 raft_consensus.cc:348] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.267257 5957 leader_election.cc:302] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.267318 7616 raft_consensus.cc:482] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.267467 7616 raft_consensus.cc:504] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.267663 7584 raft_consensus.cc:2781] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.267764 7584 raft_consensus.cc:686] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.268060 7616 leader_election.cc:288] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.268000 7584 consensus_queue.cc:237] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.268299 7616 raft_consensus.cc:482] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.268397 7616 raft_consensus.cc:504] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.268832 7616 leader_election.cc:288] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.270229 6271 raft_consensus.cc:374] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.270570 7616 raft_consensus.cc:482] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.270680 7616 raft_consensus.cc:504] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.270606 6271 raft_consensus.cc:729] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.271138 7616 leader_election.cc:288] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.279819 7455 consensus_queue.cc:1035] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:17.284411 6273 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.284718 6273 ts_tablet_manager.cc:1397] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.003s
W20260928 10:44:17.287829 5955 consensus_peers.cc:487] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.288275 6273 raft_consensus.cc:348] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.288774 6273 raft_consensus.cc:374] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.288964 6273 raft_consensus.cc:729] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.289429 6273 consensus_queue.cc:260] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.290935 6273 ts_tablet_manager.cc:1428] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260928 10:44:17.291535 6273 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.294068 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.294092 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.271493 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:17.295058 5817 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:17.295253 5817 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:17.295377 5817 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.295255 6271 consensus_queue.cc:260] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.296865 6271 ts_tablet_manager.cc:1428] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.033s user 0.000s sys 0.003s
I20260928 10:44:17.297660 6271 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.298954 6270 raft_consensus.cc:2229] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.299521 6270 raft_consensus.cc:2258] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.300109 6270 ts_tablet_manager.cc:1905] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.307766 7455 raft_consensus.cc:482] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.307952 7455 raft_consensus.cc:504] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.308903 7455 leader_election.cc:288] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.308907 6270 ts_tablet_manager.cc:1918] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:17.309106 6270 log.cc:1196] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:17.309779 6270 ts_tablet_manager.cc:1939] T ffa971239a2b4ac6bc309dfbacdbe12e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.310014 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.310221 6015 raft_consensus.cc:2454] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:17.310313 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 952) took 3328 ms. Trace:
I20260928 10:44:17.310447 6270 rpcz_store.cc:276] 0928 10:44:13.981612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.981687 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:17.242237 (+3260550us) ts_tablet_manager.cc:1145] Deleting tablet ffa971239a2b4ac6bc309dfbacdbe12e
0928 10:44:17.242249 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.299220 (+ 56971us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x615000097a24. stack: 00007f07d55a366e 00007f07d55a3430 00007f07d462a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f07e0adb04d 00007f07e1d7f5ec 00007f07e470e2e6 00007f07e4740404 00007f07e4721870 00007f07e47215fd 00000000009edb7c 00007f07d55e9344 00007f07d55ec91b 00007f07d55ec798
0928 10:44:17.303788 (+ 4568us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.308715 (+ 4927us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.310267 (+ 1552us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":129795456,"tablet-delete.queue_time_us":3260380}
I20260928 10:44:17.311204 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]) successfully deleted
I20260928 10:44:17.311195 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 958) took 3172 ms. Trace:
I20260928 10:44:17.311323 6270 rpcz_store.cc:276] 0928 10:44:14.138630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.142600 (+ 3970us) service_pool.cc:227] Handling call
0928 10:44:17.310970 (+3168370us) ts_tablet_manager.cc:1145] Deleting tablet 19e0768dea6a40889a3f50b953c0ee4d
0928 10:44:17.310985 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.311178 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3168117}
I20260928 10:44:17.311856 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 962) took 3143 ms. Trace:
W20260928 10:44:17.311977 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 19e0768dea6a40889a3f50b953c0ee4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19e0768dea6a40889a3f50b953c0ee4d already in progress: creating tablet
I20260928 10:44:17.311985 6270 rpcz_store.cc:276] 0928 10:44:14.168412 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.168472 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:17.311673 (+3143201us) ts_tablet_manager.cc:1145] Deleting tablet 91337888b5864a2286b9afb7fcba8c98
0928 10:44:17.311711 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.311839 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3142995}
W20260928 10:44:17.312510 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 91337888b5864a2286b9afb7fcba8c98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91337888b5864a2286b9afb7fcba8c98 already in progress: creating tablet
I20260928 10:44:17.312525 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 963) took 3143 ms. Trace:
I20260928 10:44:17.312649 6270 rpcz_store.cc:276] 0928 10:44:14.168920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.168974 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:17.312344 (+3143370us) ts_tablet_manager.cc:1145] Deleting tablet cab9bc67c7474cb681566118af1bbf07
0928 10:44:17.312380 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.312484 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3143217}
W20260928 10:44:17.313161 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cab9bc67c7474cb681566118af1bbf07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab9bc67c7474cb681566118af1bbf07 already in progress: creating tablet
I20260928 10:44:17.317158 6090 leader_election.cc:302] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:17.317449 7455 raft_consensus.cc:2781] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.317531 7455 raft_consensus.cc:482] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.317587 7455 raft_consensus.cc:3037] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.319913 6273 tablet_bootstrap.cc:654] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.323130 6155 raft_consensus.cc:3037] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.327064 6271 tablet_bootstrap.cc:654] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.340477 5702 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:17.340776 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d605cff11a05407b979c5aeea4534893
W20260928 10:44:17.340988 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1af4642f16b94e09833ddc4131118e2b consensus state has no leader
I20260928 10:44:17.341362 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_003e601167904dcd8816bb3be11c926a" } new_table_name: "default.Table_db9adcd0bc9a4b4e90425535a5c52a58" modify_external_catalogs: true
I20260928 10:44:17.341948 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3ab4a1219a67476ca248861749e0c846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.342505 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ab4a1219a67476ca248861749e0c846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.342584 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81611dc2ea444355bfc90e472d8088d7" } modify_external_catalogs: true
I20260928 10:44:17.342773 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_81611dc2ea444355bfc90e472d8088d7" } modify_external_catalogs: true
I20260928 10:44:17.340119 7455 raft_consensus.cc:504] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.340737 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_72cd726d99714c50bae48be33c177076" } new_table_name: "default.Table_505efc39409542098127f46437f164bc" modify_external_catalogs: true
I20260928 10:44:17.344969 5693 catalog_manager.cc:5495] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:17.345516 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet d605cff11a05407b979c5aeea4534893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.345709 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:17.345916 5693 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:17.346192 6275 tablet_bootstrap.cc:492] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:17.348006 7616 raft_consensus.cc:482] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.348150 7616 raft_consensus.cc:504] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.348724 7616 leader_election.cc:288] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.350546 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:17.350795 6015 raft_consensus.cc:3037] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.353511 6015 raft_consensus.cc:2454] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:17.355806 7557 ts_tablet_manager.cc:1918] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.358693 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.358925 5880 raft_consensus.cc:2454] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:17.359242 6271 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.359439 6271 ts_tablet_manager.cc:1397] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.006s
I20260928 10:44:17.359514 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a61d97ed6b7b4dcba34a7a2190316b02" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.359683 5884 raft_consensus.cc:3037] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.360360 6271 raft_consensus.cc:348] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.361148 6271 raft_consensus.cc:374] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.361269 6271 raft_consensus.cc:729] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.362326 6273 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.362532 6273 ts_tablet_manager.cc:1397] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.001s
I20260928 10:44:17.363291 6273 raft_consensus.cc:348] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.363574 6273 raft_consensus.cc:374] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.364066 6273 raft_consensus.cc:729] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.364349 6273 consensus_queue.cc:260] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.365036 6273 ts_tablet_manager.cc:1428] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:17.365347 6273 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.364765 7584 consensus_queue.cc:1035] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:17.365513 5957 leader_election.cc:302] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.367326 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.367414 7584 raft_consensus.cc:2781] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.367522 7584 raft_consensus.cc:482] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.367609 7584 raft_consensus.cc:3037] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.367715 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.370121 7584 raft_consensus.cc:504] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.370664 7616 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.370792 7616 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.370934 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85583238d6b54f1d89ff5b53b40e73bb" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.371146 5880 raft_consensus.cc:3037] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.371181 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.371284 7616 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.371385 7584 leader_election.cc:288] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.371719 7584 raft_consensus.cc:482] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.371879 7584 raft_consensus.cc:504] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.372496 7584 leader_election.cc:288] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.372838 6271 consensus_queue.cc:260] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.373610 5880 raft_consensus.cc:2454] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.374466 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.373685 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.374707 5880 raft_consensus.cc:2454] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.375415 6271 ts_tablet_manager.cc:1428] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260928 10:44:17.375415 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.375594 5880 raft_consensus.cc:2454] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.375841 6271 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.376704 6273 tablet_bootstrap.cc:654] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.362309 5884 raft_consensus.cc:2454] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:17.378631 6271 tablet_bootstrap.cc:654] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.386003 6269 ts_tablet_manager.cc:1918] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:17.386150 6269 log.cc:1196] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/07a0c6ca08884dc6813b25e3991d0d8c
I20260928 10:44:17.386605 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet d605cff11a05407b979c5aeea4534893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.388665 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 964) took 3219 ms. Trace:
I20260928 10:44:17.388767 6270 rpcz_store.cc:276] 0928 10:44:14.169406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.169452 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:17.388545 (+3219093us) ts_tablet_manager.cc:1145] Deleting tablet dfd9b4092b1242b8a60974c445a2789a
0928 10:44:17.388560 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.388642 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3143361}
W20260928 10:44:17.389377 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet dfd9b4092b1242b8a60974c445a2789a because the tablet was not found. No further retry: Not found: Tablet not found: dfd9b4092b1242b8a60974c445a2789a
I20260928 10:44:17.389791 6270 tablet_replica.cc:330] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.390029 6270 raft_consensus.cc:2229] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.390261 6270 pending_rounds.cc:62] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:17.390355 6270 pending_rounds.cc:68] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265881700171776 op_type: NO_OP noop_request { }
I20260928 10:44:17.390559 6270 raft_consensus.cc:2866] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:17.390712 6270 raft_consensus.cc:2258] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.390779 6271 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.390954 6146 raft_consensus.cc:3037] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.391431 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet d605cff11a05407b979c5aeea4534893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.391525 6270 ts_tablet_manager.cc:1905] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.391664 6275 ts_tablet_manager.cc:1397] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.183s user 0.005s sys 0.003s
I20260928 10:44:17.392123 7455 leader_election.cc:288] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.392266 6090 leader_election.cc:302] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:17.392344 6091 leader_election.cc:341] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 2eded874aa094054b0c2e7c2e592dba1
I20260928 10:44:17.392228 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.392462 6091 leader_election.cc:302] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:17.392781 7564 raft_consensus.cc:2781] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.392889 7564 raft_consensus.cc:686] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:17.393085 7564 consensus_queue.cc:237] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.393620 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:17.394040 5817 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.394251 7557 log.cc:1196] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:17.394732 7557 ts_tablet_manager.cc:1939] T 44bc6831f9354ddb81212bc107efdf68 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:17.395107 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1001) took 1316 ms. Trace:
I20260928 10:44:17.395234 7557 rpcz_store.cc:276] 0928 10:44:16.079150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.079201 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:17.138665 (+1059464us) ts_tablet_manager.cc:1145] Deleting tablet 44bc6831f9354ddb81212bc107efdf68
0928 10:44:17.138676 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.275075 (+136399us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.330194 (+ 55119us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.395091 (+ 64897us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":128,"tablet-delete.queue_time_us":1059266}
I20260928 10:44:17.395757 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 44bc6831f9354ddb81212bc107efdf68 (table default.Table_ccc54fc0e3d24f22a89149b227256f81 [id=7e99e684b74f47279b22e18c1cf09935]) successfully deleted
I20260928 10:44:17.396265 7557 tablet_replica.cc:330] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:17.396667 7557 raft_consensus.cc:2229] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.397184 7557 raft_consensus.cc:2258] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.397181 6270 ts_tablet_manager.cc:1918] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.397289 6270 log.cc:1196] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:17.397447 5931 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:17.400558 7651 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:17.400909 7557 ts_tablet_manager.cc:1905] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.397578 6271 ts_tablet_manager.cc:1397] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.007s
I20260928 10:44:17.402576 7616 raft_consensus.cc:482] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.402746 7616 raft_consensus.cc:504] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.403187 6271 raft_consensus.cc:348] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.403347 7616 leader_election.cc:288] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.403477 6271 raft_consensus.cc:374] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.403590 6271 raft_consensus.cc:729] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.403831 6271 consensus_queue.cc:260] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.404441 6271 ts_tablet_manager.cc:1428] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:17.404788 6271 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.405784 6270 ts_tablet_manager.cc:1939] T f1a8f5241dd14684b5544e47d6cec9cc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.407094 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 965) took 3237 ms. Trace:
I20260928 10:44:17.407274 6275 raft_consensus.cc:348] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.407519 6275 raft_consensus.cc:374] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.407567 6275 raft_consensus.cc:729] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.407759 6275 consensus_queue.cc:260] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.408334 6270 rpcz_store.cc:276] 0928 10:44:14.169853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.169897 (+ 44us) service_pool.cc:227] Handling call
0928 10:44:17.389740 (+3219843us) ts_tablet_manager.cc:1145] Deleting tablet f1a8f5241dd14684b5544e47d6cec9cc
0928 10:44:17.389752 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.394324 (+ 4572us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.397082 (+ 2758us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.407073 (+ 9991us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3219699}
I20260928 10:44:17.409199 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f1a8f5241dd14684b5544e47d6cec9cc (table default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]) successfully deleted
I20260928 10:44:17.409644 6270 tablet_replica.cc:330] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.411691 6270 raft_consensus.cc:2229] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.412209 6270 raft_consensus.cc:2258] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.415618 6275 ts_tablet_manager.cc:1428] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260928 10:44:17.415967 6275 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:17.416242 6270 ts_tablet_manager.cc:1905] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.417070 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:17.417541 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.422418 6269 ts_tablet_manager.cc:1939] T 07a0c6ca08884dc6813b25e3991d0d8c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:17.422880 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 827) took 7645 ms. Trace:
I20260928 10:44:17.422982 6269 rpcz_store.cc:276] 0928 10:44:09.777461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.779527 (+ 2066us) service_pool.cc:227] Handling call
0928 10:44:17.116468 (+7336941us) ts_tablet_manager.cc:1145] Deleting tablet 07a0c6ca08884dc6813b25e3991d0d8c
0928 10:44:17.116509 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.292213 (+175704us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.385881 (+ 93668us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.422862 (+ 36981us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7336754}
I20260928 10:44:17.423287 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f0821d260af54eb2a7eb3cb19f94df64" } new_table_name: "default.Table_fb9482e4d3084f1291a9d2623996afdc" modify_external_catalogs: true
I20260928 10:44:17.423530 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 831) took 7531 ms. Trace:
I20260928 10:44:17.423614 6269 rpcz_store.cc:276] 0928 10:44:09.892308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.892565 (+ 257us) service_pool.cc:227] Handling call
0928 10:44:17.423273 (+7530708us) ts_tablet_manager.cc:1145] Deleting tablet 2a359f1585924866be13588125db2dc4
0928 10:44:17.423283 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.423513 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7530443}
I20260928 10:44:17.423962 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 833) took 7531 ms. Trace:
I20260928 10:44:17.424031 6269 rpcz_store.cc:276] 0928 10:44:09.892508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.892578 (+ 70us) service_pool.cc:227] Handling call
0928 10:44:17.423849 (+7531271us) ts_tablet_manager.cc:1145] Deleting tablet 01bd3593f7ac421cbed8ac5797e068fa
0928 10:44:17.423860 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.423947 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7530910}
I20260928 10:44:17.424414 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 832) took 7532 ms. Trace:
I20260928 10:44:17.424484 6269 rpcz_store.cc:276] 0928 10:44:09.892428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.895674 (+ 3246us) service_pool.cc:227] Handling call
0928 10:44:17.424324 (+7528650us) ts_tablet_manager.cc:1145] Deleting tablet 51df1f1107e14996bb1b4787819de64f
0928 10:44:17.424332 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.424401 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7528392}
I20260928 10:44:17.424717 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b7065d8329b146b789216da84c9357b2
I20260928 10:44:17.424746 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 835) took 7452 ms. Trace:
I20260928 10:44:17.424811 6269 rpcz_store.cc:276] 0928 10:44:09.971897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:09.971965 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:17.424658 (+7452693us) ts_tablet_manager.cc:1145] Deleting tablet 3e15b3cc46734ed5b8f0aef2f50025dd
0928 10:44:17.424666 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.424732 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7452484}
I20260928 10:44:17.425097 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 834) took 7453 ms. Trace:
I20260928 10:44:17.425158 6269 rpcz_store.cc:276] 0928 10:44:09.971777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.004319 (+ 32542us) service_pool.cc:227] Handling call
0928 10:44:17.425001 (+7420682us) ts_tablet_manager.cc:1145] Deleting tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670
0928 10:44:17.425009 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.425084 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7420423}
I20260928 10:44:17.425352 6269 tablet_replica.cc:330] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:17.425365 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_92ad2ddc81c049f9a6338ba4475638fc" } modify_external_catalogs: true
I20260928 10:44:17.425535 6269 raft_consensus.cc:2229] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.425565 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_92ad2ddc81c049f9a6338ba4475638fc" } modify_external_catalogs: true
I20260928 10:44:17.425699 6269 raft_consensus.cc:2258] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.426651 6269 ts_tablet_manager.cc:1905] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.427282 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f333b9300b284c31b2f59f434eeb2f48" } modify_external_catalogs: true
I20260928 10:44:17.427466 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f333b9300b284c31b2f59f434eeb2f48" } modify_external_catalogs: true
I20260928 10:44:17.428607 5702 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_72cd726d99714c50bae48be33c177076 [id=aa8af07a351b4a479550ac24c9e23f44] alter complete (version 1)
I20260928 10:44:17.429307 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.429888 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.430887 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 07a0c6ca08884dc6813b25e3991d0d8c (table default.Table_45fb73a0f9e1445c8e355b4dad0839df [id=5746764388a94c4aa38985de816e9c54]) successfully deleted
W20260928 10:44:17.431149 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2a359f1585924866be13588125db2dc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a359f1585924866be13588125db2dc4 already in progress: creating tablet
W20260928 10:44:17.431341 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 01bd3593f7ac421cbed8ac5797e068fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01bd3593f7ac421cbed8ac5797e068fa already in progress: creating tablet
W20260928 10:44:17.431522 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 51df1f1107e14996bb1b4787819de64f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51df1f1107e14996bb1b4787819de64f already in progress: creating tablet
W20260928 10:44:17.431691 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 3e15b3cc46734ed5b8f0aef2f50025dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e15b3cc46734ed5b8f0aef2f50025dd already in progress: creating tablet
W20260928 10:44:17.431865 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba2ce9e5c07f4a2fa1d019e6ad8a2670 already in progress: creating tablet
I20260928 10:44:17.433480 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.433559 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.433683 5883 raft_consensus.cc:3037] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.433740 5884 raft_consensus.cc:2454] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.434847 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet b7065d8329b146b789216da84c9357b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:17.435139 5818 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.435225 5818 leader_election.cc:302] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.435427 7616 raft_consensus.cc:2726] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.435789 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet b7065d8329b146b789216da84c9357b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.436127 6270 ts_tablet_manager.cc:1918] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
W20260928 10:44:17.436306 5818 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.436434 5818 leader_election.cc:302] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.436640 7616 raft_consensus.cc:2726] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.436717 5883 raft_consensus.cc:2454] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:17.436563 5955 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:17.437726 5955 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.437930 6270 log.cc:1196] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d64c1af58d6a4dfcabd6eecb8c75d572
I20260928 10:44:17.438427 6270 ts_tablet_manager.cc:1939] T d64c1af58d6a4dfcabd6eecb8c75d572 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:17.438917 5818 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.439589 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 966) took 3269 ms. Trace:
I20260928 10:44:17.439693 6270 rpcz_store.cc:276] 0928 10:44:14.170284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.170329 (+ 45us) service_pool.cc:227] Handling call
0928 10:44:17.409595 (+3239266us) ts_tablet_manager.cc:1145] Deleting tablet d64c1af58d6a4dfcabd6eecb8c75d572
0928 10:44:17.409608 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.429036 (+ 19428us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.436026 (+ 6990us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.439571 (+ 3545us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3239107}
I20260928 10:44:17.439764 5818 leader_election.cc:302] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.440073 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 961) took 3272 ms. Trace:
I20260928 10:44:17.440397 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d64c1af58d6a4dfcabd6eecb8c75d572 (table default.Table_8062a54a93234807a39d7ff0f8787f73 [id=2d4736814acb47298c4f96e849f840f6]) successfully deleted
I20260928 10:44:17.440907 6273 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.440877 7616 raft_consensus.cc:2726] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.442044 6273 ts_tablet_manager.cc:1397] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.077s user 0.014s sys 0.009s
W20260928 10:44:17.442252 5818 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.443060 6270 rpcz_store.cc:276] 0928 10:44:14.168112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.170626 (+ 2514us) service_pool.cc:227] Handling call
0928 10:44:17.439955 (+3269329us) ts_tablet_manager.cc:1145] Deleting tablet 5eb089481e47455cb7387b0f17eda9fb
0928 10:44:17.439966 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.440058 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3269154}
I20260928 10:44:17.443559 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 984) took 2606 ms. Trace:
I20260928 10:44:17.443800 6270 rpcz_store.cc:276] 0928 10:44:14.836985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.837050 (+ 65us) service_pool.cc:227] Handling call
0928 10:44:17.443419 (+2606369us) ts_tablet_manager.cc:1145] Deleting tablet 35345a76883045afadd5922c11de910d
0928 10:44:17.443431 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.443531 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2606167}
I20260928 10:44:17.444222 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 991) took 2268 ms. Trace:
I20260928 10:44:17.444358 6270 rpcz_store.cc:276] 0928 10:44:15.176000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.176057 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:17.444110 (+2268053us) ts_tablet_manager.cc:1145] Deleting tablet 791e310f4af14569aca647cca4cf9dc3
0928 10:44:17.444121 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.444207 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2267860}
W20260928 10:44:17.444483 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5eb089481e47455cb7387b0f17eda9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb089481e47455cb7387b0f17eda9fb already in progress: creating tablet
W20260928 10:44:17.444754 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 35345a76883045afadd5922c11de910d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35345a76883045afadd5922c11de910d already in progress: creating tablet
I20260928 10:44:17.444811 6270 tablet_replica.cc:330] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:17.444958 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 791e310f4af14569aca647cca4cf9dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 791e310f4af14569aca647cca4cf9dc3 already in progress: creating tablet
I20260928 10:44:17.445000 6270 raft_consensus.cc:2229] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.445163 6270 pending_rounds.cc:62] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:17.445269 6270 pending_rounds.cc:68] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265877246451712 op_type: NO_OP noop_request { }
I20260928 10:44:17.445465 6270 raft_consensus.cc:2866] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:17.445640 6270 raft_consensus.cc:2258] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.446376 6270 ts_tablet_manager.cc:1905] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.442803 6273 raft_consensus.cc:348] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.446589 5818 leader_election.cc:302] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.446657 6273 raft_consensus.cc:374] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.446820 6273 raft_consensus.cc:729] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:17.447065 6090 consensus_peers.cc:487] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1a8f5241dd14684b5544e47d6cec9cc. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.447157 6273 consensus_queue.cc:260] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.447854 6273 ts_tablet_manager.cc:1428] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 10:44:17.448184 6273 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.449556 6273 tablet_bootstrap.cc:654] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.450404 7616 raft_consensus.cc:2726] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:17.450920 5818 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.451036 5818 leader_election.cc:302] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.451258 7616 raft_consensus.cc:2726] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.451988 5957 leader_election.cc:302] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.452461 7569 raft_consensus.cc:2781] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.452605 7569 raft_consensus.cc:686] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.452811 7569 consensus_queue.cc:237] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.453773 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_12f98eb7390e4942864fe3d2eeb10eb7" } new_table_name: "default.Table_b796abfdcfb5415ca24156d04f547a02" modify_external_catalogs: true
I20260928 10:44:17.455032 6271 tablet_bootstrap.cc:654] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.455219 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.452457 5957 leader_election.cc:302] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.456097 7585 raft_consensus.cc:2781] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.456215 7585 raft_consensus.cc:482] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.456286 7585 raft_consensus.cc:3037] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.456307 5957 leader_election.cc:302] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.456789 7584 raft_consensus.cc:2781] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.456858 7584 raft_consensus.cc:482] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.456919 7584 raft_consensus.cc:3037] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.459203 7585 raft_consensus.cc:504] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.459306 7584 raft_consensus.cc:504] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.459899 7584 leader_election.cc:288] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.463230 7585 leader_election.cc:288] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.466941 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c297c1156d4741088c7c1ce711d91cc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.467567 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c297c1156d4741088c7c1ce711d91cc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.470397 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet b7065d8329b146b789216da84c9357b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.486304 5701 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:17.488209 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 6286ae20ffbe4e24a585f29444acfe17 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:17.489776 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b2c52b6b88a44a4e925dcf1c3f9232e1
I20260928 10:44:17.490389 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 1415cbe9fa15468a91932cdec4612cf9 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:17.491372 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.493204 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6eeceb0dbb064221b6ff2a76c8bf8b79
I20260928 10:44:17.494050 6270 ts_tablet_manager.cc:1918] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.494235 6270 log.cc:1196] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/2eded874aa094054b0c2e7c2e592dba1
I20260928 10:44:17.494694 6270 ts_tablet_manager.cc:1939] T 2eded874aa094054b0c2e7c2e592dba1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:17.494689 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb945bc6b99a44e0932b2a94f05db6c2 consensus state has no leader
I20260928 10:44:17.495082 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 987) took 2462 ms. Trace:
I20260928 10:44:17.495664 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.495589 6270 rpcz_store.cc:276] 0928 10:44:15.032389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.032478 (+ 89us) service_pool.cc:227] Handling call
0928 10:44:17.444770 (+2412292us) ts_tablet_manager.cc:1145] Deleting tablet 2eded874aa094054b0c2e7c2e592dba1
0928 10:44:17.444780 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.449848 (+ 5068us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.493939 (+ 44091us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.495063 (+ 1124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266164}
I20260928 10:44:17.496263 6270 tablet_replica.cc:330] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.496521 6270 raft_consensus.cc:2229] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.496769 6270 raft_consensus.cc:2258] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.497488 6270 ts_tablet_manager.cc:1905] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.500392 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 8242d0647d1b4f28a5f1ccf36b00d616 (table default.Table_505efc39409542098127f46437f164bc [id=aa8af07a351b4a479550ac24c9e23f44]). Expected version 2 got 1
I20260928 10:44:17.502224 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.502935 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet b6d5121db2d34ea99c851595c395f3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.502970 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d762e03b384d85b4e04be8331474a4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb1742a19f4144eb8ebd30e8cf4b9d37) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.503036 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa971239a2b4ac6bc309dfbacdbe12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:13 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.503160 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 44bc6831f9354ddb81212bc107efdf68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.503186 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.503304 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet a61d97ed6b7b4dcba34a7a2190316b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.502990 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.503594 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:17.507987 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 51364.3us
I20260928 10:44:17.501539 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4706d214d3184f4ebcec28f609b00a53
W20260928 10:44:17.508731 5957 consensus_peers.cc:487] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.509245 7585 consensus_queue.cc:1035] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:17.510054 7585 consensus_queue.cc:1035] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:17.510358 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4706d214d3184f4ebcec28f609b00a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.510578 5695 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_e51c54bdc7ea467491d09018c4ea3e3c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]). Expected version 3 got 0
I20260928 10:44:17.511369 6273 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.502455 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 2eded874aa094054b0c2e7c2e592dba1 (table default.Table_a76680616cce463084d329ce2930c487 [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]) successfully deleted
I20260928 10:44:17.511519 6273 ts_tablet_manager.cc:1397] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.003s
I20260928 10:44:17.512135 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 4706d214d3184f4ebcec28f609b00a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.512346 6273 raft_consensus.cc:348] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.512611 6273 raft_consensus.cc:374] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.512696 6273 raft_consensus.cc:729] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.512902 6273 consensus_queue.cc:260] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.513451 6273 ts_tablet_manager.cc:1428] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:17.514453 5957 leader_election.cc:302] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.514719 7584 raft_consensus.cc:2781] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.514781 7584 raft_consensus.cc:482] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.514835 7584 raft_consensus.cc:3037] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:17.514948 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b820ef6381c44b44a4d4e3ebb9f99802 consensus state has no leader
I20260928 10:44:17.517496 7584 raft_consensus.cc:504] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.518158 7584 leader_election.cc:288] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.518942 5957 leader_election.cc:302] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.519861 7642 raft_consensus.cc:2781] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.519982 7642 raft_consensus.cc:686] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.520187 7642 consensus_queue.cc:237] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.521238 7616 raft_consensus.cc:482] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.521399 7616 raft_consensus.cc:504] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.521991 7616 leader_election.cc:288] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:17.524289 5818 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.524621 7662 consensus_queue.cc:1035] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:17.527160 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6286ae20ffbe4e24a585f29444acfe17
I20260928 10:44:17.527856 5701 catalog_manager.cc:6565] ReplaceTablet: tablet 6286ae20ffbe4e24a585f29444acfe17 deleted and replaced by tablet 7b084c1a99d5437985174978329441e3
I20260928 10:44:17.528666 6273 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.530268 6273 tablet_bootstrap.cc:654] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.530493 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b084c1a99d5437985174978329441e3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.530730 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.530946 5883 raft_consensus.cc:3037] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.532410 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.532629 5880 raft_consensus.cc:3037] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.533556 5883 raft_consensus.cc:2454] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.534337 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.534766 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 503a4bcb9d37441aadf66b45238a3737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.535198 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f47338950743eb8a06e779a3ca5c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.535236 5880 raft_consensus.cc:2454] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.538625 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b084c1a99d5437985174978329441e3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.539747 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:17.539846 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:17.540411 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a901ae757acf438cbf9ad1655741fbdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.541100 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a901ae757acf438cbf9ad1655741fbdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.544458 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.544715 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 4706d214d3184f4ebcec28f609b00a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.544855 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 6286ae20ffbe4e24a585f29444acfe17 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b084c1a99d5437985174978329441e3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.547914 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_359e46ee4be549cc9313d92a881b2bf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.548599 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_359e46ee4be549cc9313d92a881b2bf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.549333 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_96bc9de9fa5e4ef1999c61dece36c6dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.549877 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96bc9de9fa5e4ef1999c61dece36c6dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.550434 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8e39f8abe6304e5e820a8c3550ac7f39" } new_table_name: "default.Table_8b7bbc2010da495f9ad7159ec2337c93" modify_external_catalogs: true
I20260928 10:44:17.552073 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c7bdaf58138c4d67a7ab84f53b902081"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.552624 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7bdaf58138c4d67a7ab84f53b902081 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.553514 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 78295825061a4d75984e2d6e110e1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.554174 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ee5d6d896bd245f0a2b9c389c99f5eb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.554728 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee5d6d896bd245f0a2b9c389c99f5eb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.556443 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a80e33d33ba64ee59584c0969fc7fafa" } modify_external_catalogs: true
I20260928 10:44:17.556651 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a80e33d33ba64ee59584c0969fc7fafa" } modify_external_catalogs: true
I20260928 10:44:17.556852 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:17.557471 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.558176 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.558322 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.558569 5957 leader_election.cc:302] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.558811 7569 raft_consensus.cc:2781] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.558904 7569 raft_consensus.cc:686] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.559109 7569 consensus_queue.cc:237] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.560217 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.560422 5883 raft_consensus.cc:3037] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:17.562825 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 355c5b2e54cb4136b27eec3d65aeab55 (table default.Table_5f47609a7d8c45fbafeaba4deb440ae2 [id=2881af28dc914b29b5d9b8fc6f5e6fa8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 355c5b2e54cb4136b27eec3d65aeab55 consensus state has no leader
I20260928 10:44:17.564085 5883 raft_consensus.cc:2454] T 5ced63ab7188472e80d4ff52350be3e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.564810 6271 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.564953 6271 ts_tablet_manager.cc:1397] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.160s user 0.003s sys 0.009s
I20260928 10:44:17.565466 7616 raft_consensus.cc:482] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.565587 7616 raft_consensus.cc:504] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.565743 6271 raft_consensus.cc:348] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.566099 6271 raft_consensus.cc:374] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.566145 7616 leader_election.cc:288] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.566169 6271 raft_consensus.cc:729] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.564960 5957 leader_election.cc:302] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.567507 7584 raft_consensus.cc:2781] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.567638 7584 raft_consensus.cc:686] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.567845 7584 consensus_queue.cc:237] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.564098 6269 ts_tablet_manager.cc:1918] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.570621 6269 log.cc:1196] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9956318fe8ef4d1cbc92eda9caa98602
I20260928 10:44:17.570966 6269 ts_tablet_manager.cc:1939] T 9956318fe8ef4d1cbc92eda9caa98602 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:17.571697 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 836) took 7522 ms. Trace:
I20260928 10:44:17.571812 6269 rpcz_store.cc:276] 0928 10:44:10.049348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.064392 (+ 15044us) service_pool.cc:227] Handling call
0928 10:44:17.425319 (+7360927us) ts_tablet_manager.cc:1145] Deleting tablet 9956318fe8ef4d1cbc92eda9caa98602
0928 10:44:17.425327 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.479606 (+ 54279us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.563972 (+ 84366us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.571678 (+ 7706us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7360617}
I20260928 10:44:17.572227 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 848) took 6944 ms. Trace:
I20260928 10:44:17.572306 7616 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.572428 7616 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.572472 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9956318fe8ef4d1cbc92eda9caa98602 (table default.Table_32e4b27c2c494235acd8e4bd96b9270b [id=b97213ac749448e9a97fde5cf9246b9d]) successfully deleted
I20260928 10:44:17.572943 7616 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.572304 6269 rpcz_store.cc:276] 0928 10:44:10.628075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.628317 (+ 242us) service_pool.cc:227] Handling call
0928 10:44:17.572105 (+6943788us) ts_tablet_manager.cc:1145] Deleting tablet 349d67ee0d3840ef813f241ac13968fe
0928 10:44:17.572116 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.572213 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6943565}
I20260928 10:44:17.573704 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 849) took 6945 ms. Trace:
I20260928 10:44:17.573809 6269 rpcz_store.cc:276] 0928 10:44:10.628175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.628577 (+ 402us) service_pool.cc:227] Handling call
0928 10:44:17.573586 (+6945009us) ts_tablet_manager.cc:1145] Deleting tablet 9ecd8d56d7a945a0afbd9541048f232b
0928 10:44:17.573612 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.573690 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6944873}
W20260928 10:44:17.573872 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 349d67ee0d3840ef813f241ac13968fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349d67ee0d3840ef813f241ac13968fe already in progress: creating tablet
I20260928 10:44:17.574144 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 850) took 6945 ms. Trace:
W20260928 10:44:17.574231 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 9ecd8d56d7a945a0afbd9541048f232b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ecd8d56d7a945a0afbd9541048f232b already in progress: creating tablet
I20260928 10:44:17.574251 6269 rpcz_store.cc:276] 0928 10:44:10.629118 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.629170 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:17.574055 (+6944885us) ts_tablet_manager.cc:1145] Deleting tablet 733ac3eb76f74468a4811c5d642d53f0
0928 10:44:17.574064 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.574130 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6944695}
I20260928 10:44:17.574528 6269 tablet_replica.cc:330] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:17.574707 6269 raft_consensus.cc:2229] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.574837 6269 pending_rounds.cc:62] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Trying to abort 1 pending ops.
W20260928 10:44:17.574841 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 733ac3eb76f74468a4811c5d642d53f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733ac3eb76f74468a4811c5d642d53f0 already in progress: creating tablet
I20260928 10:44:17.574878 6269 pending_rounds.cc:68] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265882443800576 op_type: NO_OP noop_request { }
I20260928 10:44:17.575007 6269 raft_consensus.cc:2866] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:17.575132 6269 raft_consensus.cc:2258] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:17.578328 5818 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.578739 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.578933 5957 leader_election.cc:302] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.578699 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.580335 7569 raft_consensus.cc:2781] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.582522 6275 tablet_bootstrap.cc:654] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.583838 6270 ts_tablet_manager.cc:1918] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.584016 6270 log.cc:1196] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/16510244612242f796910cf28e367da9
I20260928 10:44:17.584414 6270 ts_tablet_manager.cc:1939] T 16510244612242f796910cf28e367da9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.585417 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 988) took 2552 ms. Trace:
I20260928 10:44:17.596865 6270 rpcz_store.cc:276] 0928 10:44:15.032497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.032548 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:17.496209 (+2463661us) ts_tablet_manager.cc:1145] Deleting tablet 16510244612242f796910cf28e367da9
0928 10:44:17.496221 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.527481 (+ 31260us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.583732 (+ 56251us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.585400 (+ 1668us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2314822}
I20260928 10:44:17.597748 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 16510244612242f796910cf28e367da9 (table default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]) successfully deleted
W20260928 10:44:17.588394 5957 consensus_peers.cc:487] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.566349 6271 consensus_queue.cc:260] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.599068 6271 ts_tablet_manager.cc:1428] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260928 10:44:17.599419 6271 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.601697 6271 tablet_bootstrap.cc:654] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.588143 7569 raft_consensus.cc:686] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.602387 7569 consensus_queue.cc:237] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.602046 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 989) took 2569 ms. Trace:
I20260928 10:44:17.606369 6270 rpcz_store.cc:276] 0928 10:44:15.032581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.032627 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:17.601929 (+2569302us) ts_tablet_manager.cc:1145] Deleting tablet b77c90bc2ecc4fc29a4786152cb977bd
0928 10:44:17.601942 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.602028 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2420490}
W20260928 10:44:17.607650 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b77c90bc2ecc4fc29a4786152cb977bd because the tablet was not found. No further retry: Not found: Tablet not found: b77c90bc2ecc4fc29a4786152cb977bd
I20260928 10:44:17.608371 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 992) took 2402 ms. Trace:
I20260928 10:44:17.609282 6270 rpcz_store.cc:276] 0928 10:44:15.206250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.206307 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:17.608205 (+2401898us) ts_tablet_manager.cc:1145] Deleting tablet 850693fd00274d98ab347eb40ae76b85
0928 10:44:17.608222 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.608347 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2401680}
W20260928 10:44:17.610409 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 850693fd00274d98ab347eb40ae76b85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 850693fd00274d98ab347eb40ae76b85 already in progress: creating tablet
I20260928 10:44:17.611086 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 994) took 2368 ms. Trace:
W20260928 10:44:17.611825 5818 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.611831 6270 rpcz_store.cc:276] 0928 10:44:15.242341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.242397 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:17.610951 (+2368554us) ts_tablet_manager.cc:1145] Deleting tablet cada7237dcb649188254449bd5fc3136
0928 10:44:17.610964 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.611067 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2368294}
I20260928 10:44:17.612499 7494 raft_consensus.cc:2726] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:17.612934 5818 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:17.613210 5818 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.592824 6273 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.613655 6273 ts_tablet_manager.cc:1397] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.002s
W20260928 10:44:17.613750 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cada7237dcb649188254449bd5fc3136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cada7237dcb649188254449bd5fc3136 already in progress: creating tablet
I20260928 10:44:17.614348 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 993) took 2372 ms. Trace:
I20260928 10:44:17.614595 6273 raft_consensus.cc:348] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.614871 6273 raft_consensus.cc:374] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.614935 6273 raft_consensus.cc:729] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.615288 6270 rpcz_store.cc:276] 0928 10:44:15.242207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.242701 (+ 494us) service_pool.cc:227] Handling call
0928 10:44:17.614212 (+2371511us) ts_tablet_manager.cc:1145] Deleting tablet e8e3d92709bb4893973e5d24736bafcf
0928 10:44:17.614225 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.614329 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2371381}
I20260928 10:44:17.615135 6273 consensus_queue.cc:260] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.616235 6269 ts_tablet_manager.cc:1905] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:17.616365 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e8e3d92709bb4893973e5d24736bafcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8e3d92709bb4893973e5d24736bafcf already in progress: creating tablet
I20260928 10:44:17.616974 6273 ts_tablet_manager.cc:1428] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:17.617272 6273 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:17.616987 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 995) took 2173 ms. Trace:
I20260928 10:44:17.618006 6270 rpcz_store.cc:276] 0928 10:44:15.443273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.443333 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:17.616860 (+2173527us) ts_tablet_manager.cc:1145] Deleting tablet 6037e24ee6ba4399b6100ab27c4ed621
0928 10:44:17.616873 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.616970 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2173343}
I20260928 10:44:17.619107 6273 tablet_bootstrap.cc:654] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:17.619271 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6037e24ee6ba4399b6100ab27c4ed621 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6037e24ee6ba4399b6100ab27c4ed621 already in progress: creating tablet
I20260928 10:44:17.619951 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1009) took 1641 ms. Trace:
I20260928 10:44:17.620213 7674 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:17.621235 6270 rpcz_store.cc:276] 0928 10:44:15.978034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.978190 (+ 156us) service_pool.cc:227] Handling call
0928 10:44:17.619804 (+1641614us) ts_tablet_manager.cc:1145] Deleting tablet 50d66d697f2740a98138a08fc6ef9b60
0928 10:44:17.619817 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.619929 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1641409}
W20260928 10:44:17.623172 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 50d66d697f2740a98138a08fc6ef9b60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50d66d697f2740a98138a08fc6ef9b60 already in progress: creating tablet
I20260928 10:44:17.623838 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1011) took 1618 ms. Trace:
I20260928 10:44:17.627239 6270 rpcz_store.cc:276] 0928 10:44:16.005622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.007965 (+ 2343us) service_pool.cc:227] Handling call
0928 10:44:17.623695 (+1615730us) ts_tablet_manager.cc:1145] Deleting tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19
0928 10:44:17.623708 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.623816 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1530213}
W20260928 10:44:17.628713 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 already in progress: creating tablet
I20260928 10:44:17.629567 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1012) took 1597 ms. Trace:
I20260928 10:44:17.630981 6270 rpcz_store.cc:276] 0928 10:44:16.032622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.032697 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:17.629403 (+1596706us) ts_tablet_manager.cc:1145] Deleting tablet 6026e5e88aba49ef8dbe476f7a0bb0f9
0928 10:44:17.629418 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.629537 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529528}
W20260928 10:44:17.632359 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 already in progress: creating tablet
I20260928 10:44:17.633051 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1018) took 1552 ms. Trace:
I20260928 10:44:17.634146 6270 rpcz_store.cc:276] 0928 10:44:16.080166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.081887 (+ 1721us) service_pool.cc:227] Handling call
0928 10:44:17.632915 (+1551028us) ts_tablet_manager.cc:1145] Deleting tablet b40b1b2d2377425d8e0a78da3f1c43a8
0928 10:44:17.632929 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.633032 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1526190}
W20260928 10:44:17.635715 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b40b1b2d2377425d8e0a78da3f1c43a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40b1b2d2377425d8e0a78da3f1c43a8 already in progress: creating tablet
I20260928 10:44:17.636243 6270 tablet_replica.cc:330] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.636305 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1465606aff3e41dbb04521c83e690ee3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:17.638270 6270 raft_consensus.cc:2229] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.638299 6275 tablet_bootstrap.cc:492] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:17.638897 6270 raft_consensus.cc:2258] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.639441 6275 ts_tablet_manager.cc:1397] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.224s user 0.004s sys 0.004s
I20260928 10:44:17.637820 6271 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.640057 6271 ts_tablet_manager.cc:1397] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
W20260928 10:44:17.641700 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1465606aff3e41dbb04521c83e690ee3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.643026 6270 ts_tablet_manager.cc:1905] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.644251 6275 raft_consensus.cc:348] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.645485 6275 raft_consensus.cc:374] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.643730 6271 raft_consensus.cc:348] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.647796 6271 raft_consensus.cc:374] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.647881 6271 raft_consensus.cc:729] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.648085 6271 consensus_queue.cc:260] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.648682 6271 ts_tablet_manager.cc:1428] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:44:17.650104 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b2615ec20bf64891aa8cf372959a2f93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.650717 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2615ec20bf64891aa8cf372959a2f93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.651060 6275 raft_consensus.cc:729] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.651796 6271 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.651736 6275 consensus_queue.cc:260] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.652786 7168 raft_consensus.cc:482] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.652989 7168 raft_consensus.cc:504] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.653427 6271 tablet_bootstrap.cc:654] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.653810 7168 leader_election.cc:288] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.654536 6275 ts_tablet_manager.cc:1428] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 10:44:17.655547 6269 ts_tablet_manager.cc:1918] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.655691 6269 log.cc:1196] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4bfb47ad184148d595830276bad311dc
I20260928 10:44:17.656070 6269 ts_tablet_manager.cc:1939] T 4bfb47ad184148d595830276bad311dc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:17.656396 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 852) took 7020 ms. Trace:
I20260928 10:44:17.656512 6269 rpcz_store.cc:276] 0928 10:44:10.635512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.635703 (+ 191us) service_pool.cc:227] Handling call
0928 10:44:17.574462 (+6938759us) ts_tablet_manager.cc:1145] Deleting tablet 4bfb47ad184148d595830276bad311dc
0928 10:44:17.574472 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.619479 (+ 45007us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.655432 (+ 35953us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.656378 (+ 946us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6938522}
I20260928 10:44:17.656845 6269 tablet_replica.cc:330] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:17.657019 6269 raft_consensus.cc:2229] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.657188 6269 raft_consensus.cc:2258] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.659684 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4bfb47ad184148d595830276bad311dc (table default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]) successfully deleted
I20260928 10:44:17.659886 6275 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:17.662683 6275 tablet_bootstrap.cc:654] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:17.662825 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 137ef0978ed540f88fddfa70eb9c2ca3 consensus state has no leader
I20260928 10:44:17.663232 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_74b56feae3a142d1931815dd8a85abc1" } modify_external_catalogs: true
I20260928 10:44:17.663470 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_74b56feae3a142d1931815dd8a85abc1" } modify_external_catalogs: true
I20260928 10:44:17.664620 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_681e7c813bba489da7db3c3fcc2407bf" } new_table_name: "default.Table_7a145a1866b1469db38650deecf3ad20" modify_external_catalogs: true
I20260928 10:44:17.669541 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:17.669931 5696 catalog_manager.cc:5495] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:17.671274 5990 tablet_service.cc:1467] Processing CreateTablet for tablet bc109dfdab62499e8eaab3766496fd5e (DEFAULT_TABLE table=default.Table_01a1276cec1443f49ff9d9cf34436ac4 [id=eea8edd9f8884fa2b84e7f2d838e3996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.671693 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc109dfdab62499e8eaab3766496fd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.672019 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bd4f05b0e25d45afa8eef33066895e0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:17.672386 6270 ts_tablet_manager.cc:1918] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.672490 6270 log.cc:1196] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/76a47129ab5444dcab0a3f92a16046db
W20260928 10:44:17.672536 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd4f05b0e25d45afa8eef33066895e0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.672816 6270 ts_tablet_manager.cc:1939] T 76a47129ab5444dcab0a3f92a16046db P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.673098 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1019) took 1592 ms. Trace:
I20260928 10:44:17.673169 6270 rpcz_store.cc:276] 0928 10:44:16.080237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.081959 (+ 1722us) service_pool.cc:227] Handling call
0928 10:44:17.636183 (+1554224us) ts_tablet_manager.cc:1145] Deleting tablet 76a47129ab5444dcab0a3f92a16046db
0928 10:44:17.636198 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.656067 (+ 19869us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.669038 (+ 12971us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.673083 (+ 4045us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529323}
I20260928 10:44:17.673629 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 76a47129ab5444dcab0a3f92a16046db (table default.Table_5fad44d7253f493788268121109a5671 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]) successfully deleted
I20260928 10:44:17.674753 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb42384222467eae73bb886043459a (DEFAULT_TABLE table=default.Table_f32fe38bfa5b45aab2858e07e4f14d8f [id=6163567d2402431688c42985d433c889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.675144 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb42384222467eae73bb886043459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.676831 6271 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.676942 6271 ts_tablet_manager.cc:1397] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20260928 10:44:17.677621 6271 raft_consensus.cc:348] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.677817 6271 raft_consensus.cc:374] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.677870 6271 raft_consensus.cc:729] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.677838 5859 tablet_service.cc:1467] Processing CreateTablet for tablet bc109dfdab62499e8eaab3766496fd5e (DEFAULT_TABLE table=default.Table_01a1276cec1443f49ff9d9cf34436ac4 [id=eea8edd9f8884fa2b84e7f2d838e3996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.678253 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc109dfdab62499e8eaab3766496fd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.678606 6270 tablet_replica.cc:330] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.678790 6270 raft_consensus.cc:2229] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.679061 6270 raft_consensus.cc:2258] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.679550 6270 ts_tablet_manager.cc:1905] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.682838 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb42384222467eae73bb886043459a (DEFAULT_TABLE table=default.Table_f32fe38bfa5b45aab2858e07e4f14d8f [id=6163567d2402431688c42985d433c889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.683247 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb42384222467eae73bb886043459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.683480 6271 consensus_queue.cc:260] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.684028 6271 ts_tablet_manager.cc:1428] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:44:17.684275 6271 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.685772 6271 tablet_bootstrap.cc:654] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.666425 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet d22260b5f20d47ad99d612ed5a7c022c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.670408 6121 tablet_service.cc:1467] Processing CreateTablet for tablet bc109dfdab62499e8eaab3766496fd5e (DEFAULT_TABLE table=default.Table_01a1276cec1443f49ff9d9cf34436ac4 [id=eea8edd9f8884fa2b84e7f2d838e3996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.670782 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb42384222467eae73bb886043459a (DEFAULT_TABLE table=default.Table_f32fe38bfa5b45aab2858e07e4f14d8f [id=6163567d2402431688c42985d433c889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.671317 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 881a45f69b7f4f22be6e5e68a042a950 (DEFAULT_TABLE table=default.Table_67313132092d4048940149ae175780e2 [id=a343d697b3614492b958a0c865750fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.688360 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc109dfdab62499e8eaab3766496fd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.688560 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb42384222467eae73bb886043459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.691975 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_476d854135964e5b8282613d5baa7c96" } new_table_name: "default.Table_b592e7a931834dc491be7bad13867bbf" modify_external_catalogs: true
I20260928 10:44:17.694890 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881a45f69b7f4f22be6e5e68a042a950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.695240 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a0c6ca08884dc6813b25e3991d0d8c with delete_type TABLET_DATA_DELETED (replaced by tablet d6c48b8a7efa41a684205df3e6969370) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:17.695827 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32f24476c63549e79975ef4102a248e1 consensus state has no leader
I20260928 10:44:17.696291 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1415cbe9fa15468a91932cdec4612cf9
I20260928 10:44:17.696728 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 1415cbe9fa15468a91932cdec4612cf9 deleted and replaced by tablet 8dba17dc11b940958cc10b9fbcb295f4
I20260928 10:44:17.697196 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dba17dc11b940958cc10b9fbcb295f4) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.698655 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 969cd0bea65344c787308737da1efd46
I20260928 10:44:17.698997 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9012fa19e01f43238c895a84c6dc9815
I20260928 10:44:17.699823 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 969cd0bea65344c787308737da1efd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.699903 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 9012fa19e01f43238c895a84c6dc9815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.700522 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dba17dc11b940958cc10b9fbcb295f4) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.700935 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 9012fa19e01f43238c895a84c6dc9815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.700964 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 969cd0bea65344c787308737da1efd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.703125 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bc46ac584c6242c0b72817d527d292c0" } new_table_name: "default.Table_307a19e51bd348fa8df26f51b7bab439" modify_external_catalogs: true
I20260928 10:44:17.704813 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_11d8d455798b42eca6d68cc8928974c6" } modify_external_catalogs: true
I20260928 10:44:17.704768 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dc26d0f7cd174e11880f100e464fbe50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:17.704977 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_11d8d455798b42eca6d68cc8928974c6" } modify_external_catalogs: true
W20260928 10:44:17.705396 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc26d0f7cd174e11880f100e464fbe50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.706525 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d9811c82d1fa4eff8a1065a89a8c5c13" } modify_external_catalogs: true
I20260928 10:44:17.706580 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 1415cbe9fa15468a91932cdec4612cf9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8dba17dc11b940958cc10b9fbcb295f4) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.706729 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d9811c82d1fa4eff8a1065a89a8c5c13" } modify_external_catalogs: true
I20260928 10:44:17.709076 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet 9012fa19e01f43238c895a84c6dc9815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.710680 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dc893248efaa4d91bb9d16c3b6d9c85a" } modify_external_catalogs: true
I20260928 10:44:17.710896 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dc893248efaa4d91bb9d16c3b6d9c85a" } modify_external_catalogs: true
I20260928 10:44:17.712387 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 969cd0bea65344c787308737da1efd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.714393 6270 ts_tablet_manager.cc:1918] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.714684 6270 log.cc:1196] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/45a00a2c4692459cbdd0628af0184f09
I20260928 10:44:17.715118 6270 ts_tablet_manager.cc:1939] T 45a00a2c4692459cbdd0628af0184f09 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.715545 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1021) took 1425 ms. Trace:
I20260928 10:44:17.715826 6270 rpcz_store.cc:276] 0928 10:44:16.289909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.289974 (+ 65us) service_pool.cc:227] Handling call
0928 10:44:17.678564 (+1388590us) ts_tablet_manager.cc:1145] Deleting tablet 45a00a2c4692459cbdd0628af0184f09
0928 10:44:17.678574 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.690219 (+ 11645us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.714271 (+ 24052us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.715528 (+ 1257us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1388340}
I20260928 10:44:17.716440 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 45a00a2c4692459cbdd0628af0184f09 (table default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]) successfully deleted
I20260928 10:44:17.717476 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3bfd977507e84edebfadab9cc567bd3f" } new_table_name: "default.Table_02f5489736974455aefc7ae3da68ae7e" modify_external_catalogs: true
I20260928 10:44:17.718760 7616 raft_consensus.cc:482] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.718941 7616 raft_consensus.cc:504] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.719512 7616 leader_election.cc:288] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.720952 6269 ts_tablet_manager.cc:1905] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:17.723016 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24bf23a7d7be4a0897a3fd96941bb83b consensus state has no leader
W20260928 10:44:17.724885 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2ce585cc60d4001b12cb335929b9efb consensus state has no leader
I20260928 10:44:17.728272 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.729672 7616 raft_consensus.cc:482] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.729698 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.729861 7616 raft_consensus.cc:504] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.730556 7616 leader_election.cc:288] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.731469 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 881a45f69b7f4f22be6e5e68a042a950 (DEFAULT_TABLE table=default.Table_67313132092d4048940149ae175780e2 [id=a343d697b3614492b958a0c865750fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.732003 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881a45f69b7f4f22be6e5e68a042a950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.734064 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e6788ab52b5a410b80dbafa42faca089"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:17.734634 7168 raft_consensus.cc:482] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.734769 7168 raft_consensus.cc:504] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:17.735025 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6788ab52b5a410b80dbafa42faca089 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.735364 7168 leader_election.cc:288] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.735635 7564 raft_consensus.cc:482] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.735785 7564 raft_consensus.cc:504] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.736377 7564 leader_election.cc:288] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.737119 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:17.737200 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 344147us
W20260928 10:44:17.737432 6091 consensus_peers.cc:487] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1a8f5241dd14684b5544e47d6cec9cc. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:17.738039 5817 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.738162 5817 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.738772 7616 raft_consensus.cc:2726] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.738983 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1022) took 1448 ms. Trace:
I20260928 10:44:17.739166 6270 rpcz_store.cc:276] 0928 10:44:16.290039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.290256 (+ 217us) service_pool.cc:227] Handling call
0928 10:44:17.738884 (+1448628us) ts_tablet_manager.cc:1145] Deleting tablet 4a973a1d20e3437c87ad889c723e7ebc
0928 10:44:17.738894 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.738966 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1448492}
W20260928 10:44:17.739795 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4a973a1d20e3437c87ad889c723e7ebc because the tablet was not found. No further retry: Not found: Tablet not found: 4a973a1d20e3437c87ad889c723e7ebc
I20260928 10:44:17.740235 6270 tablet_replica.cc:330] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:17.740469 6270 raft_consensus.cc:2229] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:17.740904 6270 raft_consensus.cc:2258] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.743095 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 6504434b53e84d549fce67d49a5452b9 (DEFAULT_TABLE table=default.Table_01a0de136e404eb4a264a0eeb4b60fd0 [id=b11bcab085cc49f198c43bd91cef9acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.743253 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 6504434b53e84d549fce67d49a5452b9 (DEFAULT_TABLE table=default.Table_01a0de136e404eb4a264a0eeb4b60fd0 [id=b11bcab085cc49f198c43bd91cef9acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.743539 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6504434b53e84d549fce67d49a5452b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.743716 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6504434b53e84d549fce67d49a5452b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.742447 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.747933 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741ca8fa10bb47efbd5d6a95d30f1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.751713 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.752189 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741ca8fa10bb47efbd5d6a95d30f1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.754891 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 881a45f69b7f4f22be6e5e68a042a950 (DEFAULT_TABLE table=default.Table_67313132092d4048940149ae175780e2 [id=a343d697b3614492b958a0c865750fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.755339 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881a45f69b7f4f22be6e5e68a042a950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.756230 7651 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:17.771528 6271 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:17.772495 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 455a21b95bd24fd892bd2ac7752be379 (DEFAULT_TABLE table=default.Table_4b1852b320ff47f0abc2c8d9de920f98 [id=e19216d87329470c8d39a544cbf62e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.773054 6271 ts_tablet_manager.cc:1397] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.019s
I20260928 10:44:17.773478 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 (DEFAULT_TABLE table=default.Table_e24f9f19bc504923acb59085c2e0c114 [id=3195da4039404b808e098f1349f86370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.773852 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455a21b95bd24fd892bd2ac7752be379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.773895 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780dd46414fe4dfc812f1a308162b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.774080 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 455a21b95bd24fd892bd2ac7752be379 (DEFAULT_TABLE table=default.Table_4b1852b320ff47f0abc2c8d9de920f98 [id=e19216d87329470c8d39a544cbf62e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.774470 6271 raft_consensus.cc:348] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.774698 6271 raft_consensus.cc:374] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.774740 6271 raft_consensus.cc:729] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.775233 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.775592 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.773396 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 (DEFAULT_TABLE table=default.Table_e24f9f19bc504923acb59085c2e0c114 [id=3195da4039404b808e098f1349f86370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.775853 7680 consensus_queue.cc:1035] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:17.775926 5818 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.776047 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780dd46414fe4dfc812f1a308162b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.776211 7680 consensus_queue.cc:1035] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:17.779515 5818 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.779989 6271 consensus_queue.cc:260] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.781308 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 6504434b53e84d549fce67d49a5452b9 (DEFAULT_TABLE table=default.Table_01a0de136e404eb4a264a0eeb4b60fd0 [id=b11bcab085cc49f198c43bd91cef9acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.781455 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.781661 6271 ts_tablet_manager.cc:1428] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 10:44:17.781682 5881 raft_consensus.cc:2454] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.781785 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 455a21b95bd24fd892bd2ac7752be379 (DEFAULT_TABLE table=default.Table_4b1852b320ff47f0abc2c8d9de920f98 [id=e19216d87329470c8d39a544cbf62e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.781899 6271 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:17.782096 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455a21b95bd24fd892bd2ac7752be379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.783363 6271 tablet_bootstrap.cc:654] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.786024 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.786550 5880 raft_consensus.cc:2454] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.787636 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455a21b95bd24fd892bd2ac7752be379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.783718 5957 leader_election.cc:302] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.788188 5957 leader_election.cc:302] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.788430 7168 raft_consensus.cc:2781] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.788497 7168 raft_consensus.cc:482] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.788551 7168 raft_consensus.cc:3037] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.788695 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6504434b53e84d549fce67d49a5452b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.790863 7168 raft_consensus.cc:504] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.791405 7168 leader_election.cc:288] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.791667 7168 raft_consensus.cc:2781] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.791818 7168 raft_consensus.cc:482] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.791929 7168 raft_consensus.cc:3037] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.794430 7168 raft_consensus.cc:504] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.795112 7616 raft_consensus.cc:482] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.795228 7168 leader_election.cc:288] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.780714 6270 ts_tablet_manager.cc:1905] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.795248 7616 raft_consensus.cc:504] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.795820 7616 leader_election.cc:288] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:17.796872 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 209e0ea726ff4f20ad8edd047d9bc6e9 (DEFAULT_TABLE table=default.Table_7fa5b056e17743188a2e90bc2a0f692e [id=240383f769c84c30919c8b5495d43e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.796979 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 (DEFAULT_TABLE table=default.Table_e24f9f19bc504923acb59085c2e0c114 [id=3195da4039404b808e098f1349f86370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.797427 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780dd46414fe4dfc812f1a308162b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.797425 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209e0ea726ff4f20ad8edd047d9bc6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.797394 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:17.797708 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.797880 5881 raft_consensus.cc:3037] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:17.797932 5818 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.798622 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 209e0ea726ff4f20ad8edd047d9bc6e9 (DEFAULT_TABLE table=default.Table_7fa5b056e17743188a2e90bc2a0f692e [id=240383f769c84c30919c8b5495d43e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.799014 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209e0ea726ff4f20ad8edd047d9bc6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.800439 5881 raft_consensus.cc:2454] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.802109 6270 ts_tablet_manager.cc:1918] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.802091 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.802392 5880 raft_consensus.cc:3037] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.807139 6119 tablet_service.cc:1467] Processing CreateTablet for tablet df6cd04a2b1a48c1a9c2959936b4cb2c (DEFAULT_TABLE table=default.Table_b09f4f6e9c904fb88555bb00b9910e6e [id=51ae9ef405b54842b0aea924a18b5ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.807494 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 59e74ac74d274a63b70b84d013e3f742 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.807641 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6cd04a2b1a48c1a9c2959936b4cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.807888 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e74ac74d274a63b70b84d013e3f742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.809897 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 59e74ac74d274a63b70b84d013e3f742 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.810312 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e74ac74d274a63b70b84d013e3f742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.814821 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 209e0ea726ff4f20ad8edd047d9bc6e9 (DEFAULT_TABLE table=default.Table_7fa5b056e17743188a2e90bc2a0f692e [id=240383f769c84c30919c8b5495d43e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.802531 5957 leader_election.cc:302] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.815358 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209e0ea726ff4f20ad8edd047d9bc6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.815743 7662 raft_consensus.cc:2781] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.815905 7662 raft_consensus.cc:686] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.816138 7662 consensus_queue.cc:237] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.817189 7642 raft_consensus.cc:482] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.817317 7642 raft_consensus.cc:504] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.817811 7642 leader_election.cc:288] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.818696 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.818918 5878 raft_consensus.cc:2454] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:17.819257 5957 leader_election.cc:302] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.819458 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 98689ee648a84666a783aef0d4601fc2 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:17.819679 7642 raft_consensus.cc:2781] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:17.819758 7642 raft_consensus.cc:482] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:17.819824 7642 raft_consensus.cc:3037] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.804104 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.821275 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741ca8fa10bb47efbd5d6a95d30f1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.822129 7642 raft_consensus.cc:504] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.822952 7642 leader_election.cc:288] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:17.823494 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502d275d161945ce86626594ab0d89b3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.823575 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.824127 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:17.824286 5878 raft_consensus.cc:3037] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:17.827250 5878 raft_consensus.cc:2454] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.827747 5957 leader_election.cc:302] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
W20260928 10:44:17.829226 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 248446us
W20260928 10:44:17.829531 5955 leader_election.cc:341] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:17.829998 5955 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.830343 6269 ts_tablet_manager.cc:1918] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.830463 6269 log.cc:1196] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:17.830842 6269 ts_tablet_manager.cc:1939] T d22260b5f20d47ad99d612ed5a7c022c P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:17.831738 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 853) took 7196 ms. Trace:
I20260928 10:44:17.831848 6269 rpcz_store.cc:276] 0928 10:44:10.635648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.635704 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:17.656802 (+7021098us) ts_tablet_manager.cc:1145] Deleting tablet d22260b5f20d47ad99d612ed5a7c022c
0928 10:44:17.656813 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.793597 (+136784us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.830197 (+ 36600us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.831719 (+ 1522us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7020687}
I20260928 10:44:17.832198 6269 tablet_replica.cc:330] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:17.832389 6269 raft_consensus.cc:2229] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:17.832595 6269 raft_consensus.cc:2258] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:17.834824 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 337b66a1e02245f298335d445f5020b0 (DEFAULT_TABLE table=default.Table_cfc6ba341cb0497d9f0dd2749da2265b [id=0bbe049a30694844963643b20f49823a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.834967 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet d22260b5f20d47ad99d612ed5a7c022c (table default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]) successfully deleted
I20260928 10:44:17.835278 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 337b66a1e02245f298335d445f5020b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.842700 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.843487 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.830027 7676 raft_consensus.cc:2781] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:17.833976 5993 tablet_service.cc:1467] Processing CreateTablet for tablet df6cd04a2b1a48c1a9c2959936b4cb2c (DEFAULT_TABLE table=default.Table_b09f4f6e9c904fb88555bb00b9910e6e [id=51ae9ef405b54842b0aea924a18b5ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.834568 6270 log.cc:1196] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:17.845197 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 59e74ac74d274a63b70b84d013e3f742 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.852535 7557 ts_tablet_manager.cc:1918] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:17.854333 7557 log.cc:1196] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/67f29acce3604e458d1981aad87f2eb9
I20260928 10:44:17.854785 7557 ts_tablet_manager.cc:1939] T 67f29acce3604e458d1981aad87f2eb9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:17.855827 6123 tablet_service.cc:1467] Processing CreateTablet for tablet e1868c3e598b4a46b550eaac13ae0d20 (DEFAULT_TABLE table=default.Table_369a1bc5f44f41e58a6f28a71a3b731e [id=627542c667084c788d0d968f80757519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.856375 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1868c3e598b4a46b550eaac13ae0d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.857479 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.858018 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.858436 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.859368 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:17.861040 6091 leader_election.cc:302] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:17.861057 7619 lock_manager.cc:586] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 8903359038299187447) tablet 00000000000000000000000000000000 cur holder 0x617000071580
I20260928 10:44:17.856424 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 337b66a1e02245f298335d445f5020b0 (DEFAULT_TABLE table=default.Table_cfc6ba341cb0497d9f0dd2749da2265b [id=0bbe049a30694844963643b20f49823a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.862087 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 337b66a1e02245f298335d445f5020b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.842448 5880 raft_consensus.cc:2454] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:17.871870 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f39bdf00d7984f6496300c8b0c9f7571 (DEFAULT_TABLE table=default.Table_6cc4bdae4768448b9b6598d8ab40ec6a [id=91775dffe4c34408963fd7d97ebedfeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.872375 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39bdf00d7984f6496300c8b0c9f7571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.874580 5854 tablet_service.cc:1467] Processing CreateTablet for tablet e1868c3e598b4a46b550eaac13ae0d20 (DEFAULT_TABLE table=default.Table_369a1bc5f44f41e58a6f28a71a3b731e [id=627542c667084c788d0d968f80757519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.874953 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1868c3e598b4a46b550eaac13ae0d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.874447 7455 raft_consensus.cc:2726] T 502d275d161945ce86626594ab0d89b3 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:17.877981 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b523bc2fedb7482c9c2561e4cb54bf50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:17.878383 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4ead8c7aa6364125bd059516cf0413e7
W20260928 10:44:17.878578 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b523bc2fedb7482c9c2561e4cb54bf50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.879055 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b592e7a931834dc491be7bad13867bbf" } new_table_name: "default.Table_bad12c6d98f54e249460a528807f8d7e" modify_external_catalogs: true
I20260928 10:44:17.880194 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6520ab6acc2142a2a3b8e1f0dabedc7a
I20260928 10:44:17.880792 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9bffbab1e55e478882d8115ab0e8b826"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.881299 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bffbab1e55e478882d8115ab0e8b826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.883038 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7d58c3bddc1f45939d5432843b74a325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.883590 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d58c3bddc1f45939d5432843b74a325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.885094 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.885257 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2c3a6c8d0bf1402dbac60afd9298f4e6
I20260928 10:44:17.885437 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.885898 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4d02fe9f7eae47fbbe27a15a2e408dec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.886400 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d02fe9f7eae47fbbe27a15a2e408dec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.887732 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:17.891425 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_62778da60fec4dd4beeada7adc219568"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.892050 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62778da60fec4dd4beeada7adc219568 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:17.885121 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_eff1d60da628455ea5d70486f28df058"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.893684 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eff1d60da628455ea5d70486f28df058 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:17.897028 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 consensus state has no leader
I20260928 10:44:17.897437 6134 tablet_service.cc:1467] Processing CreateTablet for tablet c6abf75d30334b08aa4b53ef92fbaa4a (DEFAULT_TABLE table=default.Table_84eec5f79a7e4d24a08b9a1f0754cc42 [id=547cdf7215d944479daf90b871865f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.898070 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6abf75d30334b08aa4b53ef92fbaa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.900063 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.900246 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.900669 5861 tablet_service.cc:1467] Processing CreateTablet for tablet f39bdf00d7984f6496300c8b0c9f7571 (DEFAULT_TABLE table=default.Table_6cc4bdae4768448b9b6598d8ab40ec6a [id=91775dffe4c34408963fd7d97ebedfeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.901062 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39bdf00d7984f6496300c8b0c9f7571. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.859836 5817 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.907141 5817 leader_election.cc:302] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.907171 5957 leader_election.cc:302] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:17.907215 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_07d6b2189b69472bb92c8da35bca6bf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:17.907424 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 47601us
I20260928 10:44:17.907616 7584 raft_consensus.cc:2781] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 10:44:17.907838 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07d6b2189b69472bb92c8da35bca6bf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:17.907940 5817 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.908035 5817 leader_election.cc:302] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.908658 7616 raft_consensus.cc:2726] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.908826 7616 raft_consensus.cc:2726] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.913412 6269 ts_tablet_manager.cc:1905] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:17.916381 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 337b66a1e02245f298335d445f5020b0 (DEFAULT_TABLE table=default.Table_cfc6ba341cb0497d9f0dd2749da2265b [id=0bbe049a30694844963643b20f49823a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.916828 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.918834 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead8c7aa6364125bd059516cf0413e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:17.919382 5861 tablet_service.cc:1467] Processing CreateTablet for tablet c6abf75d30334b08aa4b53ef92fbaa4a (DEFAULT_TABLE table=default.Table_84eec5f79a7e4d24a08b9a1f0754cc42 [id=547cdf7215d944479daf90b871865f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.919863 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6abf75d30334b08aa4b53ef92fbaa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.919845 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb (DEFAULT_TABLE table=default.Table_99ae64c5eee24cc189fb1f54cbe4ad75 [id=2d6370ce94654d60a6dd43521aac488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.920372 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.919378 5864 tablet_service.cc:1467] Processing CreateTablet for tablet df6cd04a2b1a48c1a9c2959936b4cb2c (DEFAULT_TABLE table=default.Table_b09f4f6e9c904fb88555bb00b9910e6e [id=51ae9ef405b54842b0aea924a18b5ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.856706 6273 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:17.924914 6273 ts_tablet_manager.cc:1397] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.308s user 0.004s sys 0.000s
I20260928 10:44:17.925087 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6cd04a2b1a48c1a9c2959936b4cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.927758 7676 raft_consensus.cc:686] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.930258 6275 tablet_bootstrap.cc:492] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:17.930528 6275 ts_tablet_manager.cc:1397] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.274s user 0.016s sys 0.016s
I20260928 10:44:17.931282 6275 raft_consensus.cc:348] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.931610 6275 raft_consensus.cc:374] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.931720 6275 raft_consensus.cc:729] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.931981 6275 consensus_queue.cc:260] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.932657 6275 ts_tablet_manager.cc:1428] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:17.932582 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_dd9ab8b729544b908fe750000e5b528d" } new_table_name: "default.Table_cba0b4492880427b83a8a460e484d29c" modify_external_catalogs: true
I20260928 10:44:17.939163 5994 tablet_service.cc:1467] Processing CreateTablet for tablet f39bdf00d7984f6496300c8b0c9f7571 (DEFAULT_TABLE table=default.Table_6cc4bdae4768448b9b6598d8ab40ec6a [id=91775dffe4c34408963fd7d97ebedfeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.925758 6273 raft_consensus.cc:348] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.941584 6273 raft_consensus.cc:374] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.941671 6273 raft_consensus.cc:729] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.942037 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:17.947244 5854 tablet_service.cc:1467] Processing CreateTablet for tablet f290d195b3d04f4086650b2bb8a50cd1 (DEFAULT_TABLE table=default.Table_ab3cfb6419ef479580e7915b4fe6b5af [id=81d32908fb0b4b138409bb7dc0a4aa2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.947204 6119 tablet_service.cc:1467] Processing CreateTablet for tablet f590c4ac7e6a4df485cceca9bca2058b (DEFAULT_TABLE table=default.Table_6e34e07962c64df98e43a6f5bb6fd281 [id=cba916a3cec148088a213c785d4cc969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.947696 6275 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:17.947733 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f290d195b3d04f4086650b2bb8a50cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.947896 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f590c4ac7e6a4df485cceca9bca2058b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.947889 6273 consensus_queue.cc:260] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:17.949982 5858 tablet_service.cc:1467] Processing CreateTablet for tablet f590c4ac7e6a4df485cceca9bca2058b (DEFAULT_TABLE table=default.Table_6e34e07962c64df98e43a6f5bb6fd281 [id=cba916a3cec148088a213c785d4cc969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.950410 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f590c4ac7e6a4df485cceca9bca2058b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.950412 6275 tablet_bootstrap.cc:654] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.951437 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb (DEFAULT_TABLE table=default.Table_99ae64c5eee24cc189fb1f54cbe4ad75 [id=2d6370ce94654d60a6dd43521aac488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.952054 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.960485 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb (DEFAULT_TABLE table=default.Table_99ae64c5eee24cc189fb1f54cbe4ad75 [id=2d6370ce94654d60a6dd43521aac488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.960938 6000 tablet_service.cc:1467] Processing CreateTablet for tablet f290d195b3d04f4086650b2bb8a50cd1 (DEFAULT_TABLE table=default.Table_ab3cfb6419ef479580e7915b4fe6b5af [id=81d32908fb0b4b138409bb7dc0a4aa2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.961246 5984 tablet_service.cc:1467] Processing CreateTablet for tablet f590c4ac7e6a4df485cceca9bca2058b (DEFAULT_TABLE table=default.Table_6e34e07962c64df98e43a6f5bb6fd281 [id=cba916a3cec148088a213c785d4cc969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.961863 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d96e1b0fcf9e4fe199708e8b2427c477" } modify_external_catalogs: true
I20260928 10:44:17.962085 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d96e1b0fcf9e4fe199708e8b2427c477" } modify_external_catalogs: true
W20260928 10:44:17.962199 5955 leader_election.cc:341] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.963145 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6cd04a2b1a48c1a9c2959936b4cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:17.963985 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 56048us
W20260928 10:44:17.964373 5817 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.964538 5817 leader_election.cc:302] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:17.969908 6091 consensus_peers.cc:487] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9956318fe8ef4d1cbc92eda9caa98602. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:17.969887 7584 raft_consensus.cc:686] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:17.970237 7584 consensus_queue.cc:237] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:17.970413 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2ce585cc60d4001b12cb335929b9efb consensus state has no leader
I20260928 10:44:17.971304 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 (DEFAULT_TABLE table=default.Table_2da17aac467c432899b53a16ba53b3c0 [id=82d1a8f5679e4a7e8597f09eb9191b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.971289 5992 tablet_service.cc:1467] Processing CreateTablet for tablet e1868c3e598b4a46b550eaac13ae0d20 (DEFAULT_TABLE table=default.Table_369a1bc5f44f41e58a6f28a71a3b731e [id=627542c667084c788d0d968f80757519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.971698 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfef184644b4fec8058759dd2e70cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.971704 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.971916 7676 consensus_queue.cc:237] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:17.972158 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 (DEFAULT_TABLE table=default.Table_2da17aac467c432899b53a16ba53b3c0 [id=82d1a8f5679e4a7e8597f09eb9191b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.972834 6002 tablet_service.cc:1467] Processing CreateTablet for tablet c6abf75d30334b08aa4b53ef92fbaa4a (DEFAULT_TABLE table=default.Table_84eec5f79a7e4d24a08b9a1f0754cc42 [id=547cdf7215d944479daf90b871865f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.973156 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:17.973331 7680 raft_consensus.cc:482] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:17.973455 7680 raft_consensus.cc:504] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.973608 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed0451e509d4580be284739255821e2 (DEFAULT_TABLE table=default.Table_667eb87198d94c5fa00a0298e6bbf859 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.973922 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed0451e509d4580be284739255821e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.974040 7680 leader_election.cc:288] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:17.975114 6273 ts_tablet_manager.cc:1428] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.050s user 0.002s sys 0.000s
I20260928 10:44:17.975420 6273 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:17.977038 5817 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.977496 6273 tablet_bootstrap.cc:654] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:17.977442 5817 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.977748 7696 raft_consensus.cc:2726] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.977838 7616 raft_consensus.cc:2726] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:17.978145 5817 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.978240 5817 leader_election.cc:302] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.978428 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:17.978668 5883 raft_consensus.cc:2454] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:17.978777 5817 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.978520 7616 raft_consensus.cc:2726] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.978859 5817 leader_election.cc:302] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.979017 7616 raft_consensus.cc:2726] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:17.979707 5817 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:17.979868 5817 leader_election.cc:302] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:17.980083 7616 raft_consensus.cc:2726] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:17.980161 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f290d195b3d04f4086650b2bb8a50cd1 (DEFAULT_TABLE table=default.Table_ab3cfb6419ef479580e7915b4fe6b5af [id=81d32908fb0b4b138409bb7dc0a4aa2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.981237 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f290d195b3d04f4086650b2bb8a50cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.981681 6275 tablet_bootstrap.cc:492] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:17.982218 6275 ts_tablet_manager.cc:1397] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20260928 10:44:17.983144 6275 raft_consensus.cc:348] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.989372 6275 raft_consensus.cc:374] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:17.989657 6275 raft_consensus.cc:729] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:17.990108 6275 consensus_queue.cc:260] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:17.996898 6270 ts_tablet_manager.cc:1939] T d22260b5f20d47ad99d612ed5a7c022c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:17.998613 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed0451e509d4580be284739255821e2 (DEFAULT_TABLE table=default.Table_667eb87198d94c5fa00a0298e6bbf859 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:17.999495 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:17.999642 5957 leader_election.cc:302] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.000066 7642 raft_consensus.cc:2781] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:18.000190 7642 raft_consensus.cc:482] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:18.000339 7642 raft_consensus.cc:3037] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.000813 7675 raft_consensus.cc:482] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.000941 7675 raft_consensus.cc:504] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.001713 7675 leader_election.cc:288] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.002669 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1002) took 1921 ms. Trace:
W20260928 10:44:18.000166 7514 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s user 0.015s sys 0.068s
I20260928 10:44:18.002877 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1024) took 1708 ms. Trace:
I20260928 10:44:18.003018 7642 raft_consensus.cc:504] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.003175 6275 ts_tablet_manager.cc:1428] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260928 10:44:18.002875 7557 rpcz_store.cc:276] 0928 10:44:16.081436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.081478 (+ 42us) service_pool.cc:227] Handling call
0928 10:44:17.396218 (+1314740us) ts_tablet_manager.cc:1145] Deleting tablet 67f29acce3604e458d1981aad87f2eb9
0928 10:44:17.396229 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.753779 (+357550us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.852412 (+ 98633us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.002642 (+150230us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314602}
I20260928 10:44:18.003752 7642 leader_election.cc:288] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:18.003811 7514 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s user 0.015s sys 0.068s
I20260928 10:44:18.003769 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed0451e509d4580be284739255821e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.004238 7674 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:18.005040 6275 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:18.004921 5818 consensus_peers.cc:487] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76a47129ab5444dcab0a3f92a16046db. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:18.005820 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.006058 5883 raft_consensus.cc:2454] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:18.006659 7651 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:18.008169 6270 rpcz_store.cc:276] 0928 10:44:16.290418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.290453 (+ 35us) service_pool.cc:227] Handling call
0928 10:44:17.740184 (+1449731us) ts_tablet_manager.cc:1145] Deleting tablet d22260b5f20d47ad99d612ed5a7c022c
0928 10:44:17.740196 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.799398 (+ 59202us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.802025 (+ 2627us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:17.999006 (+196981us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1449578}
I20260928 10:44:18.008611 6270 tablet_replica.cc:330] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:18.008986 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:18.010327 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet d22260b5f20d47ad99d612ed5a7c022c (table default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]) successfully deleted
I20260928 10:44:18.010915 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:18.011196 5882 raft_consensus.cc:3037] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.011533 6270 raft_consensus.cc:2229] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.011775 6275 tablet_bootstrap.cc:654] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.011924 6270 raft_consensus.cc:2258] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.013912 5882 raft_consensus.cc:2454] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:18.015282 6270 ts_tablet_manager.cc:1905] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.015378 5957 leader_election.cc:302] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.022826 7642 raft_consensus.cc:2781] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:18.022967 7642 raft_consensus.cc:482] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:18.023578 7642 raft_consensus.cc:3037] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.023612 5957 leader_election.cc:302] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.023927 7680 raft_consensus.cc:2781] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:18.024066 7680 raft_consensus.cc:686] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:18.024295 7680 consensus_queue.cc:237] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.026134 7642 raft_consensus.cc:504] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.026636 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1003) took 1944 ms. Trace:
I20260928 10:44:18.026880 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfef184644b4fec8058759dd2e70cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.026782 7557 rpcz_store.cc:276] 0928 10:44:16.081734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.081771 (+ 37us) service_pool.cc:227] Handling call
0928 10:44:18.003572 (+1921801us) ts_tablet_manager.cc:1145] Deleting tablet 76a47129ab5444dcab0a3f92a16046db
0928 10:44:18.026326 (+ 22754us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.026590 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921664}
I20260928 10:44:18.031672 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f290d195b3d04f4086650b2bb8a50cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.034682 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 337b66a1e02245f298335d445f5020b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.034934 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f590c4ac7e6a4df485cceca9bca2058b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.038681 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6abf75d30334b08aa4b53ef92fbaa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.041858 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39bdf00d7984f6496300c8b0c9f7571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.042853 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1007) took 1627 ms. Trace:
I20260928 10:44:18.042945 7642 leader_election.cc:288] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.043143 7557 rpcz_store.cc:276] 0928 10:44:16.415552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.415609 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:18.027369 (+1611760us) ts_tablet_manager.cc:1145] Deleting tablet 95e1f8a63fed4c82ac95c2fbb7bc633d
0928 10:44:18.042605 (+ 15236us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.042801 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1398278}
I20260928 10:44:18.044389 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1868c3e598b4a46b550eaac13ae0d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.053890 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:18.054307 5882 raft_consensus.cc:3037] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.057762 5882 raft_consensus.cc:2454] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:18.058848 7557 tablet_replica.cc:330] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.058796 5957 leader_election.cc:302] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.059178 7557 raft_consensus.cc:2229] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.059224 7642 raft_consensus.cc:2781] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:18.059510 7642 raft_consensus.cc:686] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:18.059525 7557 raft_consensus.cc:2258] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.059775 7642 consensus_queue.cc:237] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:18.023300 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 116235us
I20260928 10:44:18.060815 7557 ts_tablet_manager.cc:1905] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:18.060997 5955 consensus_peers.cc:487] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:18.064179 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e74ac74d274a63b70b84d013e3f742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.065454 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b912bd21046b46f7b5c6adedb0933598" } modify_external_catalogs: true
I20260928 10:44:18.065693 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b912bd21046b46f7b5c6adedb0933598" } modify_external_catalogs: true
W20260928 10:44:18.072225 5686 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 83561.7us
I20260928 10:44:18.072391 7675 consensus_queue.cc:1035] T 502d275d161945ce86626594ab0d89b3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260928 10:44:18.072822 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 67f29acce3604e458d1981aad87f2eb9 (table default.Table_a766cb0490244b6794f67a154e92eb96 [id=ae18f339d30546ddad1a25f939345b78]) successfully deleted
I20260928 10:44:18.072927 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:18.073197 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 76a47129ab5444dcab0a3f92a16046db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a47129ab5444dcab0a3f92a16046db already in progress: creating tablet
I20260928 10:44:18.075718 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5fc9a16567af46819d9549748c48d2fd" } new_table_name: "default.Table_5101a41ebd1d448aba9997e49dd8cfd7" modify_external_catalogs: true
I20260928 10:44:18.077392 7616 raft_consensus.cc:482] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.077524 7616 raft_consensus.cc:504] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.078106 7616 leader_election.cc:288] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:18.078225 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 95e1f8a63fed4c82ac95c2fbb7bc633d because the tablet was not found. No further retry: Not found: Tablet not found: 95e1f8a63fed4c82ac95c2fbb7bc633d
I20260928 10:44:18.078694 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.078884 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:18.079238 5817 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.079380 5818 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.079625 5818 leader_election.cc:302] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.080438 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5c26637f264087a6d613d63a89238c (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.080593 6122 tablet_service.cc:1467] Processing CreateTablet for tablet dcc53301cc6f4978976317885dc1c2b6 (DEFAULT_TABLE table=default.Table_5bf0412c2a814aecae606e549920a767 [id=717a2fa4860e4e31aa3d35c25d8afd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.080847 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5c26637f264087a6d613d63a89238c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.081128 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc53301cc6f4978976317885dc1c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.081358 7616 raft_consensus.cc:2726] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.082427 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5c26637f264087a6d613d63a89238c (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.082844 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5c26637f264087a6d613d63a89238c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.085839 5858 tablet_service.cc:1467] Processing CreateTablet for tablet dcc53301cc6f4978976317885dc1c2b6 (DEFAULT_TABLE table=default.Table_5bf0412c2a814aecae606e549920a767 [id=717a2fa4860e4e31aa3d35c25d8afd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.086207 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 10ab23279fec4478be7031ae1c79d074 (DEFAULT_TABLE table=default.Table_51fa060d9bae490292fbd4d249570f9e [id=08747d5ccd6b49ecb1e343a3a70350a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.086745 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ab23279fec4478be7031ae1c79d074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.094619 6273 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.094893 6273 ts_tablet_manager.cc:1397] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.120s user 0.003s sys 0.001s
I20260928 10:44:18.098169 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed0451e509d4580be284739255821e2 (DEFAULT_TABLE table=default.Table_667eb87198d94c5fa00a0298e6bbf859 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.099100 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed0451e509d4580be284739255821e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.105068 6273 raft_consensus.cc:348] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.105485 6273 raft_consensus.cc:374] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.105616 6273 raft_consensus.cc:729] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.105898 6273 consensus_queue.cc:260] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.110327 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 (DEFAULT_TABLE table=default.Table_2da17aac467c432899b53a16ba53b3c0 [id=82d1a8f5679e4a7e8597f09eb9191b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.113201 6273 ts_tablet_manager.cc:1428] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260928 10:44:18.106536 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 10ab23279fec4478be7031ae1c79d074 (DEFAULT_TABLE table=default.Table_51fa060d9bae490292fbd4d249570f9e [id=08747d5ccd6b49ecb1e343a3a70350a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.117061 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fdf4f0f1779b41c1810a5abed52b624e" } new_table_name: "default.Table_552d092ff6c04813ac3fc542db212c21" modify_external_catalogs: true
I20260928 10:44:18.117162 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_23b2d43e3e86401b9c5c9a3d7b6dfc5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.117858 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23b2d43e3e86401b9c5c9a3d7b6dfc5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.118759 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_aed3c43316044362b92d3639149bff4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.119261 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aed3c43316044362b92d3639149bff4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.120147 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 98689ee648a84666a783aef0d4601fc2
I20260928 10:44:18.120568 5695 catalog_manager.cc:6565] ReplaceTablet: tablet 98689ee648a84666a783aef0d4601fc2 deleted and replaced by tablet e12cb66fdad747ba94d90bb1be2e7e0d
I20260928 10:44:18.120842 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b2615ec20bf64891aa8cf372959a2f93" } modify_external_catalogs: true
I20260928 10:44:18.120941 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 98689ee648a84666a783aef0d4601fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet e12cb66fdad747ba94d90bb1be2e7e0d) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.121001 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b2615ec20bf64891aa8cf372959a2f93" } modify_external_catalogs: true
I20260928 10:44:18.123158 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 98689ee648a84666a783aef0d4601fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet e12cb66fdad747ba94d90bb1be2e7e0d) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.123728 6275 tablet_bootstrap.cc:492] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.123869 6275 ts_tablet_manager.cc:1397] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.119s user 0.010s sys 0.028s
I20260928 10:44:18.124681 6273 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:18.113400 7569 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s user 0.028s sys 0.032s
W20260928 10:44:18.127074 7569 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s user 0.028s sys 0.032s
I20260928 10:44:18.115247 7662 raft_consensus.cc:482] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.128031 7662 raft_consensus.cc:504] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.128636 7662 leader_election.cc:288] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.135555 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5c26637f264087a6d613d63a89238c (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.136544 6273 tablet_bootstrap.cc:654] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.139016 6275 raft_consensus.cc:348] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.139274 6275 raft_consensus.cc:374] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.139312 6271 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.139339 6275 raft_consensus.cc:729] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.139451 6271 ts_tablet_manager.cc:1397] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.358s user 0.006s sys 0.008s
I20260928 10:44:18.139546 6275 consensus_queue.cc:260] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.143721 6269 ts_tablet_manager.cc:1918] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.143846 6269 log.cc:1196] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/4b6db38f77f64cfe9a7802d5307aa949
I20260928 10:44:18.144156 6269 ts_tablet_manager.cc:1939] T 4b6db38f77f64cfe9a7802d5307aa949 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:18.144968 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 851) took 7509 ms. Trace:
I20260928 10:44:18.145067 6269 rpcz_store.cc:276] 0928 10:44:10.635416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.636204 (+ 788us) service_pool.cc:227] Handling call
0928 10:44:17.832153 (+7195949us) ts_tablet_manager.cc:1145] Deleting tablet 4b6db38f77f64cfe9a7802d5307aa949
0928 10:44:17.832164 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:17.993381 (+161217us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.143601 (+150220us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.144944 (+ 1343us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7195796}
I20260928 10:44:18.145416 6269 tablet_replica.cc:330] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:18.145599 6269 raft_consensus.cc:2229] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.145743 6269 raft_consensus.cc:2258] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.146271 6269 ts_tablet_manager.cc:1905] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.151003 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 4b6db38f77f64cfe9a7802d5307aa949 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]) successfully deleted
I20260928 10:44:18.151777 7455 raft_consensus.cc:482] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.151924 7455 raft_consensus.cc:504] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.152549 7455 leader_election.cc:288] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.153102 7616 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.153223 7616 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.153663 6275 ts_tablet_manager.cc:1428] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260928 10:44:18.153857 7616 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:18.154798 6090 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:18.155242 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.155720 6275 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:18.155795 5817 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.156744 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5c26637f264087a6d613d63a89238c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:18.156838 6091 leader_election.cc:341] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:18.156929 6091 leader_election.cc:302] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.158004 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 10ab23279fec4478be7031ae1c79d074 (DEFAULT_TABLE table=default.Table_51fa060d9bae490292fbd4d249570f9e [id=08747d5ccd6b49ecb1e343a3a70350a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.158414 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ab23279fec4478be7031ae1c79d074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.158704 7455 raft_consensus.cc:2726] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.161521 6269 ts_tablet_manager.cc:1918] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.161648 6269 log.cc:1196] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/3cb9c554d363441b8006abc2d9bdd856
I20260928 10:44:18.161947 6269 ts_tablet_manager.cc:1939] T 3cb9c554d363441b8006abc2d9bdd856 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:18.162814 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 855) took 7525 ms. Trace:
I20260928 10:44:18.162920 6269 rpcz_store.cc:276] 0928 10:44:10.637608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.637748 (+ 140us) service_pool.cc:227] Handling call
0928 10:44:18.145371 (+7507623us) ts_tablet_manager.cc:1145] Deleting tablet 3cb9c554d363441b8006abc2d9bdd856
0928 10:44:18.145382 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.152699 (+ 7317us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.161409 (+ 8710us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.162789 (+ 1380us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7507423}
I20260928 10:44:18.163444 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 3cb9c554d363441b8006abc2d9bdd856 (table default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]) successfully deleted
I20260928 10:44:18.163844 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ab23279fec4478be7031ae1c79d074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.164355 6275 tablet_bootstrap.cc:654] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.170641 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfef184644b4fec8058759dd2e70cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.172119 6269 tablet_replica.cc:330] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:18.172420 6269 raft_consensus.cc:2229] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.172641 6269 raft_consensus.cc:2258] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.173745 7557 ts_tablet_manager.cc:1918] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.173923 7557 log.cc:1196] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/45a00a2c4692459cbdd0628af0184f09
I20260928 10:44:18.174289 7557 ts_tablet_manager.cc:1939] T 45a00a2c4692459cbdd0628af0184f09 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.175168 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1005) took 1759 ms. Trace:
I20260928 10:44:18.175323 7557 rpcz_store.cc:276] 0928 10:44:16.415386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.415761 (+ 375us) service_pool.cc:227] Handling call
0928 10:44:18.043749 (+1627988us) ts_tablet_manager.cc:1145] Deleting tablet 45a00a2c4692459cbdd0628af0184f09
0928 10:44:18.058734 (+ 14985us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.143666 (+ 84932us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.173645 (+ 29979us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.175150 (+ 1505us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1414593}
I20260928 10:44:18.175449 6270 ts_tablet_manager.cc:1918] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.175639 6270 log.cc:1196] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/3cb9c554d363441b8006abc2d9bdd856
I20260928 10:44:18.175957 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 45a00a2c4692459cbdd0628af0184f09 (table default.Table_0d36f9f8ba214574854051d92467ff92 [id=daa1b9bac97040caa339b33ea5acdaa6]) successfully deleted
I20260928 10:44:18.175999 5983 tablet_service.cc:1467] Processing CreateTablet for tablet dcc53301cc6f4978976317885dc1c2b6 (DEFAULT_TABLE table=default.Table_5bf0412c2a814aecae606e549920a767 [id=717a2fa4860e4e31aa3d35c25d8afd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.176412 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc53301cc6f4978976317885dc1c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.182415 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 47cd73e527d04194a7ca8c24a7134e09
W20260928 10:44:18.182548 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f16bcb500113427cb1536a643b70525d consensus state has no leader
I20260928 10:44:18.182924 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7c7255a349a41febd0f10821dff155a" } modify_external_catalogs: true
I20260928 10:44:18.183038 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c482d492c6f147919876101634e2f217" } modify_external_catalogs: true
I20260928 10:44:18.183135 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e7c7255a349a41febd0f10821dff155a" } modify_external_catalogs: true
I20260928 10:44:18.183238 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c482d492c6f147919876101634e2f217" } modify_external_catalogs: true
I20260928 10:44:18.183877 5694 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 6e51a1be805149548e31619511557dfc
I20260928 10:44:18.183970 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 98689ee648a84666a783aef0d4601fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet e12cb66fdad747ba94d90bb1be2e7e0d) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.184154 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8037e52845d14b45a299988713dc062b" } new_table_name: "default.Table_66b57e8a1dc9422686b89f61bb0afcac" modify_external_catalogs: true
I20260928 10:44:18.185168 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.185259 5698 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_505efc39409542098127f46437f164bc [id=aa8af07a351b4a479550ac24c9e23f44] alter complete (version 2)
I20260928 10:44:18.185382 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.185977 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_139ee18bc0754f6aa23a8fe96e1e89ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.190629 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 47cd73e527d04194a7ca8c24a7134e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.192375 6275 tablet_bootstrap.cc:492] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.192504 6275 ts_tablet_manager.cc:1397] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.004s
I20260928 10:44:18.193162 6275 raft_consensus.cc:348] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.193354 6275 raft_consensus.cc:374] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.193397 6275 raft_consensus.cc:729] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.193619 6275 consensus_queue.cc:260] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.194445 6273 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:18.194510 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59c67a02d7f84bed9c440c8c451ea4ff consensus state has no leader
I20260928 10:44:18.194590 6273 ts_tablet_manager.cc:1397] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.004s
I20260928 10:44:18.199153 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1a7cbc438a68462190d9462cc10f74e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.199846 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a7cbc438a68462190d9462cc10f74e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.201736 7557 tablet_replica.cc:330] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.201943 7557 raft_consensus.cc:2229] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.195456 6273 raft_consensus.cc:348] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.204560 6273 raft_consensus.cc:374] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.204666 6273 raft_consensus.cc:729] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.204950 6273 consensus_queue.cc:260] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.205763 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb9c554d363441b8006abc2d9bdd856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:18.206701 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_139ee18bc0754f6aa23a8fe96e1e89ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.211661 6273 ts_tablet_manager.cc:1428] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 10:44:18.211978 6273 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.213394 6273 tablet_bootstrap.cc:654] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.217617 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 914ea799da554974960e7bf142a407b1 consensus state has no leader
I20260928 10:44:18.218258 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ac97228d056a4e5c94a51b6decaf589f" } new_table_name: "default.Table_3fd660209eb542b090b9df5d50c15db4" modify_external_catalogs: true
I20260928 10:44:18.219380 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 6037e24ee6ba4399b6100ab27c4ed621 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:18.227644 6275 ts_tablet_manager.cc:1428] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260928 10:44:18.227999 6275 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.230460 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfb47ad184148d595830276bad311dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:58 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.233738 7557 raft_consensus.cc:2258] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.235955 7557 ts_tablet_manager.cc:1905] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.238994 6273 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.239275 6273 ts_tablet_manager.cc:1397] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
I20260928 10:44:18.240132 6273 raft_consensus.cc:348] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.240417 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c7f4ce1792fd494687863136583be109
I20260928 10:44:18.240448 6273 raft_consensus.cc:374] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.240659 6273 raft_consensus.cc:729] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.240833 5695 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f7b3d0154e144a7c9f1b5dab1815921f
I20260928 10:44:18.241036 6273 consensus_queue.cc:260] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:18.241266 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11b732758c1f4565b3051309cdfd9649 consensus state has no leader
I20260928 10:44:18.242005 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet c7f4ce1792fd494687863136583be109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.242295 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet c7f4ce1792fd494687863136583be109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.245594 6270 ts_tablet_manager.cc:1939] T 3cb9c554d363441b8006abc2d9bdd856 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:18.250067 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1023) took 1959 ms. Trace:
I20260928 10:44:18.250334 6270 rpcz_store.cc:276] 0928 10:44:16.290142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.290846 (+ 704us) service_pool.cc:227] Handling call
0928 10:44:18.008523 (+1717677us) ts_tablet_manager.cc:1145] Deleting tablet 3cb9c554d363441b8006abc2d9bdd856
0928 10:44:18.008537 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.059460 (+ 50923us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.072114 (+ 12654us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.250035 (+177921us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1717511}
I20260928 10:44:18.254958 6275 tablet_bootstrap.cc:654] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.254971 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1025) took 1788 ms. Trace:
I20260928 10:44:18.255113 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 3cb9c554d363441b8006abc2d9bdd856 (table default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]) successfully deleted
I20260928 10:44:18.255087 6270 rpcz_store.cc:276] 0928 10:44:16.466668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.495514 (+ 28846us) service_pool.cc:227] Handling call
0928 10:44:18.254822 (+1759308us) ts_tablet_manager.cc:1145] Deleting tablet 8092cd377a6548a1bce299cf5ce8f4dd
0928 10:44:18.254836 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.254949 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1757930}
W20260928 10:44:18.255506 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 8092cd377a6548a1bce299cf5ce8f4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8092cd377a6548a1bce299cf5ce8f4dd already in progress: creating tablet
I20260928 10:44:18.256021 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1028) took 1757 ms. Trace:
I20260928 10:44:18.256107 6270 rpcz_store.cc:276] 0928 10:44:16.498544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.500038 (+ 1494us) service_pool.cc:227] Handling call
0928 10:44:18.255887 (+1755849us) ts_tablet_manager.cc:1145] Deleting tablet 882f017dc1df42c89495b4d06bb9f563
0928 10:44:18.255899 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.256001 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1755059}
W20260928 10:44:18.256529 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 882f017dc1df42c89495b4d06bb9f563 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882f017dc1df42c89495b4d06bb9f563 already in progress: creating tablet
I20260928 10:44:18.256990 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1027) took 1765 ms. Trace:
I20260928 10:44:18.257071 6270 rpcz_store.cc:276] 0928 10:44:16.491199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.491421 (+ 222us) service_pool.cc:227] Handling call
0928 10:44:18.256871 (+1765450us) ts_tablet_manager.cc:1145] Deleting tablet a0de9e5daf1c46889988bd66f01f11be
0928 10:44:18.256882 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.256970 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1753391}
W20260928 10:44:18.257428 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a0de9e5daf1c46889988bd66f01f11be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0de9e5daf1c46889988bd66f01f11be already in progress: creating tablet
I20260928 10:44:18.257721 6270 tablet_replica.cc:330] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:18.257913 6270 raft_consensus.cc:2229] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.258167 6270 pending_rounds.cc:62] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:18.258227 6270 pending_rounds.cc:68] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265881646219264 op_type: NO_OP noop_request { }
I20260928 10:44:18.258358 6270 raft_consensus.cc:2866] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:18.258452 6270 raft_consensus.cc:2258] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.258647 6273 ts_tablet_manager.cc:1428] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20260928 10:44:18.259052 6270 ts_tablet_manager.cc:1905] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.267509 6273 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.269089 6273 tablet_bootstrap.cc:654] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.270339 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d915567a3c924688b3ef70bf6ec31435"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.271030 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d915567a3c924688b3ef70bf6ec31435 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.272230 6271 raft_consensus.cc:348] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.272536 6271 raft_consensus.cc:374] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.272643 6271 raft_consensus.cc:729] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.272871 6271 consensus_queue.cc:260] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.275446 7616 raft_consensus.cc:482] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.275605 7616 raft_consensus.cc:504] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.275823 6271 ts_tablet_manager.cc:1428] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.136s user 0.000s sys 0.003s
I20260928 10:44:18.276103 6271 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:18.276202 7616 leader_election.cc:288] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:18.276944 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.277468 5817 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.281288 6275 tablet_bootstrap.cc:492] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.281973 6275 ts_tablet_manager.cc:1397] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.005s
I20260928 10:44:18.282793 6275 raft_consensus.cc:348] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.283077 6275 raft_consensus.cc:374] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.283177 6275 raft_consensus.cc:729] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.283403 6275 consensus_queue.cc:260] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.284586 6275 ts_tablet_manager.cc:1428] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:18.284461 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_973c8c233782408a87dcdc8457da1792"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.285106 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973c8c233782408a87dcdc8457da1792 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.285463 7557 ts_tablet_manager.cc:1918] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.285584 7557 log.cc:1196] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/16510244612242f796910cf28e367da9
I20260928 10:44:18.285908 7557 ts_tablet_manager.cc:1939] T 16510244612242f796910cf28e367da9 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:18.286388 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39a851d2728a46c4ab2ad70399153361 consensus state has no leader
I20260928 10:44:18.305858 7564 raft_consensus.cc:482] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.306054 7564 raft_consensus.cc:504] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.300221 6269 ts_tablet_manager.cc:1905] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.306726 7564 leader_election.cc:288] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.307325 6275 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.309126 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1010) took 1893 ms. Trace:
I20260928 10:44:18.302270 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.309337 5882 raft_consensus.cc:2454] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:18.309947 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.310400 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.310658 5882 raft_consensus.cc:2379] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
W20260928 10:44:18.311779 5818 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.309778 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.311889 5818 leader_election.cc:302] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.309621 7557 rpcz_store.cc:276] 0928 10:44:16.415789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.415832 (+ 43us) service_pool.cc:227] Handling call
0928 10:44:18.201677 (+1785845us) ts_tablet_manager.cc:1145] Deleting tablet 16510244612242f796910cf28e367da9
0928 10:44:18.201693 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.275152 (+ 73459us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.285369 (+ 10217us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.309109 (+ 23740us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21457,"tablet-delete.queue_time_us":1572502}
I20260928 10:44:18.312219 7616 raft_consensus.cc:2726] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.312415 7557 tablet_replica.cc:330] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.312636 7557 raft_consensus.cc:2229] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.312956 7557 raft_consensus.cc:2258] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.313551 7557 ts_tablet_manager.cc:1905] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.313712 6275 tablet_bootstrap.cc:654] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.314064 6271 tablet_bootstrap.cc:654] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.314873 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f0191c7dd347058749790b4e4159c2" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.315727 6090 leader_election.cc:302] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.316083 7564 raft_consensus.cc:3037] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.321964 7564 raft_consensus.cc:2726] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:18.324872 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 263527us
I20260928 10:44:18.324952 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 16510244612242f796910cf28e367da9 (table default.Table_1f7d2400d1014db09fdc8caf288adcd4 [id=8adfd3e71dce45dcac2c373d0e755753]) successfully deleted
W20260928 10:44:18.325922 5955 consensus_peers.cc:487] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:18.326468 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_00006401c21343899754201dd8e65597"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.326468 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5999a52847494711b1665f30074e5065"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.327162 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00006401c21343899754201dd8e65597 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:18.327227 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5999a52847494711b1665f30074e5065 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.326771 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_582bec7fc1de458b9f8615e82e51928b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.328652 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_582bec7fc1de458b9f8615e82e51928b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.332520 5957 leader_election.cc:302] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.332942 7675 raft_consensus.cc:2781] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:18.333032 7675 raft_consensus.cc:482] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:18.333097 7675 raft_consensus.cc:3037] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.336072 7675 raft_consensus.cc:504] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.336763 7675 leader_election.cc:288] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:18.338289 5818 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.338452 5818 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.339030 7616 raft_consensus.cc:2726] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.339805 5880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:18.340008 5880 raft_consensus.cc:3037] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.342320 7564 raft_consensus.cc:482] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.342540 7564 raft_consensus.cc:504] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.342931 6203 heartbeater.cc:347] Connected to a master server at 127.5.100.125:37939
I20260928 10:44:18.342972 5880 raft_consensus.cc:2454] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:18.343679 7564 leader_election.cc:288] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:18.344293 6091 leader_election.cc:341] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 4bfb47ad184148d595830276bad311dc
I20260928 10:44:18.344286 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfb47ad184148d595830276bad311dc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.344362 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet c7f4ce1792fd494687863136583be109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.344805 6090 leader_election.cc:302] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.345301 7564 raft_consensus.cc:2726] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.348546 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.349498 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.350462 6155 raft_consensus.cc:3037] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.350663 6269 ts_tablet_manager.cc:1918] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.350769 6269 log.cc:1196] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c5c1a1c5e22e455d91de92f0aa3535c7
I20260928 10:44:18.351104 6269 ts_tablet_manager.cc:1939] T c5c1a1c5e22e455d91de92f0aa3535c7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:18.351855 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 856) took 7714 ms. Trace:
I20260928 10:44:18.351948 6269 rpcz_store.cc:276] 0928 10:44:10.637698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.638079 (+ 381us) service_pool.cc:227] Handling call
0928 10:44:18.172073 (+7533994us) ts_tablet_manager.cc:1145] Deleting tablet c5c1a1c5e22e455d91de92f0aa3535c7
0928 10:44:18.172084 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.346889 (+174805us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.350550 (+ 3661us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.351832 (+ 1282us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7533836}
I20260928 10:44:18.352288 6269 tablet_replica.cc:330] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:18.352461 6269 raft_consensus.cc:2229] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.352598 6269 raft_consensus.cc:2258] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.353119 6269 ts_tablet_manager.cc:1905] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.353986 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c5c1a1c5e22e455d91de92f0aa3535c7 (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
I20260928 10:44:18.356609 6273 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.356913 6273 ts_tablet_manager.cc:1397] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.008s
I20260928 10:44:18.357714 6273 raft_consensus.cc:348] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.358037 6273 raft_consensus.cc:374] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.358188 6273 raft_consensus.cc:729] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.358568 6273 consensus_queue.cc:260] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.360459 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.366882 6273 ts_tablet_manager.cc:1428] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 10:44:18.367323 6273 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.368709 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:18.369153 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 73960us
I20260928 10:44:18.369540 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.370304 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.371665 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.372279 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.372871 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a229207ce7cc475c8f4492e62d122721" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.377029 7557 ts_tablet_manager.cc:1918] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.377378 6273 tablet_bootstrap.cc:654] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.378306 5957 leader_election.cc:302] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.379719 7675 raft_consensus.cc:2781] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:18.379851 7675 raft_consensus.cc:686] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:18.379603 7557 log.cc:1196] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9956318fe8ef4d1cbc92eda9caa98602
I20260928 10:44:18.380059 7675 consensus_queue.cc:237] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.380399 7674 tablet.cc:1722] T cc50ec106e9b4137b64bf6ce71487979 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.381476 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_60ab33f1717f464f874105a5289f8a41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.387367 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 7a3cb198fb3d481eb6bdab29d968144e from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:18.389707 7651 tablet.cc:1722] T cc50ec106e9b4137b64bf6ce71487979 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.391433 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.394333 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.397210 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_973c8c233782408a87dcdc8457da1792" } new_table_name: "default.Table_4b496883c4594670b22467780b843420" modify_external_catalogs: true
I20260928 10:44:18.389504 6273 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.399035 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_17dd613f305e45edb706a04a93c7b222" } modify_external_catalogs: true
I20260928 10:44:18.399287 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_17dd613f305e45edb706a04a93c7b222" } modify_external_catalogs: true
I20260928 10:44:18.399894 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6e34e07962c64df98e43a6f5bb6fd281" } new_table_name: "default.Table_f5805ccf12af43bfb0943bf2a8e560cd" modify_external_catalogs: true
I20260928 10:44:18.402783 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3926c98ab5364e61af330f941b3d63bc" } modify_external_catalogs: true
I20260928 10:44:18.403074 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3926c98ab5364e61af330f941b3d63bc" } modify_external_catalogs: true
I20260928 10:44:18.403194 6273 ts_tablet_manager.cc:1397] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
I20260928 10:44:18.403615 7557 ts_tablet_manager.cc:1939] T 9956318fe8ef4d1cbc92eda9caa98602 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
W20260928 10:44:18.399346 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60ab33f1717f464f874105a5289f8a41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.407215 6273 raft_consensus.cc:348] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.404476 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1006) took 1989 ms. Trace:
I20260928 10:44:18.407897 7557 rpcz_store.cc:276] 0928 10:44:16.415480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.415954 (+ 474us) service_pool.cc:227] Handling call
0928 10:44:18.312371 (+1896417us) ts_tablet_manager.cc:1145] Deleting tablet 9956318fe8ef4d1cbc92eda9caa98602
0928 10:44:18.312383 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.364488 (+ 52105us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.376930 (+ 12442us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.404452 (+ 27522us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683163}
I20260928 10:44:18.408931 7707 consensus_queue.cc:1035] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:18.409411 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9956318fe8ef4d1cbc92eda9caa98602 (table default.Table_32e4b27c2c494235acd8e4bd96b9270b [id=b97213ac749448e9a97fde5cf9246b9d]) successfully deleted
I20260928 10:44:18.410455 7557 tablet_replica.cc:330] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.410866 6273 raft_consensus.cc:374] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.411226 7557 raft_consensus.cc:2229] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.411630 6273 raft_consensus.cc:729] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.413144 7707 raft_consensus.cc:482] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.413339 7707 raft_consensus.cc:504] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.414145 7707 leader_election.cc:288] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.411892 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.414716 7557 raft_consensus.cc:2258] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.415319 7557 ts_tablet_manager.cc:1905] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.418658 6273 consensus_queue.cc:260] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.420405 6273 ts_tablet_manager.cc:1428] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260928 10:44:18.420719 6273 tablet_bootstrap.cc:492] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.426466 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_499f33aa4f674f90aa166f95140d0219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.427373 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1a7cbc438a68462190d9462cc10f74e7" } new_table_name: "default.Table_7ec18e8771694dd49b866b3da97e6386" modify_external_catalogs: true
W20260928 10:44:18.428984 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f590c4ac7e6a4df485cceca9bca2058b consensus state has no leader
I20260928 10:44:18.429742 6273 tablet_bootstrap.cc:654] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.429991 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5dd8a3bbafa45549b88bfebbf3e8410 has no consensus state
W20260928 10:44:18.431216 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_499f33aa4f674f90aa166f95140d0219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.441291 7707 consensus_queue.cc:1035] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:18.443905 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_139ee18bc0754f6aa23a8fe96e1e89ce" } modify_external_catalogs: true
I20260928 10:44:18.444168 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_139ee18bc0754f6aa23a8fe96e1e89ce" } modify_external_catalogs: true
I20260928 10:44:18.445920 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_18daf257df304b87a04bbf5f584865fb" } modify_external_catalogs: true
I20260928 10:44:18.446130 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_18daf257df304b87a04bbf5f584865fb" } modify_external_catalogs: true
I20260928 10:44:18.446919 7616 raft_consensus.cc:482] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.447064 7616 raft_consensus.cc:504] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.447328 6273 tablet_bootstrap.cc:492] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.447654 7616 leader_election.cc:288] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:18.448859 6273 ts_tablet_manager.cc:1397] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260928 10:44:18.449532 6273 raft_consensus.cc:348] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.449720 6273 raft_consensus.cc:374] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.449770 6273 raft_consensus.cc:729] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.449941 6273 consensus_queue.cc:260] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.454627 7557 ts_tablet_manager.cc:1918] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.454788 7557 log.cc:1196] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:18.455171 7557 ts_tablet_manager.cc:1939] T f7d762e03b384d85b4e04be8331474a4 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.455533 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1008) took 2039 ms. Trace:
I20260928 10:44:18.455664 7557 rpcz_store.cc:276] 0928 10:44:16.415631 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.416061 (+ 430us) service_pool.cc:227] Handling call
0928 10:44:18.410392 (+1994331us) ts_tablet_manager.cc:1145] Deleting tablet f7d762e03b384d85b4e04be8331474a4
0928 10:44:18.410408 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.418270 (+ 7862us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.454505 (+ 36235us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.455511 (+ 1006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1781143}
I20260928 10:44:18.456292 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f7d762e03b384d85b4e04be8331474a4 (table default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]) successfully deleted
I20260928 10:44:18.456357 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a071f4e45b5c41ab934a5244ae781050" } new_table_name: "default.Table_c6bee3dfe1f943fd889ec70f978792f2" modify_external_catalogs: true
I20260928 10:44:18.457232 7616 raft_consensus.cc:482] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.457372 7616 raft_consensus.cc:504] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.457966 7616 leader_election.cc:288] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:18.459358 6273 ts_tablet_manager.cc:1428] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:44:18.459334 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.460026 5817 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.460472 6273 tablet_bootstrap.cc:492] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.461542 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.462164 5817 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.462656 5957 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bb5eed4318fe482789fee32e24a49bfc
W20260928 10:44:18.462934 5957 consensus_peers.cc:487] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5c1a1c5e22e455d91de92f0aa3535c7. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:18.463476 7557 tablet_replica.cc:330] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.463737 7674 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.464071 6273 tablet_bootstrap.cc:654] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.465502 6275 tablet_bootstrap.cc:492] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.465654 6275 ts_tablet_manager.cc:1397] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.158s user 0.006s sys 0.010s
I20260928 10:44:18.465979 7557 raft_consensus.cc:2229] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.466334 6275 raft_consensus.cc:348] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.466718 6275 raft_consensus.cc:374] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.466805 6275 raft_consensus.cc:729] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.467095 7557 raft_consensus.cc:2258] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.467062 6275 consensus_queue.cc:260] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.467676 7557 ts_tablet_manager.cc:1905] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.467818 6275 ts_tablet_manager.cc:1428] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:18.468077 6275 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.468707 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.471016 6275 tablet_bootstrap.cc:654] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.474571 7616 raft_consensus.cc:482] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.474730 7616 raft_consensus.cc:504] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.475307 7616 leader_election.cc:288] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:18.476155 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.476765 5817 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.480499 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb5eed4318fe482789fee32e24a49bfc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.481528 7564 raft_consensus.cc:482] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.481681 7564 raft_consensus.cc:504] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.481902 6271 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.482029 6271 ts_tablet_manager.cc:1397] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.206s user 0.001s sys 0.011s
I20260928 10:44:18.482223 7564 leader_election.cc:288] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.482630 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a0c6ca08884dc6813b25e3991d0d8c" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:18.483171 6090 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: Tablet not RUNNING: STOPPED
W20260928 10:44:18.483353 6091 leader_election.cc:341] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 07a0c6ca08884dc6813b25e3991d0d8c
I20260928 10:44:18.483500 6091 leader_election.cc:302] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.483599 6154 raft_consensus.cc:3037] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.483960 7564 raft_consensus.cc:2726] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:18.488627 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc24f846ad71418195657ff37dbe418e has no consensus state
I20260928 10:44:18.490147 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
W20260928 10:44:18.490824 5955 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.491111 5955 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.491341 5955 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.491336 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_14f7bfd3d5f8493c96fcc866e5160507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.491536 5955 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.491771 5955 consensus_peers.cc:487] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:18.491889 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14f7bfd3d5f8493c96fcc866e5160507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:18.491891 5955 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.492053 6091 consensus_peers.cc:487] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:18.492100 5955 leader_election.cc:341] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.493687 5695 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 6c3fa80726ea4802aac4cd8a7c0eb639
I20260928 10:44:18.494107 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cb3b44ccee5a4a09af9172ca455c5b05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.494342 6275 tablet_bootstrap.cc:492] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.494535 6275 ts_tablet_manager.cc:1397] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
W20260928 10:44:18.494696 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb3b44ccee5a4a09af9172ca455c5b05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.495272 6275 raft_consensus.cc:348] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.495507 6275 raft_consensus.cc:374] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.495572 6275 raft_consensus.cc:729] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.495853 6275 consensus_queue.cc:260] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.496516 6275 ts_tablet_manager.cc:1428] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:18.496675 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.496886 6275 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.498241 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8eb39b2da4e442bf82b9a70b87175b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.498929 6275 tablet_bootstrap.cc:654] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.499712 5818 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.499797 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eb39b2da4e442bf82b9a70b87175b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.499876 5818 leader_election.cc:302] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.500352 7616 raft_consensus.cc:2726] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.502270 7651 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.505144 6275 tablet_bootstrap.cc:492] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.507419 6270 ts_tablet_manager.cc:1918] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.507622 6270 log.cc:1196] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/07a0c6ca08884dc6813b25e3991d0d8c
W20260928 10:44:18.507612 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26b2ef9828d240838217d45c433ff667 consensus state has no leader
I20260928 10:44:18.508122 6270 ts_tablet_manager.cc:1939] T 07a0c6ca08884dc6813b25e3991d0d8c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:18.508020 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7d58c3bddc1f45939d5432843b74a325" } new_table_name: "default.Table_1c42644ffe764577bee6449c0d9b6c30" modify_external_catalogs: true
I20260928 10:44:18.508493 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1029) took 1962 ms. Trace:
I20260928 10:44:18.508675 6270 rpcz_store.cc:276] 0928 10:44:16.545931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.545986 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:18.257676 (+1711690us) ts_tablet_manager.cc:1145] Deleting tablet 07a0c6ca08884dc6813b25e3991d0d8c
0928 10:44:18.257686 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.403088 (+145402us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.507310 (+104222us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.508477 (+ 1167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1711501}
I20260928 10:44:18.509321 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 07a0c6ca08884dc6813b25e3991d0d8c (table default.Table_45fb73a0f9e1445c8e355b4dad0839df [id=5746764388a94c4aa38985de816e9c54]) successfully deleted
I20260928 10:44:18.509466 6275 ts_tablet_manager.cc:1397] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260928 10:44:18.511523 7557 ts_tablet_manager.cc:1918] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.512822 7557 log.cc:1196] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/b6d5121db2d34ea99c851595c395f3be
W20260928 10:44:18.513455 5818 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.513633 5818 leader_election.cc:302] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.514079 7616 raft_consensus.cc:2726] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.510318 6275 raft_consensus.cc:348] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.518750 6275 raft_consensus.cc:374] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.518889 6275 raft_consensus.cc:729] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.519201 6275 consensus_queue.cc:260] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.519894 7616 raft_consensus.cc:482] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.520074 7616 raft_consensus.cc:504] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.520747 7616 leader_election.cc:288] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:18.521176 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.521754 5817 leader_election.cc:341] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.519971 6275 ts_tablet_manager.cc:1428] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:44:18.522367 6275 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.524237 6275 tablet_bootstrap.cc:654] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.530687 7743 tablet.cc:1722] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:18.534639 5955 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.534992 5955 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.535342 6275 tablet_bootstrap.cc:492] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:18.535375 5955 leader_election.cc:341] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.535790 5955 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.535900 6275 ts_tablet_manager.cc:1397] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260928 10:44:18.536881 6275 raft_consensus.cc:348] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.537122 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_de8ffe56d2154e0c8ca4b46066aa0335"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.538147 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de8ffe56d2154e0c8ca4b46066aa0335 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:18.540628 5955 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:18.541092 5955 consensus_peers.cc:487] T 190cd281b1ad41aab2564744c282bcab P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:18.541785 5955 leader_election.cc:341] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.538097 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 76a47129ab5444dcab0a3f92a16046db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:15 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.542589 6275 raft_consensus.cc:374] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.538255 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.542670 6275 raft_consensus.cc:729] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.542869 6275 consensus_queue.cc:260] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.544818 6275 ts_tablet_manager.cc:1428] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 10:44:18.548228 7707 consensus_queue.cc:1035] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:18.538858 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5458bf89cc6e49729a30125ff6a5f1bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.550990 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5458bf89cc6e49729a30125ff6a5f1bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.553383 6275 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.555099 6270 tablet_replica.cc:330] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:18.555366 6270 raft_consensus.cc:2229] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.555626 6270 raft_consensus.cc:2258] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.556238 6270 ts_tablet_manager.cc:1905] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.560532 6275 tablet_bootstrap.cc:654] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.564667 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f16bcb500113427cb1536a643b70525d (table default.Table_cba0b4492880427b83a8a460e484d29c [id=af68cbd1beb0487ca37537e9bfec5f5b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f16bcb500113427cb1536a643b70525d consensus state has no leader
I20260928 10:44:18.569983 7564 consensus_queue.cc:1035] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:18.571014 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b0e7ff119e8488dbe89a3796d7ce228 has no consensus state
I20260928 10:44:18.571322 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a3443d4c6674342b4124156414dcc13 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:18.571979 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_751cb522af9d4e9eae2571a2a05cf29f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.572625 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_751cb522af9d4e9eae2571a2a05cf29f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.575088 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc53301cc6f4978976317885dc1c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.576059 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7e60a46790b94fb598a978cae4ef4696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.576560 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e60a46790b94fb598a978cae4ef4696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.582597 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.584705 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.587154 6275 tablet_bootstrap.cc:492] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.587013 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cb93faf059524456a24a4639b828da64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.587711 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb93faf059524456a24a4639b828da64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.588685 6275 ts_tablet_manager.cc:1397] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.002s
I20260928 10:44:18.589676 6275 raft_consensus.cc:348] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.591593 6275 raft_consensus.cc:374] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.594834 6271 raft_consensus.cc:348] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.595060 6271 raft_consensus.cc:374] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.595124 6271 raft_consensus.cc:729] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.595307 6271 consensus_queue.cc:260] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.595953 6271 ts_tablet_manager.cc:1428] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.114s user 0.001s sys 0.001s
I20260928 10:44:18.596244 6271 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:18.597721 6271 tablet_bootstrap.cc:654] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.604671 6275 raft_consensus.cc:729] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.605058 6275 consensus_queue.cc:260] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.605813 6275 ts_tablet_manager.cc:1428] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260928 10:44:18.609840 6275 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.527757 7735 tablet.cc:1722] T 8242d0647d1b4f28a5f1ccf36b00d616 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:18.588521 7557 ts_tablet_manager.cc:1939] T b6d5121db2d34ea99c851595c395f3be P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.611793 7443 raft_consensus.cc:482] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.611925 7443 raft_consensus.cc:504] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.612495 7443 leader_election.cc:288] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.612854 6275 tablet_bootstrap.cc:654] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.613089 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.613380 5884 raft_consensus.cc:2379] T fe50a4f375244d0bbc507cc638bb2f35 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:18.621122 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe50a4f375244d0bbc507cc638bb2f35" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:18.622605 6090 leader_election.cc:302] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.623426 7443 raft_consensus.cc:3037] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.626025 7443 raft_consensus.cc:2726] T fe50a4f375244d0bbc507cc638bb2f35 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.630770 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1fab26669af04128871528af607785f9
I20260928 10:44:18.633641 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fab26669af04128871528af607785f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.634855 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_123771d82cfe40db95628f7b70fb4f4e" } new_table_name: "default.Table_8c0ee61434fb477f9c4326a24851b4c2" modify_external_catalogs: true
I20260928 10:44:18.635505 7443 raft_consensus.cc:482] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.635663 7443 raft_consensus.cc:504] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.636387 7443 leader_election.cc:288] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.636915 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a47129ab5444dcab0a3f92a16046db" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.637706 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fab26669af04128871528af607785f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:18.638888 6090 leader_election.cc:341] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 76a47129ab5444dcab0a3f92a16046db
I20260928 10:44:18.639016 6090 leader_election.cc:302] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.640105 5693 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]). Expected version 1 got 0
I20260928 10:44:18.640249 7443 raft_consensus.cc:2726] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.641505 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.642364 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1009) took 2226 ms. Trace:
I20260928 10:44:18.642462 7557 rpcz_store.cc:276] 0928 10:44:16.415714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.416169 (+ 455us) service_pool.cc:227] Handling call
0928 10:44:18.463422 (+2047253us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:18.463434 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.470551 (+ 7117us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.511406 (+ 40855us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.642348 (+130942us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":893,"tablet-delete.queue_time_us":1834138}
I20260928 10:44:18.642915 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1011) took 2175 ms. Trace:
I20260928 10:44:18.642992 7557 rpcz_store.cc:276] 0928 10:44:16.467764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.467820 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:18.642770 (+2174950us) ts_tablet_manager.cc:1145] Deleting tablet 8092cd377a6548a1bce299cf5ce8f4dd
0928 10:44:18.642780 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.642871 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2010991}
I20260928 10:44:18.643286 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1012) took 2151 ms. Trace:
I20260928 10:44:18.643358 7557 rpcz_store.cc:276] 0928 10:44:16.491727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.491836 (+ 109us) service_pool.cc:227] Handling call
0928 10:44:18.643193 (+2151357us) ts_tablet_manager.cc:1145] Deleting tablet a0de9e5daf1c46889988bd66f01f11be
0928 10:44:18.643202 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.643275 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2011363}
I20260928 10:44:18.643605 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1013) took 2144 ms. Trace:
I20260928 10:44:18.643183 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet b6d5121db2d34ea99c851595c395f3be (table default.Table_b73a1edf5a204eaea434f196b48efb2b [id=fbf38701c8ef48d3a18275a3d4751357]) successfully deleted
I20260928 10:44:18.643666 7557 rpcz_store.cc:276] 0928 10:44:16.499112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.499183 (+ 71us) service_pool.cc:227] Handling call
0928 10:44:18.643530 (+2144347us) ts_tablet_manager.cc:1145] Deleting tablet 882f017dc1df42c89495b4d06bb9f563
0928 10:44:18.643538 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.643595 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2011664}
I20260928 10:44:18.643859 7557 tablet_replica.cc:330] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:18.643959 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8092cd377a6548a1bce299cf5ce8f4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8092cd377a6548a1bce299cf5ce8f4dd already in progress: creating tablet
I20260928 10:44:18.644032 7557 raft_consensus.cc:2229] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:18.644170 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a0de9e5daf1c46889988bd66f01f11be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0de9e5daf1c46889988bd66f01f11be already in progress: creating tablet
I20260928 10:44:18.644207 7557 raft_consensus.cc:2258] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:18.644574 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 882f017dc1df42c89495b4d06bb9f563 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882f017dc1df42c89495b4d06bb9f563 already in progress: creating tablet
I20260928 10:44:18.644770 7557 ts_tablet_manager.cc:1905] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.642565 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ab3769f0805b4970b30845f5f978e14a" } new_table_name: "default.Table_3228b3ddcce04724959b783432209126" modify_external_catalogs: true
W20260928 10:44:18.651906 5818 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.652063 5818 leader_election.cc:302] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:18.652428 7616 raft_consensus.cc:2726] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.652580 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1695a629b60c48909bb7938c1976d80f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.653122 5818 leader_election.cc:341] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.653254 5818 leader_election.cc:302] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:18.653409 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1695a629b60c48909bb7938c1976d80f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.653492 7616 raft_consensus.cc:2726] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.654820 7557 ts_tablet_manager.cc:1918] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:18.654960 7557 log.cc:1196] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c2f078ae6d2b498d8c5af90afba887ad
I20260928 10:44:18.655306 7557 ts_tablet_manager.cc:1939] T c2f078ae6d2b498d8c5af90afba887ad P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.655604 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1014) took 1698 ms. Trace:
I20260928 10:44:18.655689 7557 rpcz_store.cc:276] 0928 10:44:16.957374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.957972 (+ 598us) service_pool.cc:227] Handling call
0928 10:44:18.643826 (+1685854us) ts_tablet_manager.cc:1145] Deleting tablet c2f078ae6d2b498d8c5af90afba887ad
0928 10:44:18.643833 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.647921 (+ 4088us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.654701 (+ 6780us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.655585 (+ 884us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655581}
I20260928 10:44:18.655988 7557 tablet_replica.cc:330] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.656179 7557 raft_consensus.cc:2229] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.656494 7557 raft_consensus.cc:2258] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.656612 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]) successfully deleted
I20260928 10:44:18.656925 7680 raft_consensus.cc:482] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.657071 7680 raft_consensus.cc:504] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.657609 7680 leader_election.cc:288] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.659492 7557 ts_tablet_manager.cc:1905] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.660475 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:18.660755 5882 raft_consensus.cc:2454] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:18.663623 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fab26669af04128871528af607785f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.664295 5957 leader_election.cc:302] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:18.665194 7705 raft_consensus.cc:2781] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:18.665274 7705 raft_consensus.cc:482] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:18.665331 7705 raft_consensus.cc:3037] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.666949 7674 tablet.cc:1722] T c322d11fab43499f82e077fd8a8c02f3 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.667896 7705 raft_consensus.cc:504] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.668529 7705 leader_election.cc:288] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.668910 7707 consensus_queue.cc:1035] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:18.674960 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05c21bf3bbd7403cbc5a74142a883000 consensus state has no leader
W20260928 10:44:18.678035 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 112544a97042482e848b85b9dca84ca2 consensus state has no leader
I20260928 10:44:18.678642 7616 raft_consensus.cc:482] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.678828 7616 raft_consensus.cc:504] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.679446 7616 leader_election.cc:288] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:18.683581 6273 tablet_bootstrap.cc:492] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.683732 6273 ts_tablet_manager.cc:1397] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.223s user 0.015s sys 0.023s
I20260928 10:44:18.684471 6273 raft_consensus.cc:348] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.684691 6273 raft_consensus.cc:374] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.684754 6273 raft_consensus.cc:729] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.684958 6273 consensus_queue.cc:260] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.685559 6273 ts_tablet_manager.cc:1428] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:18.685828 6273 tablet_bootstrap.cc:492] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.687482 6269 ts_tablet_manager.cc:1918] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:18.687583 6273 tablet_bootstrap.cc:654] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.687654 6269 log.cc:1196] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a61d97ed6b7b4dcba34a7a2190316b02
I20260928 10:44:18.688026 6269 ts_tablet_manager.cc:1939] T a61d97ed6b7b4dcba34a7a2190316b02 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:18.688802 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 854) took 8051 ms. Trace:
I20260928 10:44:18.689062 6269 rpcz_store.cc:276] 0928 10:44:10.637514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:10.638297 (+ 783us) service_pool.cc:227] Handling call
0928 10:44:18.352240 (+7713943us) ts_tablet_manager.cc:1145] Deleting tablet a61d97ed6b7b4dcba34a7a2190316b02
0928 10:44:18.352252 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.508776 (+156524us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.687380 (+178604us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.688756 (+ 1376us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7713819}
I20260928 10:44:18.689738 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a61d97ed6b7b4dcba34a7a2190316b02 (table default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]) successfully deleted
I20260928 10:44:18.690254 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 857) took 7586 ms. Trace:
I20260928 10:44:18.691666 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51b5de9fb5c7450f8288a68a7a3f8fd7" } new_table_name: "default.Table_46d5c5a2dbda4e2cb761a5e1fd14ceaf" modify_external_catalogs: true
I20260928 10:44:18.692775 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_76c6f9abd0af4d5ab3daa5d92b3db883"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.694734 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76c6f9abd0af4d5ab3daa5d92b3db883 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.698056 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5999a52847494711b1665f30074e5065" } modify_external_catalogs: true
I20260928 10:44:18.698248 7557 ts_tablet_manager.cc:1918] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.698284 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5999a52847494711b1665f30074e5065" } modify_external_catalogs: true
I20260928 10:44:18.698381 7557 log.cc:1196] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f1a8f5241dd14684b5544e47d6cec9cc
I20260928 10:44:18.698741 7557 ts_tablet_manager.cc:1939] T f1a8f5241dd14684b5544e47d6cec9cc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.699043 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1015) took 1741 ms. Trace:
I20260928 10:44:18.699119 7557 rpcz_store.cc:276] 0928 10:44:16.957695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.958054 (+ 359us) service_pool.cc:227] Handling call
0928 10:44:18.655941 (+1697887us) ts_tablet_manager.cc:1145] Deleting tablet f1a8f5241dd14684b5544e47d6cec9cc
0928 10:44:18.655955 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.671773 (+ 15818us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.698099 (+ 26326us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.699026 (+ 927us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1666886}
I20260928 10:44:18.699589 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f1a8f5241dd14684b5544e47d6cec9cc (table default.Table_cbfc5179d22f49d0852cb571f19adbfb [id=ea84c90007604cf6ad98b7ed305457e7]) successfully deleted
I20260928 10:44:18.699848 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cdff9f01974354a81179dd9bd5a26e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.702009 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1021) took 1706 ms. Trace:
I20260928 10:44:18.702111 7557 rpcz_store.cc:276] 0928 10:44:16.995953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.996160 (+ 207us) service_pool.cc:227] Handling call
0928 10:44:18.701857 (+1705697us) ts_tablet_manager.cc:1145] Deleting tablet 069469d23ccf446284e67d970ffd6efa
0928 10:44:18.701870 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.701978 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1702282}
W20260928 10:44:18.702608 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 069469d23ccf446284e67d970ffd6efa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069469d23ccf446284e67d970ffd6efa already in progress: creating tablet
I20260928 10:44:18.703177 6271 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.703322 6271 ts_tablet_manager.cc:1397] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.107s user 0.000s sys 0.002s
I20260928 10:44:18.703999 6271 raft_consensus.cc:348] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.704216 6271 raft_consensus.cc:374] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.704264 6271 raft_consensus.cc:729] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.704402 6134 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffbf968fc7478b99ca11e307398363 (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.704452 6271 consensus_queue.cc:260] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.704833 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffbf968fc7478b99ca11e307398363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.704854 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1023) took 1702 ms. Trace:
I20260928 10:44:18.704974 6271 ts_tablet_manager.cc:1428] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:18.704936 7557 rpcz_store.cc:276] 0928 10:44:17.002647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.003393 (+ 746us) service_pool.cc:227] Handling call
0928 10:44:18.704727 (+1701334us) ts_tablet_manager.cc:1145] Deleting tablet 0e149cdb22cc4c60b012c2d87868827b
0928 10:44:18.704737 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.704835 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677104}
I20260928 10:44:18.705250 6271 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:18.705439 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0e149cdb22cc4c60b012c2d87868827b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e149cdb22cc4c60b012c2d87868827b already in progress: creating tablet
W20260928 10:44:18.705818 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 163689us
I20260928 10:44:18.706154 7675 consensus_queue.cc:1035] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:18.706892 6271 tablet_bootstrap.cc:654] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.707496 5955 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.707602 5955 leader_election.cc:302] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:18.707783 7675 raft_consensus.cc:2726] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.710186 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1030) took 1660 ms. Trace:
I20260928 10:44:18.710296 7557 rpcz_store.cc:276] 0928 10:44:17.050186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.079783 (+ 29597us) service_pool.cc:227] Handling call
0928 10:44:18.710032 (+1630249us) ts_tablet_manager.cc:1145] Deleting tablet 5640b425dd9945539dbdf658994c7918
0928 10:44:18.710047 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.710160 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573017}
W20260928 10:44:18.710798 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5640b425dd9945539dbdf658994c7918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5640b425dd9945539dbdf658994c7918 already in progress: creating tablet
I20260928 10:44:18.710845 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6c38f70ac4604d6a9fc9757976da471f" } new_table_name: "default.Table_b39b63f5b21a40a09b35265b7d92e5e5" modify_external_catalogs: true
I20260928 10:44:18.711861 7557 tablet_replica.cc:330] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.712302 7557 raft_consensus.cc:2229] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.712721 7557 pending_rounds.cc:62] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:18.712950 7557 pending_rounds.cc:68] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265877246451712 op_type: NO_OP noop_request { }
I20260928 10:44:18.713269 7557 raft_consensus.cc:2866] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:18.713529 7557 raft_consensus.cc:2258] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:18.713774 7709 log.cc:924] Time spent T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: Append to log took a long time: real 0.104s user 0.002s sys 0.001s
I20260928 10:44:18.714941 7557 ts_tablet_manager.cc:1905] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:18.716133 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 47299.9us
I20260928 10:44:18.727950 7557 ts_tablet_manager.cc:1918] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.731029 6275 tablet_bootstrap.cc:492] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.731305 6275 ts_tablet_manager.cc:1397] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.122s user 0.013s sys 0.009s
I20260928 10:44:18.732184 6275 raft_consensus.cc:348] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.732491 6275 raft_consensus.cc:374] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.732610 6275 raft_consensus.cc:729] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.732920 6275 consensus_queue.cc:260] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.732982 5992 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffbf968fc7478b99ca11e307398363 (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.733577 6275 ts_tablet_manager.cc:1428] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:18.733969 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffbf968fc7478b99ca11e307398363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.734025 6271 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.733978 6275 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.734144 6271 ts_tablet_manager.cc:1397] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.003s
I20260928 10:44:18.734838 6271 raft_consensus.cc:348] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.735056 6271 raft_consensus.cc:374] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.735116 6271 raft_consensus.cc:729] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.735285 6271 consensus_queue.cc:260] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.735821 6271 ts_tablet_manager.cc:1428] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:18.736073 6271 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:18.736655 6275 tablet_bootstrap.cc:654] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.737700 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:18.737972 6271 tablet_bootstrap.cc:654] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.739450 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a3462af0b92048c4be77613275780644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.739763 7557 log.cc:1196] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/2eded874aa094054b0c2e7c2e592dba1
I20260928 10:44:18.739948 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cdff9f01974354a81179dd9bd5a26e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:18.740061 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3462af0b92048c4be77613275780644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.740109 7557 ts_tablet_manager.cc:1939] T 2eded874aa094054b0c2e7c2e592dba1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.740401 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1043) took 1552 ms. Trace:
I20260928 10:44:18.740474 7557 rpcz_store.cc:276] 0928 10:44:17.187774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.187850 (+ 76us) service_pool.cc:227] Handling call
0928 10:44:18.711811 (+1523961us) ts_tablet_manager.cc:1145] Deleting tablet 2eded874aa094054b0c2e7c2e592dba1
0928 10:44:18.711823 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.717936 (+ 6113us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.727843 (+ 9907us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.740386 (+ 12543us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519283}
I20260928 10:44:18.740918 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 2eded874aa094054b0c2e7c2e592dba1 (table default.Table_a76680616cce463084d329ce2930c487 [id=4cb50ab5d3c44a6cb2664bb22cf4d2b6]) successfully deleted
I20260928 10:44:18.746681 7557 tablet_replica.cc:330] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.746917 7557 raft_consensus.cc:2229] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:18.747327 7557 raft_consensus.cc:2258] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.750190 6275 tablet_bootstrap.cc:492] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.750396 6275 ts_tablet_manager.cc:1397] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260928 10:44:18.750797 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 45814bb909ed4a15a39a0819973042d2
I20260928 10:44:18.751152 6275 raft_consensus.cc:348] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.751334 6275 raft_consensus.cc:374] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.751376 6275 raft_consensus.cc:729] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.751540 6275 consensus_queue.cc:260] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.751809 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 45814bb909ed4a15a39a0819973042d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.752128 6275 ts_tablet_manager.cc:1428] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:18.752375 6275 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.753983 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 45814bb909ed4a15a39a0819973042d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.754288 7557 ts_tablet_manager.cc:1905] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.750360 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 2649bc592b4148f59c6a570743951506 (DEFAULT_TABLE table=default.Table_a901ae757acf438cbf9ad1655741fbdd [id=5d15e189d210486e955eab697775daed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.755605 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2649bc592b4148f59c6a570743951506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.758208 6271 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.758343 6271 ts_tablet_manager.cc:1397] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
I20260928 10:44:18.758586 6275 tablet_bootstrap.cc:654] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.761404 6271 raft_consensus.cc:348] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.761643 6271 raft_consensus.cc:374] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.761700 6271 raft_consensus.cc:729] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.761868 6271 consensus_queue.cc:260] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.762391 6271 ts_tablet_manager.cc:1428] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:44:18.762379 7557 ts_tablet_manager.cc:1918] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:18.762688 6271 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:18.764240 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2649bc592b4148f59c6a570743951506 (DEFAULT_TABLE table=default.Table_a901ae757acf438cbf9ad1655741fbdd [id=5d15e189d210486e955eab697775daed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.764631 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2649bc592b4148f59c6a570743951506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.768373 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.768613 6154 raft_consensus.cc:2454] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:18.769332 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:18.769511 6154 raft_consensus.cc:3037] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.770524 7557 log.cc:1196] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/a61d97ed6b7b4dcba34a7a2190316b02
I20260928 10:44:18.770924 7557 ts_tablet_manager.cc:1939] T a61d97ed6b7b4dcba34a7a2190316b02 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.771219 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1042) took 1585 ms. Trace:
I20260928 10:44:18.771292 7557 rpcz_store.cc:276] 0928 10:44:17.185346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.185464 (+ 118us) service_pool.cc:227] Handling call
0928 10:44:18.746613 (+1561149us) ts_tablet_manager.cc:1145] Deleting tablet a61d97ed6b7b4dcba34a7a2190316b02
0928 10:44:18.746628 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.757242 (+ 10614us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.762282 (+ 5040us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.771204 (+ 8922us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519984}
I20260928 10:44:18.771773 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet a61d97ed6b7b4dcba34a7a2190316b02 (table default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]) successfully deleted
I20260928 10:44:18.772140 6154 raft_consensus.cc:2454] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:18.772178 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1044) took 1429 ms. Trace:
I20260928 10:44:18.772255 7557 rpcz_store.cc:276] 0928 10:44:17.342290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.345061 (+ 2771us) service_pool.cc:227] Handling call
0928 10:44:18.772061 (+1427000us) ts_tablet_manager.cc:1145] Deleting tablet d605cff11a05407b979c5aeea4534893
0928 10:44:18.772073 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.772163 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380487}
I20260928 10:44:18.764242 6271 tablet_bootstrap.cc:654] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:18.772686 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d605cff11a05407b979c5aeea4534893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d605cff11a05407b979c5aeea4534893 already in progress: creating tablet
I20260928 10:44:18.773005 6154 raft_consensus.cc:3037] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.773680 6275 tablet_bootstrap.cc:492] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.773864 6275 ts_tablet_manager.cc:1397] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260928 10:44:18.774676 6275 raft_consensus.cc:348] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.774919 6275 raft_consensus.cc:374] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.775018 6275 raft_consensus.cc:729] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.775265 6275 consensus_queue.cc:260] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.775883 6275 ts_tablet_manager.cc:1428] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:18.776166 6275 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.777649 6275 tablet_bootstrap.cc:654] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.777729 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1045) took 1340 ms. Trace:
I20260928 10:44:18.777988 7743 tablet.cc:1722] T cc50ec106e9b4137b64bf6ce71487979 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.778029 7557 rpcz_store.cc:276] 0928 10:44:17.433152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.470319 (+ 37167us) service_pool.cc:227] Handling call
0928 10:44:18.773033 (+1302714us) ts_tablet_manager.cc:1145] Deleting tablet b7065d8329b146b789216da84c9357b2
0928 10:44:18.773042 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.773115 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302444}
W20260928 10:44:18.778982 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b7065d8329b146b789216da84c9357b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7065d8329b146b789216da84c9357b2 already in progress: creating tablet
I20260928 10:44:18.779371 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1047) took 1238 ms. Trace:
I20260928 10:44:18.779467 7557 rpcz_store.cc:276] 0928 10:44:17.540620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.544343 (+ 3723us) service_pool.cc:227] Handling call
0928 10:44:18.779271 (+1234928us) ts_tablet_manager.cc:1145] Deleting tablet 6eeceb0dbb064221b6ff2a76c8bf8b79
0928 10:44:18.779282 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.779357 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234638}
W20260928 10:44:18.779883 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 already in progress: creating tablet
I20260928 10:44:18.779981 7455 raft_consensus.cc:482] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.780104 7455 raft_consensus.cc:504] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:18.780334 7735 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.780408 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1048) took 1239 ms. Trace:
I20260928 10:44:18.780476 7557 rpcz_store.cc:276] 0928 10:44:17.540753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.544678 (+ 3925us) service_pool.cc:227] Handling call
0928 10:44:18.780317 (+1235639us) ts_tablet_manager.cc:1145] Deleting tablet 4706d214d3184f4ebcec28f609b00a53
0928 10:44:18.780326 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.780395 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235514}
I20260928 10:44:18.780633 7455 leader_election.cc:288] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:18.780822 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4706d214d3184f4ebcec28f609b00a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4706d214d3184f4ebcec28f609b00a53 already in progress: creating tablet
I20260928 10:44:18.781232 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1049) took 1240 ms. Trace:
I20260928 10:44:18.781329 7557 rpcz_store.cc:276] 0928 10:44:17.540835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.544823 (+ 3988us) service_pool.cc:227] Handling call
0928 10:44:18.781145 (+1236322us) ts_tablet_manager.cc:1145] Deleting tablet 6286ae20ffbe4e24a585f29444acfe17
0928 10:44:18.781154 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.781218 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236218}
W20260928 10:44:18.781706 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6286ae20ffbe4e24a585f29444acfe17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6286ae20ffbe4e24a585f29444acfe17 already in progress: creating tablet
I20260928 10:44:18.782029 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1046) took 1241 ms. Trace:
I20260928 10:44:18.782135 7557 rpcz_store.cc:276] 0928 10:44:17.540498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.557410 (+ 16912us) service_pool.cc:227] Handling call
0928 10:44:18.781934 (+1224524us) ts_tablet_manager.cc:1145] Deleting tablet b2c52b6b88a44a4e925dcf1c3f9232e1
0928 10:44:18.781943 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.782015 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1224081}
I20260928 10:44:18.782298 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:18.782567 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2c52b6b88a44a4e925dcf1c3f9232e1 already in progress: creating tablet
I20260928 10:44:18.782809 7557 tablet_replica.cc:330] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.783000 7557 raft_consensus.cc:2229] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.783154 7557 raft_consensus.cc:2258] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.783664 7557 ts_tablet_manager.cc:1905] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:18.788251 5957 consensus_peers.cc:487] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b6db38f77f64cfe9a7802d5307aa949. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:18.790970 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 70c98265599a45a98bc1f8d70c8d05cd (DEFAULT_TABLE table=default.Table_c0854bf35562488b9269fe6813ea878c [id=3ef1af5af41842f7989a1816c8cb46dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.791319 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c98265599a45a98bc1f8d70c8d05cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:18.700562 5817 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.809305 6269 rpcz_store.cc:276] 0928 10:44:11.104168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.104333 (+ 165us) service_pool.cc:227] Handling call
0928 10:44:18.690096 (+7585763us) ts_tablet_manager.cc:1145] Deleting tablet 917513e857de49a7a57416eca237f70b
0928 10:44:18.690110 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.690219 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7585159}
W20260928 10:44:18.809504 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 108952us
I20260928 10:44:18.809803 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 858) took 7705 ms. Trace:
I20260928 10:44:18.809911 6269 rpcz_store.cc:276] 0928 10:44:11.104279 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.104637 (+ 358us) service_pool.cc:227] Handling call
0928 10:44:18.809643 (+7705006us) ts_tablet_manager.cc:1145] Deleting tablet be50535c36a54453b2a1a6d6d09207eb
0928 10:44:18.809654 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.809755 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7704601}
I20260928 10:44:18.810176 6269 tablet_replica.cc:330] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:18.706471 6273 tablet_bootstrap.cc:492] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.810680 6273 ts_tablet_manager.cc:1397] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.125s user 0.005s sys 0.000s
I20260928 10:44:18.811422 6273 raft_consensus.cc:348] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.811625 6273 raft_consensus.cc:374] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.811684 6273 raft_consensus.cc:729] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.811913 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7fd4f439f1ac4c368f18fc3bc2dacb07
I20260928 10:44:18.811857 6273 consensus_queue.cc:260] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.812287 6273 ts_tablet_manager.cc:1428] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:18.812556 6273 tablet_bootstrap.cc:492] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.813505 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet cee82663abf948a8a2a36c1676a57a8d
W20260928 10:44:18.813840 5818 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.814129 6273 tablet_bootstrap.cc:654] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.814255 5818 leader_election.cc:302] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:18.814374 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13455c14a9834156bd5e45179f5d3f41 consensus state has no leader
I20260928 10:44:18.724393 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a3443d4c6674342b4124156414dcc13" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:18.814651 5882 raft_consensus.cc:3037] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:18.815047 7616 raft_consensus.cc:2726] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:18.726598 5862 tablet_service.cc:1467] Processing CreateTablet for tablet c1ffbf968fc7478b99ca11e307398363 (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.732192 7651 tablet.cc:1722] T c322d11fab43499f82e077fd8a8c02f3 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:18.755155 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 45814bb909ed4a15a39a0819973042d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.815485 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ffbf968fc7478b99ca11e307398363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.787899 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 2649bc592b4148f59c6a570743951506 (DEFAULT_TABLE table=default.Table_a901ae757acf438cbf9ad1655741fbdd [id=5d15e189d210486e955eab697775daed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.815820 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2649bc592b4148f59c6a570743951506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.816371 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.816571 6119 tablet_service.cc:1514] Processing DeleteTablet for tablet cee82663abf948a8a2a36c1676a57a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.816830 7557 ts_tablet_manager.cc:1918] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:18.816936 7557 log.cc:1196] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/d22260b5f20d47ad99d612ed5a7c022c
I20260928 10:44:18.817648 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7a3cb198fb3d481eb6bdab29d968144e
I20260928 10:44:18.818001 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 7a3cb198fb3d481eb6bdab29d968144e deleted and replaced by tablet e26894e5be1b4bc19453c55f06beeaaf
I20260928 10:44:18.818005 7557 ts_tablet_manager.cc:1939] T d22260b5f20d47ad99d612ed5a7c022c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.818276 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1050) took 1152 ms. Trace:
I20260928 10:44:18.818346 7557 rpcz_store.cc:276] 0928 10:44:17.666213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.666349 (+ 136us) service_pool.cc:227] Handling call
0928 10:44:18.782771 (+1116422us) ts_tablet_manager.cc:1145] Deleting tablet d22260b5f20d47ad99d612ed5a7c022c
0928 10:44:18.782780 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.813583 (+ 30803us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.816693 (+ 3110us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.818262 (+ 1569us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094866}
I20260928 10:44:18.818646 7557 tablet_replica.cc:330] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:18.818814 7557 raft_consensus.cc:2229] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.818953 7557 raft_consensus.cc:2258] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.819428 7557 ts_tablet_manager.cc:1905] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.820451 5882 raft_consensus.cc:2454] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:18.820437 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet d22260b5f20d47ad99d612ed5a7c022c (table default.Table_752e3c917c88427c89c7b474aa6e2142 [id=22c0414bf02e46c980568d6d25b09846]) successfully deleted
I20260928 10:44:18.823985 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 70c98265599a45a98bc1f8d70c8d05cd (DEFAULT_TABLE table=default.Table_c0854bf35562488b9269fe6813ea878c [id=3ef1af5af41842f7989a1816c8cb46dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.825605 7644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ef695111ecc46a1bc1439b0b1a282bf)
I20260928 10:44:18.825939 7613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef695111ecc46a1bc1439b0b1a282bf. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:18.825999 7644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } }
I20260928 10:44:18.826272 7613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 10:44:18.827885 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 3a395050540d4148bcd02aeefe1a7324 (DEFAULT_TABLE table=default.Table_2eac1662a03a4d3e994d1dc575325c8d [id=f8e3d6452c4346da93e3c3c65e5a521a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.828348 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a395050540d4148bcd02aeefe1a7324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.829465 7644 leader_election.cc:288] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997), 0ef695111ecc46a1bc1439b0b1a282bf (127.5.100.124:42487)
W20260928 10:44:18.830818 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 917513e857de49a7a57416eca237f70b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917513e857de49a7a57416eca237f70b already in progress: creating tablet
W20260928 10:44:18.831182 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet be50535c36a54453b2a1a6d6d09207eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be50535c36a54453b2a1a6d6d09207eb already in progress: creating tablet
I20260928 10:44:18.832283 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e with delete_type TABLET_DATA_DELETED (replaced by tablet e26894e5be1b4bc19453c55f06beeaaf) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.832402 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 70c98265599a45a98bc1f8d70c8d05cd (DEFAULT_TABLE table=default.Table_c0854bf35562488b9269fe6813ea878c [id=3ef1af5af41842f7989a1816c8cb46dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.832482 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 424ff62ef57e4cd1af1f604373a1bae4 (DEFAULT_TABLE table=default.Table_c7bdaf58138c4d67a7ab84f53b902081 [id=6072e3bd039e4854881513594aa3c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.832823 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c98265599a45a98bc1f8d70c8d05cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.833072 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424ff62ef57e4cd1af1f604373a1bae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.834993 7616 raft_consensus.cc:482] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.835146 7616 raft_consensus.cc:504] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.835718 7616 leader_election.cc:288] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:18.840128 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e with delete_type TABLET_DATA_DELETED (replaced by tablet e26894e5be1b4bc19453c55f06beeaaf) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:18.842720 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.845921 5987 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.845782 6269 raft_consensus.cc:2229] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.846170 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet cee82663abf948a8a2a36c1676a57a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.846318 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a3cb198fb3d481eb6bdab29d968144e with delete_type TABLET_DATA_DELETED (replaced by tablet e26894e5be1b4bc19453c55f06beeaaf) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:18.846715 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 424ff62ef57e4cd1af1f604373a1bae4 (DEFAULT_TABLE table=default.Table_c7bdaf58138c4d67a7ab84f53b902081 [id=6072e3bd039e4854881513594aa3c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.847586 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 3a395050540d4148bcd02aeefe1a7324 (DEFAULT_TABLE table=default.Table_2eac1662a03a4d3e994d1dc575325c8d [id=f8e3d6452c4346da93e3c3c65e5a521a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.846354 6269 raft_consensus.cc:2258] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.848547 7616 raft_consensus.cc:482] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.848712 7616 raft_consensus.cc:504] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.848920 6269 ts_tablet_manager.cc:1905] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.849344 7616 leader_election.cc:288] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:18.851111 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet cee82663abf948a8a2a36c1676a57a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:18 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:18.852391 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c780d8c23a764f769848fa04550ceff6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:18.853180 5817 leader_election.cc:341] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.856160 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.856280 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf0bef2dfc4cbc848f20a4f469659b (DEFAULT_TABLE table=default.Table_c297c1156d4741088c7c1ce711d91cc7 [id=91ec88b4141f45c2994350c515203e48]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:18.856783 5817 leader_election.cc:341] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.857326 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf0bef2dfc4cbc848f20a4f469659b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.858858 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 3a395050540d4148bcd02aeefe1a7324 (DEFAULT_TABLE table=default.Table_2eac1662a03a4d3e994d1dc575325c8d [id=f8e3d6452c4346da93e3c3c65e5a521a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.859267 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a395050540d4148bcd02aeefe1a7324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.859434 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 2db842351a0942f3b4ec62a917a71234 (DEFAULT_TABLE table=default.Table_9bffbab1e55e478882d8115ab0e8b826 [id=c21263fc090748dca575ccc18034f02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.859840 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db842351a0942f3b4ec62a917a71234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.863746 5850 tablet_service.cc:1467] Processing CreateTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.864171 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8ad986491cf44669c6a5ef3f6ea21ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.864120 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 539ad153a13d4b51a50c6bf27c1d2ca4 (DEFAULT_TABLE table=default.Table_dc26d0f7cd174e11880f100e464fbe50 [id=e785f2411c404a10a462d8e5ad65f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.864323 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 1f16c439078844bfa5cfbda286794c4e (DEFAULT_TABLE table=default.Table_bd4f05b0e25d45afa8eef33066895e0c [id=23c785d611ef4bb6a725066828b82a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.864434 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 539ad153a13d4b51a50c6bf27c1d2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.864683 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f16c439078844bfa5cfbda286794c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.864687 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 24e83a40e6704cd5b5c805ab478abfd3 (DEFAULT_TABLE table=default.Table_5e048035283140fe883a18642f50d8f2 [id=3f378a6bd1c741de9acf787f570e7a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.864842 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 7b084c1a99d5437985174978329441e3 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.865069 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24e83a40e6704cd5b5c805ab478abfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.865361 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 49845b235306417fa025c2cb2d6911bf (DEFAULT_TABLE table=default.Table_e6788ab52b5a410b80dbafa42faca089 [id=868b3905a1a748da94e1ce56899e244f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.865654 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49845b235306417fa025c2cb2d6911bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.866716 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 8dba17dc11b940958cc10b9fbcb295f4 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.867019 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dba17dc11b940958cc10b9fbcb295f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.863811 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 429359332f62488fba8d647077354423 (DEFAULT_TABLE table=default.Table_359e46ee4be549cc9313d92a881b2bf4 [id=7192695f173445d4a664db2816f9e7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.870720 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429359332f62488fba8d647077354423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.871863 6117 tablet_service.cc:1467] Processing CreateTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.872238 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8ad986491cf44669c6a5ef3f6ea21ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.872442 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 49845b235306417fa025c2cb2d6911bf (DEFAULT_TABLE table=default.Table_e6788ab52b5a410b80dbafa42faca089 [id=868b3905a1a748da94e1ce56899e244f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.872715 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49845b235306417fa025c2cb2d6911bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.874619 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b084c1a99d5437985174978329441e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.874758 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 24e83a40e6704cd5b5c805ab478abfd3 (DEFAULT_TABLE table=default.Table_5e048035283140fe883a18642f50d8f2 [id=3f378a6bd1c741de9acf787f570e7a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.875053 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24e83a40e6704cd5b5c805ab478abfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.877409 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 8dba17dc11b940958cc10b9fbcb295f4 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.877683 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dba17dc11b940958cc10b9fbcb295f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.878759 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 429359332f62488fba8d647077354423 (DEFAULT_TABLE table=default.Table_359e46ee4be549cc9313d92a881b2bf4 [id=7192695f173445d4a664db2816f9e7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.879061 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429359332f62488fba8d647077354423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.882730 6131 tablet_service.cc:1467] Processing CreateTablet for tablet 46d7c42febfc428a9af71adac7dca328 (DEFAULT_TABLE table=default.Table_3ab4a1219a67476ca248861749e0c846 [id=7fccf8dbbe344058b70ec6d66fe31689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.882910 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 7b084c1a99d5437985174978329441e3 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.883041 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46d7c42febfc428a9af71adac7dca328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.883227 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b084c1a99d5437985174978329441e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.883605 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 1f16c439078844bfa5cfbda286794c4e (DEFAULT_TABLE table=default.Table_bd4f05b0e25d45afa8eef33066895e0c [id=23c785d611ef4bb6a725066828b82a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.883891 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f16c439078844bfa5cfbda286794c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.882740 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 539ad153a13d4b51a50c6bf27c1d2ca4 (DEFAULT_TABLE table=default.Table_dc26d0f7cd174e11880f100e464fbe50 [id=e785f2411c404a10a462d8e5ad65f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.887147 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 539ad153a13d4b51a50c6bf27c1d2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.894670 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 2db842351a0942f3b4ec62a917a71234 (DEFAULT_TABLE table=default.Table_9bffbab1e55e478882d8115ab0e8b826 [id=c21263fc090748dca575ccc18034f02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.895054 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db842351a0942f3b4ec62a917a71234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.895182 7616 raft_consensus.cc:482] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.895334 7616 raft_consensus.cc:504] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.895979 7616 leader_election.cc:288] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:18.899327 6149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25a2f20766024978a16b6bccd366a848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:18.899884 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf0bef2dfc4cbc848f20a4f469659b (DEFAULT_TABLE table=default.Table_c297c1156d4741088c7c1ce711d91cc7 [id=91ec88b4141f45c2994350c515203e48]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:18.900074 5817 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:18.900342 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf0bef2dfc4cbc848f20a4f469659b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.910377 6275 tablet_bootstrap.cc:492] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.910552 6275 ts_tablet_manager.cc:1397] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.134s user 0.006s sys 0.003s
I20260928 10:44:18.911243 6275 raft_consensus.cc:348] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.911438 6275 raft_consensus.cc:374] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.911489 6275 raft_consensus.cc:729] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.911689 6275 consensus_queue.cc:260] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.911717 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 424ff62ef57e4cd1af1f604373a1bae4 (DEFAULT_TABLE table=default.Table_c7bdaf58138c4d67a7ab84f53b902081 [id=6072e3bd039e4854881513594aa3c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.912119 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424ff62ef57e4cd1af1f604373a1bae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.912184 6275 ts_tablet_manager.cc:1428] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:18.912423 6275 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:18.913910 6275 tablet_bootstrap.cc:654] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.914624 6273 tablet_bootstrap.cc:492] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.914772 6273 ts_tablet_manager.cc:1397] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.000s
I20260928 10:44:18.915514 6273 raft_consensus.cc:348] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.915743 6273 raft_consensus.cc:374] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.915817 6273 raft_consensus.cc:729] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.916033 6273 consensus_queue.cc:260] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.916615 6273 ts_tablet_manager.cc:1428] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:18.916913 6273 tablet_bootstrap.cc:492] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.918380 6273 tablet_bootstrap.cc:654] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.919263 7109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 0) took 6765 ms. Trace:
I20260928 10:44:18.923899 7455 raft_consensus.cc:482] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:18.924045 7455 raft_consensus.cc:504] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.924685 7455 leader_election.cc:288] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:18.925081 6123 tablet_service.cc:1467] Processing CreateTablet for tablet a2997060d74d410083e605bcc340d4d9 (DEFAULT_TABLE table=default.Table_46da627f37a140bc842d319c71955e03 [id=778ffcffdac3468f8c49e462eae91b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.925483 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2997060d74d410083e605bcc340d4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.926703 5700 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2604ca361a744bb49747965094166994
I20260928 10:44:18.928488 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 3e78bfa994d041678796ba73a22ee414 (DEFAULT_TABLE table=default.Table_9d8fe2a3cf6d4876baa28468029c3157 [id=9294b66f9f8149a49414b4ddffba02a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.928911 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e78bfa994d041678796ba73a22ee414. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:18.930608 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb1b5a7494414c3ba3f2b176cde0eeb5 consensus state has no leader
I20260928 10:44:18.933210 7557 ts_tablet_manager.cc:1918] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:18.933367 7557 log.cc:1196] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/07a0c6ca08884dc6813b25e3991d0d8c
I20260928 10:44:18.933669 7557 ts_tablet_manager.cc:1939] T 07a0c6ca08884dc6813b25e3991d0d8c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:18.933961 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1054) took 1239 ms. Trace:
I20260928 10:44:18.934037 7557 rpcz_store.cc:276] 0928 10:44:17.695001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.695177 (+ 176us) service_pool.cc:227] Handling call
0928 10:44:18.818607 (+1123430us) ts_tablet_manager.cc:1145] Deleting tablet 07a0c6ca08884dc6813b25e3991d0d8c
0928 10:44:18.818617 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.914614 (+ 95997us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.923685 (+ 9071us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.933943 (+ 10258us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123214}
I20260928 10:44:18.934538 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 07a0c6ca08884dc6813b25e3991d0d8c (table default.Table_45fb73a0f9e1445c8e355b4dad0839df [id=5746764388a94c4aa38985de816e9c54]) successfully deleted
I20260928 10:44:18.934955 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1055) took 1237 ms. Trace:
I20260928 10:44:18.935034 7557 rpcz_store.cc:276] 0928 10:44:17.697070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.697122 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:18.934821 (+1237699us) ts_tablet_manager.cc:1145] Deleting tablet 1415cbe9fa15468a91932cdec4612cf9
0928 10:44:18.934834 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.934938 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1237491}
W20260928 10:44:18.935506 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1415cbe9fa15468a91932cdec4612cf9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1415cbe9fa15468a91932cdec4612cf9 already in progress: creating tablet
I20260928 10:44:18.935891 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1057) took 1226 ms. Trace:
I20260928 10:44:18.935709 5694 catalog_manager.cc:5495] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:18.935963 7557 rpcz_store.cc:276] 0928 10:44:17.708935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.709002 (+ 67us) service_pool.cc:227] Handling call
0928 10:44:18.935777 (+1226775us) ts_tablet_manager.cc:1145] Deleting tablet 9012fa19e01f43238c895a84c6dc9815
0928 10:44:18.935788 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.935876 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226512}
I20260928 10:44:18.936225 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
W20260928 10:44:18.936354 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9012fa19e01f43238c895a84c6dc9815 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9012fa19e01f43238c895a84c6dc9815 already in progress: creating tablet
I20260928 10:44:18.935985 7765 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 10:44:18.936691 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1056) took 1227 ms. Trace:
I20260928 10:44:18.936769 7557 rpcz_store.cc:276] 0928 10:44:17.708804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.712325 (+ 3521us) service_pool.cc:227] Handling call
0928 10:44:18.936591 (+1224266us) ts_tablet_manager.cc:1145] Deleting tablet 969cd0bea65344c787308737da1efd46
0928 10:44:18.936601 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.936677 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1224041}
I20260928 10:44:18.936764 5694 catalog_manager.cc:5495] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:18.937176 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:18.937367 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1069) took 1052 ms. Trace:
I20260928 10:44:18.937434 7557 rpcz_store.cc:276] 0928 10:44:17.884974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.885024 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:18.937257 (+1052233us) ts_tablet_manager.cc:1145] Deleting tablet 6520ab6acc2142a2a3b8e1f0dabedc7a
0928 10:44:18.937276 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.937353 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4992,"tablet-delete.queue_time_us":1051977}
I20260928 10:44:18.937440 5694 catalog_manager.cc:5495] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } }
I20260928 10:44:18.937973 5694 catalog_manager.cc:5495] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:18.938318 6271 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:18.938337 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:18.938458 6271 ts_tablet_manager.cc:1397] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.176s user 0.011s sys 0.000s
I20260928 10:44:18.938742 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_360ffaceac464cdfb9ca8278f925d9fc" } new_table_name: "default.Table_30ab911321ef41ea938b6e9228cf4725" modify_external_catalogs: true
I20260928 10:44:18.940289 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bc495c395b1e46c8ac5db474e1790b7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.940840 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc495c395b1e46c8ac5db474e1790b7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.942013 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6c2b98627d6646de9a34fba8f67cc203"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.942577 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c2b98627d6646de9a34fba8f67cc203 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.943709 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e6aec6578c9040cd9f2c18255f419558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:18.944135 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424ff62ef57e4cd1af1f604373a1bae4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:18.944195 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6aec6578c9040cd9f2c18255f419558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.945259 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8bf674c9271c461c9453f493dddc8469"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.945688 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bf674c9271c461c9453f493dddc8469 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.945932 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 46d7c42febfc428a9af71adac7dca328 (DEFAULT_TABLE table=default.Table_3ab4a1219a67476ca248861749e0c846 [id=7fccf8dbbe344058b70ec6d66fe31689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.946383 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46d7c42febfc428a9af71adac7dca328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.946729 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a395050540d4148bcd02aeefe1a7324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.946820 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_de31a65edae9483083c7f278bb1d88aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.947324 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de31a65edae9483083c7f278bb1d88aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.948503 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0464858370af453b8ba8edfdd7f2c243"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:18.948980 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0464858370af453b8ba8edfdd7f2c243 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:18.950232 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0e7ff119e8488dbe89a3796d7ce228 (DEFAULT_TABLE table=default.Table_1c42644ffe764577bee6449c0d9b6c30 [id=ae815ea9a8c24aa393fa1d1ff7fffda7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.950670 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0e7ff119e8488dbe89a3796d7ce228. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:18.937175 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 969cd0bea65344c787308737da1efd46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 969cd0bea65344c787308737da1efd46 already in progress: creating tablet
I20260928 10:44:18.952344 6133 tablet_service.cc:1467] Processing CreateTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 (DEFAULT_TABLE table=default.Table_96bc9de9fa5e4ef1999c61dece36c6dc [id=8b57367fe71a45f3898d445a53686a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.952744 6131 tablet_service.cc:1467] Processing CreateTablet for tablet c294fef855ea460fabe78b8ab5e4ac80 (DEFAULT_TABLE table=default.Table_7abf708f047242498f827cce03ce3342 [id=6cfb20ad8f184490b9d521fdede896d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:18.952818 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6520ab6acc2142a2a3b8e1f0dabedc7a already in progress: creating tablet
I20260928 10:44:18.946426 6269 ts_tablet_manager.cc:1918] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:18.953377 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0e7ff119e8488dbe89a3796d7ce228 (DEFAULT_TABLE table=default.Table_1c42644ffe764577bee6449c0d9b6c30 [id=ae815ea9a8c24aa393fa1d1ff7fffda7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.953544 6269 log.cc:1196] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/3abfedf425b84f679b22d6ca9bef718a
I20260928 10:44:18.953887 6269 ts_tablet_manager.cc:1939] T 3abfedf425b84f679b22d6ca9bef718a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:18.953874 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 32258185a7144e0282c9ae8f246faeda (DEFAULT_TABLE table=default.Table_1465606aff3e41dbb04521c83e690ee3 [id=a6313ef73f3a4dd3831a8b4b487cc1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.954236 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 862) took 7815 ms. Trace:
I20260928 10:44:18.954267 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 77034afc1df8428eaf152fc7151cca39 (DEFAULT_TABLE table=default.Table_ee5d6d896bd245f0a2b9c389c99f5eb4 [id=48273e57e9be4780a7ee2577d32dec98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.954346 6269 rpcz_store.cc:276] 0928 10:44:11.138949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.139002 (+ 53us) service_pool.cc:227] Handling call
0928 10:44:18.810117 (+7671115us) ts_tablet_manager.cc:1145] Deleting tablet 3abfedf425b84f679b22d6ca9bef718a
0928 10:44:18.810126 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.911658 (+101532us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.946300 (+ 34642us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.954194 (+ 7894us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35341,"tablet-delete.queue_time_us":7670884}
I20260928 10:44:18.954821 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 3abfedf425b84f679b22d6ca9bef718a (table default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]) successfully deleted
I20260928 10:44:18.954810 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 32258185a7144e0282c9ae8f246faeda (DEFAULT_TABLE table=default.Table_1465606aff3e41dbb04521c83e690ee3 [id=a6313ef73f3a4dd3831a8b4b487cc1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.954962 6269 tablet_replica.cc:330] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:18.955197 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32258185a7144e0282c9ae8f246faeda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.955461 5850 tablet_service.cc:1467] Processing CreateTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 (DEFAULT_TABLE table=default.Table_96bc9de9fa5e4ef1999c61dece36c6dc [id=8b57367fe71a45f3898d445a53686a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.955781 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e984fec74147a8af24c4cf9dfa3284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.958714 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c98265599a45a98bc1f8d70c8d05cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.961328 6273 tablet_bootstrap.cc:492] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:18.961510 6273 ts_tablet_manager.cc:1397] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.003s
I20260928 10:44:18.962283 6273 raft_consensus.cc:348] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.962586 6273 raft_consensus.cc:374] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.962677 6273 raft_consensus.cc:729] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.962865 5856 tablet_service.cc:1467] Processing CreateTablet for tablet c294fef855ea460fabe78b8ab5e4ac80 (DEFAULT_TABLE table=default.Table_7abf708f047242498f827cce03ce3342 [id=6cfb20ad8f184490b9d521fdede896d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.962903 6273 consensus_queue.cc:260] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:18.963317 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c294fef855ea460fabe78b8ab5e4ac80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.963537 6273 ts_tablet_manager.cc:1428] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 10:44:18.963842 6273 tablet_bootstrap.cc:492] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:18.964548 5694 catalog_manager.cc:5495] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:18.965273 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:18.965487 6273 tablet_bootstrap.cc:654] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:18.966837 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 77034afc1df8428eaf152fc7151cca39 (DEFAULT_TABLE table=default.Table_ee5d6d896bd245f0a2b9c389c99f5eb4 [id=48273e57e9be4780a7ee2577d32dec98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.967221 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77034afc1df8428eaf152fc7151cca39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.955195 6269 raft_consensus.cc:2229] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:18.971702 6269 raft_consensus.cc:2258] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:18.972299 6269 ts_tablet_manager.cc:1905] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:18.974696 6275 tablet_bootstrap.cc:492] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:18.974932 6275 ts_tablet_manager.cc:1397] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.008s
I20260928 10:44:18.976368 6275 raft_consensus.cc:348] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.976676 6275 raft_consensus.cc:374] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:18.976785 6275 raft_consensus.cc:729] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:18.977069 6275 consensus_queue.cc:260] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:18.977749 6275 ts_tablet_manager.cc:1428] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:18.987241 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1068) took 1102 ms. Trace:
I20260928 10:44:18.987210 7675 consensus_queue.cc:1035] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:18.987353 7557 rpcz_store.cc:276] 0928 10:44:17.884835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.885394 (+ 559us) service_pool.cc:227] Handling call
0928 10:44:18.938268 (+1052874us) ts_tablet_manager.cc:1145] Deleting tablet 4ead8c7aa6364125bd059516cf0413e7
0928 10:44:18.987088 (+ 48820us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.987217 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1052678}
W20260928 10:44:18.987800 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4ead8c7aa6364125bd059516cf0413e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ead8c7aa6364125bd059516cf0413e7 already in progress: creating tablet
I20260928 10:44:18.988904 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 539ad153a13d4b51a50c6bf27c1d2ca4 (DEFAULT_TABLE table=default.Table_dc26d0f7cd174e11880f100e464fbe50 [id=e785f2411c404a10a462d8e5ad65f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.989331 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 539ad153a13d4b51a50c6bf27c1d2ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.989292 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 3e78bfa994d041678796ba73a22ee414 (DEFAULT_TABLE table=default.Table_9d8fe2a3cf6d4876baa28468029c3157 [id=9294b66f9f8149a49414b4ddffba02a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.989621 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e78bfa994d041678796ba73a22ee414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.989848 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 7b084c1a99d5437985174978329441e3 (DEFAULT_TABLE table=default.Table_32c97b96f4e9497097370b07f7b9da83 [id=48a8988c755e4e5cbdfd5d7408f6a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.990161 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b084c1a99d5437985174978329441e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.990993 5994 tablet_service.cc:1467] Processing CreateTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.991295 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8ad986491cf44669c6a5ef3f6ea21ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.994733 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 24e83a40e6704cd5b5c805ab478abfd3 (DEFAULT_TABLE table=default.Table_5e048035283140fe883a18642f50d8f2 [id=3f378a6bd1c741de9acf787f570e7a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.995046 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24e83a40e6704cd5b5c805ab478abfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.995098 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 8dba17dc11b940958cc10b9fbcb295f4 (DEFAULT_TABLE table=default.Table_9d7e6f17bff44442923f9cb732081e0f [id=891766dd97ed4b64881706308cb9c8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.995358 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dba17dc11b940958cc10b9fbcb295f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.998436 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 429359332f62488fba8d647077354423 (DEFAULT_TABLE table=default.Table_359e46ee4be549cc9313d92a881b2bf4 [id=7192695f173445d4a664db2816f9e7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.998719 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 46d7c42febfc428a9af71adac7dca328 (DEFAULT_TABLE table=default.Table_3ab4a1219a67476ca248861749e0c846 [id=7fccf8dbbe344058b70ec6d66fe31689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.998854 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429359332f62488fba8d647077354423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:18.998998 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46d7c42febfc428a9af71adac7dca328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.002247 5990 tablet_service.cc:1467] Processing CreateTablet for tablet a2997060d74d410083e605bcc340d4d9 (DEFAULT_TABLE table=default.Table_46da627f37a140bc842d319c71955e03 [id=778ffcffdac3468f8c49e462eae91b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.002662 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2997060d74d410083e605bcc340d4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.002727 5996 tablet_service.cc:1467] Processing CreateTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 (DEFAULT_TABLE table=default.Table_96bc9de9fa5e4ef1999c61dece36c6dc [id=8b57367fe71a45f3898d445a53686a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.002990 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e984fec74147a8af24c4cf9dfa3284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.005510 6269 ts_tablet_manager.cc:1918] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.005666 6269 log.cc:1196] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/2ab439922c6e4ffea8d8cdb6b7d8d8d7
I20260928 10:44:19.006021 6269 ts_tablet_manager.cc:1939] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.006173 7455 raft_consensus.cc:482] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.006378 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 863) took 7866 ms. Trace:
I20260928 10:44:19.006304 7455 raft_consensus.cc:504] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.006495 6269 rpcz_store.cc:276] 0928 10:44:11.139593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.139652 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:18.954887 (+7815235us) ts_tablet_manager.cc:1145] Deleting tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
0928 10:44:18.954898 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.983879 (+ 28981us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.005370 (+ 21491us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.006336 (+ 966us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7815053}
I20260928 10:44:19.006868 6269 tablet_replica.cc:330] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.006822 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 77034afc1df8428eaf152fc7151cca39 (DEFAULT_TABLE table=default.Table_ee5d6d896bd245f0a2b9c389c99f5eb4 [id=48273e57e9be4780a7ee2577d32dec98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.006992 7455 leader_election.cc:288] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.007103 6269 raft_consensus.cc:2229] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.007217 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77034afc1df8428eaf152fc7151cca39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.007279 6269 raft_consensus.cc:2258] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.007498 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (table default.Table_9d4a7be11896409ebc4138bc454bc2bb [id=b1363dbf11ec4d228eac4323ea1ad5d9]) successfully deleted
I20260928 10:44:19.007884 6269 ts_tablet_manager.cc:1905] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:19.008427 6090 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 3cb9c554d363441b8006abc2d9bdd856
I20260928 10:44:19.008733 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877e2d1c734a4e2891119f308f9f3ae8" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.010820 6001 tablet_service.cc:1467] Processing CreateTablet for tablet c294fef855ea460fabe78b8ab5e4ac80 (DEFAULT_TABLE table=default.Table_7abf708f047242498f827cce03ce3342 [id=6cfb20ad8f184490b9d521fdede896d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.011224 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c294fef855ea460fabe78b8ab5e4ac80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.014817 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 32258185a7144e0282c9ae8f246faeda (DEFAULT_TABLE table=default.Table_1465606aff3e41dbb04521c83e690ee3 [id=a6313ef73f3a4dd3831a8b4b487cc1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.015223 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32258185a7144e0282c9ae8f246faeda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.018802 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0e7ff119e8488dbe89a3796d7ce228 (DEFAULT_TABLE table=default.Table_1c42644ffe764577bee6449c0d9b6c30 [id=ae815ea9a8c24aa393fa1d1ff7fffda7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.018896 7455 raft_consensus.cc:482] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.019043 7455 raft_consensus.cc:504] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:19.019186 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0e7ff119e8488dbe89a3796d7ce228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.019650 7455 leader_election.cc:288] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.020335 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.022881 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 2db842351a0942f3b4ec62a917a71234 (DEFAULT_TABLE table=default.Table_9bffbab1e55e478882d8115ab0e8b826 [id=c21263fc090748dca575ccc18034f02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:18.994763 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 49845b235306417fa025c2cb2d6911bf (DEFAULT_TABLE table=default.Table_e6788ab52b5a410b80dbafa42faca089 [id=868b3905a1a748da94e1ce56899e244f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.023584 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49845b235306417fa025c2cb2d6911bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.026741 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db842351a0942f3b4ec62a917a71234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.026958 7762 raft_consensus.cc:482] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.027148 7762 raft_consensus.cc:504] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.027822 7762 leader_election.cc:288] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.022372 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 1f16c439078844bfa5cfbda286794c4e (DEFAULT_TABLE table=default.Table_bd4f05b0e25d45afa8eef33066895e0c [id=23c785d611ef4bb6a725066828b82a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.034963 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f16c439078844bfa5cfbda286794c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.040951 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270d4148268a47e5a6a5e71651eb0b12" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.041848 5817 leader_election.cc:341] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:19.045817 5817 consensus_peers.cc:487] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2f078ae6d2b498d8c5af90afba887ad. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.046380 6269 ts_tablet_manager.cc:1918] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.046589 6269 log.cc:1196] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/85583238d6b54f1d89ff5b53b40e73bb
I20260928 10:44:19.046983 6269 ts_tablet_manager.cc:1939] T 85583238d6b54f1d89ff5b53b40e73bb P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.047582 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 864) took 7907 ms. Trace:
I20260928 10:44:19.047700 6269 rpcz_store.cc:276] 0928 10:44:11.139711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.139830 (+ 119us) service_pool.cc:227] Handling call
0928 10:44:19.006807 (+7866977us) ts_tablet_manager.cc:1145] Deleting tablet 85583238d6b54f1d89ff5b53b40e73bb
0928 10:44:19.006818 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.032469 (+ 25651us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.046099 (+ 13630us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.047545 (+ 1446us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7866801}
I20260928 10:44:19.048102 6269 tablet_replica.cc:330] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.048261 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 85583238d6b54f1d89ff5b53b40e73bb (table default.Table_e7cdd96b23534cf9a61ec1e66e419155 [id=2ff0d03c75a046f5b76951e171ee8e38]) successfully deleted
I20260928 10:44:19.048362 6269 raft_consensus.cc:2229] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.048534 6269 pending_rounds.cc:62] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Trying to abort 1 pending ops.
I20260928 10:44:19.048592 6269 pending_rounds.cc:68] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265886964436992 op_type: NO_OP noop_request { }
I20260928 10:44:19.048731 6269 raft_consensus.cc:2866] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:19.048846 6269 raft_consensus.cc:2258] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.058151 6269 ts_tablet_manager.cc:1905] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.062253 5696 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_db9adcd0bc9a4b4e90425535a5c52a58 [id=6c4f8a03470949939c8e51847b52ce13] alter complete (version 3)
I20260928 10:44:19.062933 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9ad6a96c2add467eaf16ec5e62390b77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.063540 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ad6a96c2add467eaf16ec5e62390b77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:19.065011 5697 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.65:39775 (request call id 169) took 869 ms (client timeout 1000 ms). Trace:
W20260928 10:44:19.065105 5697 rpcz_store.cc:269] 0928 10:44:18.195621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.203104 (+ 7483us) service_pool.cc:227] Handling call
0928 10:44:19.064943 (+861839us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260928 10:44:19.065500 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_884fb10fbd3649ed8e069634d78d3042" } modify_external_catalogs: true
I20260928 10:44:19.065666 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_884fb10fbd3649ed8e069634d78d3042" } modify_external_catalogs: true
I20260928 10:44:18.920167 7109 rpcz_store.cc:276] 0928 10:44:12.153477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.153532 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:16.809326 (+4655794us) raft_consensus.cc:1457] Updating replica for 406 ops
0928 10:44:16.818070 (+ 8744us) raft_consensus.cc:1520] Early marking committed up to index 0
0928 10:44:16.818086 (+ 16us) raft_consensus.cc:1525] Triggering prepare for 406 ops
0928 10:44:16.818825 (+ 739us) write_op.cc:270] Start()
0928 10:44:16.818901 (+ 76us) write_op.cc:276] Timestamp: P: 1790592244082296 usec, L: 0
0928 10:44:16.831831 (+ 12930us) write_op.cc:270] Start()
0928 10:44:16.831882 (+ 51us) write_op.cc:276] Timestamp: P: 1790592244084069 usec, L: 0
0928 10:44:16.832220 (+ 338us) write_op.cc:270] Start()
0928 10:44:16.832262 (+ 42us) write_op.cc:276] Timestamp: P: 1790592244084746 usec, L: 0
0928 10:44:16.832446 (+ 184us) write_op.cc:270] Start()
0928 10:44:16.832466 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244085297 usec, L: 0
0928 10:44:16.832610 (+ 144us) write_op.cc:270] Start()
0928 10:44:16.832631 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244086447 usec, L: 0
0928 10:44:16.832755 (+ 124us) write_op.cc:270] Start()
0928 10:44:16.832773 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244087983 usec, L: 0
0928 10:44:16.832898 (+ 125us) write_op.cc:270] Start()
0928 10:44:16.832939 (+ 41us) write_op.cc:276] Timestamp: P: 1790592244088500 usec, L: 0
0928 10:44:16.833078 (+ 139us) write_op.cc:270] Start()
0928 10:44:16.833099 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244089373 usec, L: 0
0928 10:44:16.833242 (+ 143us) write_op.cc:270] Start()
0928 10:44:16.833263 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244091007 usec, L: 0
0928 10:44:16.833379 (+ 116us) write_op.cc:270] Start()
0928 10:44:16.833398 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244091988 usec, L: 0
0928 10:44:16.833590 (+ 192us) write_op.cc:270] Start()
0928 10:44:16.833614 (+ 24us) write_op.cc:276] Timestamp: P: 1790592244097671 usec, L: 0
0928 10:44:16.833735 (+ 121us) write_op.cc:270] Start()
0928 10:44:16.833754 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244118022 usec, L: 0
0928 10:44:16.833887 (+ 133us) write_op.cc:270] Start()
0928 10:44:16.833907 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244118745 usec, L: 0
0928 10:44:16.834018 (+ 111us) write_op.cc:270] Start()
0928 10:44:16.834038 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244128400 usec, L: 0
0928 10:44:16.834171 (+ 133us) write_op.cc:270] Start()
0928 10:44:16.834191 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244128977 usec, L: 0
0928 10:44:16.834310 (+ 119us) write_op.cc:270] Start()
0928 10:44:16.834328 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244129571 usec, L: 0
0928 10:44:16.834462 (+ 134us) write_op.cc:270] Start()
0928 10:44:16.851041 (+ 16579us) write_op.cc:276] Timestamp: P: 1790592244133388 usec, L: 0
0928 10:44:16.851375 (+ 334us) write_op.cc:270] Start()
0928 10:44:16.851436 (+ 61us) write_op.cc:276] Timestamp: P: 1790592244135117 usec, L: 0
0928 10:44:16.851588 (+ 152us) write_op.cc:270] Start()
0928 10:44:16.851608 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244142494 usec, L: 0
0928 10:44:16.851713 (+ 105us) write_op.cc:270] Start()
0928 10:44:16.851730 (+ 17us) write_op.cc:276] Timestamp: P: 1790592244211049 usec, L: 0
0928 10:44:16.851862 (+ 132us) write_op.cc:270] Start()
0928 10:44:16.851883 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244250964 usec, L: 0
0928 10:44:16.852012 (+ 129us) write_op.cc:270] Start()
0928 10:44:16.852030 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244271721 usec, L: 0
0928 10:44:16.852148 (+ 118us) write_op.cc:270] Start()
0928 10:44:16.852165 (+ 17us) write_op.cc:276] Timestamp: P: 1790592244306863 usec, L: 0
0928 10:44:16.852314 (+ 149us) write_op.cc:270] Start()
0928 10:44:16.852331 (+ 17us) write_op.cc:276] Timestamp: P: 1790592244311316 usec, L: 0
0928 10:44:16.852450 (+ 119us) write_op.cc:270] Start()
0928 10:44:16.852468 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244384595 usec, L: 0
0928 10:44:16.893830 (+ 41362us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x616000050278. stack: 00007f1f1097a66e 00007f1f1097a430 00007f1f0fa015ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1f1d1c74fd 00007f1f1d1b641a 00007f1f1d166608 00007f1f1d165875 00007f1f1be77d27 00007f1f1be964e7 00007f1f1be93ee9 00007f1f1fa3aa6c 00007f1f1a325fa6 00007f1f1a325cd5
0928 10:44:16.895643 (+ 1813us) write_op.cc:270] Start()
0928 10:44:16.895689 (+ 46us) write_op.cc:276] Timestamp: P: 1790592244387294 usec, L: 0
0928 10:44:16.895969 (+ 280us) write_op.cc:270] Start()
0928 10:44:16.895998 (+ 29us) write_op.cc:276] Timestamp: P: 1790592244394651 usec, L: 0
0928 10:44:16.896151 (+ 153us) write_op.cc:270] Start()
0928 10:44:16.896183 (+ 32us) write_op.cc:276] Timestamp: P: 1790592244399052 usec, L: 0
0928 10:44:16.896329 (+ 146us) write_op.cc:270] Start()
0928 10:44:16.896349 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244399693 usec, L: 0
0928 10:44:16.896458 (+ 109us) write_op.cc:270] Start()
0928 10:44:16.896476 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244400189 usec, L: 0
0928 10:44:16.957399 (+ 60923us) write_op.cc:270] Start()
0928 10:44:16.957444 (+ 45us) write_op.cc:276] Timestamp: P: 1790592244413652 usec, L: 0
0928 10:44:16.959599 (+ 2155us) write_op.cc:270] Start()
0928 10:44:16.959648 (+ 49us) write_op.cc:276] Timestamp: P: 1790592244415055 usec, L: 0
0928 10:44:16.959887 (+ 239us) write_op.cc:270] Start()
0928 10:44:16.959909 (+ 22us) write_op.cc:276] Timestamp: P: 1790592244498006 usec, L: 0
0928 10:44:16.960024 (+ 115us) write_op.cc:270] Start()
0928 10:44:16.960041 (+ 17us) write_op.cc:276] Timestamp: P: 1790592244508663 usec, L: 0
0928 10:44:16.960175 (+ 134us) write_op.cc:270] Start()
0928 10:44:16.960196 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244509343 usec, L: 0
0928 10:44:16.960322 (+ 126us) write_op.cc:270] Start()
0928 10:44:16.960342 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244509906 usec, L: 0
0928 10:44:17.002358 (+ 42016us) write_op.cc:270] Start()
0928 10:44:17.002409 (+ 51us) write_op.cc:276] Timestamp: P: 1790592244510432 usec, L: 0
0928 10:44:17.002672 (+ 263us) write_op.cc:270] Start()
0928 10:44:17.002699 (+ 27us) write_op.cc:276] Timestamp: P: 1790592244523595 usec, L: 0
0928 10:44:17.002835 (+ 136us) write_op.cc:270] Start()
0928 10:44:17.002855 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244524160 usec, L: 0
0928 10:44:17.002980 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.002999 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244524607 usec, L: 0
0928 10:44:17.003119 (+ 120us) write_op.cc:270] Start()
0928 10:44:17.003138 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244525084 usec, L: 0
0928 10:44:17.003270 (+ 132us) write_op.cc:270] Start()
0928 10:44:17.003289 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244569560 usec, L: 0
0928 10:44:17.003409 (+ 120us) write_op.cc:270] Start()
0928 10:44:17.003429 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244610805 usec, L: 0
0928 10:44:17.003560 (+ 131us) write_op.cc:270] Start()
0928 10:44:17.003580 (+ 20us) write_op.cc:276] Timestamp: P: 1790592244613017 usec, L: 0
0928 10:44:17.003701 (+ 121us) write_op.cc:270] Start()
0928 10:44:17.003723 (+ 22us) write_op.cc:276] Timestamp: P: 1790592244742659 usec, L: 0
0928 10:44:17.003834 (+ 111us) write_op.cc:270] Start()
0928 10:44:17.003852 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244743403 usec, L: 0
0928 10:44:17.003956 (+ 104us) write_op.cc:270] Start()
0928 10:44:17.003974 (+ 18us) write_op.cc:276] Timestamp: P: 1790592244743985 usec, L: 0
0928 10:44:17.004083 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.004102 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244834719 usec, L: 0
0928 10:44:17.023749 (+ 19647us) write_op.cc:270] Start()
0928 10:44:17.023795 (+ 46us) write_op.cc:276] Timestamp: P: 1790592244852348 usec, L: 0
0928 10:44:17.024128 (+ 333us) write_op.cc:270] Start()
0928 10:44:17.024164 (+ 36us) write_op.cc:276] Timestamp: P: 1790592244873157 usec, L: 0
0928 10:44:17.024413 (+ 249us) write_op.cc:270] Start()
0928 10:44:17.024439 (+ 26us) write_op.cc:276] Timestamp: P: 1790592244910756 usec, L: 0
0928 10:44:17.024582 (+ 143us) write_op.cc:270] Start()
0928 10:44:17.024605 (+ 23us) write_op.cc:276] Timestamp: P: 1790592244917980 usec, L: 0
0928 10:44:17.024735 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.024756 (+ 21us) write_op.cc:276] Timestamp: P: 1790592244954553 usec, L: 0
0928 10:44:17.024862 (+ 106us) write_op.cc:270] Start()
0928 10:44:17.024878 (+ 16us) write_op.cc:276] Timestamp: P: 1790592244967531 usec, L: 0
0928 10:44:17.024974 (+ 96us) write_op.cc:270] Start()
0928 10:44:17.024993 (+ 19us) write_op.cc:276] Timestamp: P: 1790592244986541 usec, L: 0
0928 10:44:17.025102 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.025119 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245007977 usec, L: 0
0928 10:44:17.025228 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.025267 (+ 39us) write_op.cc:276] Timestamp: P: 1790592245008686 usec, L: 0
0928 10:44:17.025396 (+ 129us) write_op.cc:270] Start()
0928 10:44:17.025415 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245042958 usec, L: 0
0928 10:44:17.025537 (+ 122us) write_op.cc:270] Start()
0928 10:44:17.025555 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245054167 usec, L: 0
0928 10:44:17.025663 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.025681 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245054878 usec, L: 0
0928 10:44:17.025806 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.025823 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245055413 usec, L: 0
0928 10:44:17.025929 (+ 106us) write_op.cc:270] Start()
0928 10:44:17.025947 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245055944 usec, L: 0
0928 10:44:17.026057 (+ 110us) write_op.cc:270] Start()
0928 10:44:17.026075 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245057758 usec, L: 0
0928 10:44:17.026218 (+ 143us) write_op.cc:270] Start()
0928 10:44:17.026237 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245060735 usec, L: 0
0928 10:44:17.026374 (+ 137us) write_op.cc:270] Start()
0928 10:44:17.026394 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245136058 usec, L: 0
0928 10:44:17.026541 (+ 147us) write_op.cc:270] Start()
0928 10:44:17.026561 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245139846 usec, L: 0
0928 10:44:17.026691 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.026711 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245141110 usec, L: 0
0928 10:44:17.026822 (+ 111us) write_op.cc:270] Start()
0928 10:44:17.026843 (+ 21us) write_op.cc:276] Timestamp: P: 1790592245142051 usec, L: 0
0928 10:44:17.026955 (+ 112us) write_op.cc:270] Start()
0928 10:44:17.026973 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245142900 usec, L: 0
0928 10:44:17.027102 (+ 129us) write_op.cc:270] Start()
0928 10:44:17.027122 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245174595 usec, L: 0
0928 10:44:17.027255 (+ 133us) write_op.cc:270] Start()
0928 10:44:17.027273 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245184016 usec, L: 0
0928 10:44:17.027401 (+ 128us) write_op.cc:270] Start()
0928 10:44:17.027420 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245184583 usec, L: 0
0928 10:44:17.027541 (+ 121us) write_op.cc:270] Start()
0928 10:44:17.027559 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245185067 usec, L: 0
0928 10:44:17.027679 (+ 120us) write_op.cc:270] Start()
0928 10:44:17.027698 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245185736 usec, L: 0
0928 10:44:17.027852 (+ 154us) write_op.cc:270] Start()
0928 10:44:17.027883 (+ 31us) write_op.cc:276] Timestamp: P: 1790592245186253 usec, L: 0
0928 10:44:17.027992 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.028009 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245186732 usec, L: 0
0928 10:44:17.028115 (+ 106us) write_op.cc:270] Start()
0928 10:44:17.028133 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245187189 usec, L: 0
0928 10:44:17.028263 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.028281 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245188836 usec, L: 0
0928 10:44:17.028395 (+ 114us) write_op.cc:270] Start()
0928 10:44:17.028440 (+ 45us) write_op.cc:276] Timestamp: P: 1790592245198962 usec, L: 0
0928 10:44:17.028564 (+ 124us) write_op.cc:270] Start()
0928 10:44:17.028582 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245218046 usec, L: 0
0928 10:44:17.028687 (+ 105us) write_op.cc:270] Start()
0928 10:44:17.028705 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245259105 usec, L: 0
0928 10:44:17.028851 (+ 146us) write_op.cc:270] Start()
0928 10:44:17.028871 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245271214 usec, L: 0
0928 10:44:17.029002 (+ 131us) write_op.cc:270] Start()
0928 10:44:17.029039 (+ 37us) write_op.cc:276] Timestamp: P: 1790592245278397 usec, L: 0
0928 10:44:17.029169 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.029188 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245279666 usec, L: 0
0928 10:44:17.029317 (+ 129us) write_op.cc:270] Start()
0928 10:44:17.029344 (+ 27us) write_op.cc:276] Timestamp: P: 1790592245280277 usec, L: 0
0928 10:44:17.029469 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.029489 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245314700 usec, L: 0
0928 10:44:17.029639 (+ 150us) write_op.cc:270] Start()
0928 10:44:17.029659 (+ 20us) write_op.cc:276] Timestamp: P: 1790592245392911 usec, L: 0
0928 10:44:17.029799 (+ 140us) write_op.cc:270] Start()
0928 10:44:17.029820 (+ 21us) write_op.cc:276] Timestamp: P: 1790592245393464 usec, L: 0
0928 10:44:17.029927 (+ 107us) write_op.cc:270] Start()
0928 10:44:17.029953 (+ 26us) write_op.cc:276] Timestamp: P: 1790592245397983 usec, L: 0
0928 10:44:17.030067 (+ 114us) write_op.cc:270] Start()
0928 10:44:17.030084 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245406510 usec, L: 0
0928 10:44:17.030221 (+ 137us) write_op.cc:270] Start()
0928 10:44:17.030239 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245417915 usec, L: 0
0928 10:44:17.030345 (+ 106us) write_op.cc:270] Start()
0928 10:44:17.030361 (+ 16us) write_op.cc:276] Timestamp: P: 1790592245418530 usec, L: 0
0928 10:44:17.030541 (+ 180us) write_op.cc:270] Start()
0928 10:44:17.030563 (+ 22us) write_op.cc:276] Timestamp: P: 1790592245419082 usec, L: 0
0928 10:44:17.030683 (+ 120us) write_op.cc:270] Start()
0928 10:44:17.030702 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245419560 usec, L: 0
0928 10:44:17.030807 (+ 105us) write_op.cc:270] Start()
0928 10:44:17.030826 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245420029 usec, L: 0
0928 10:44:17.030931 (+ 105us) write_op.cc:270] Start()
0928 10:44:17.030949 (+ 18us) write_op.cc:276] Timestamp: P: 1790592245454492 usec, L: 0
0928 10:44:17.031049 (+ 100us) write_op.cc:270] Start()
0928 10:44:17.031072 (+ 23us) write_op.cc:276] Timestamp: P: 1790592245455294 usec, L: 0
0928 10:44:17.031200 (+ 128us) write_op.cc:270] Start()
0928 10:44:17.031219 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245456515 usec, L: 0
0928 10:44:17.312856 (+281637us) write_op.cc:270] Start()
0928 10:44:17.312986 (+ 130us) write_op.cc:276] Timestamp: P: 1790592245487354 usec, L: 0
0928 10:44:17.313481 (+ 495us) write_op.cc:270] Start()
0928 10:44:17.313566 (+ 85us) write_op.cc:276] Timestamp: P: 1790592245602396 usec, L: 0
0928 10:44:17.314072 (+ 506us) write_op.cc:270] Start()
0928 10:44:17.314139 (+ 67us) write_op.cc:276] Timestamp: P: 1790592245607759 usec, L: 0
0928 10:44:17.326394 (+ 12255us) write_op.cc:270] Start()
0928 10:44:17.326588 (+ 194us) write_op.cc:276] Timestamp: P: 1790592245615775 usec, L: 0
0928 10:44:17.327260 (+ 672us) write_op.cc:270] Start()
0928 10:44:17.327348 (+ 88us) write_op.cc:276] Timestamp: P: 1790592245617115 usec, L: 0
0928 10:44:17.353517 (+ 26169us) write_op.cc:270] Start()
0928 10:44:17.353561 (+ 44us) write_op.cc:276] Timestamp: P: 1790592245633314 usec, L: 0
0928 10:44:17.353810 (+ 249us) write_op.cc:270] Start()
0928 10:44:17.353836 (+ 26us) write_op.cc:276] Timestamp: P: 1790592245639022 usec, L: 0
0928 10:44:17.354005 (+ 169us) write_op.cc:270] Start()
0928 10:44:17.354026 (+ 21us) write_op.cc:276] Timestamp: P: 1790592245649744 usec, L: 0
0928 10:44:17.356136 (+ 2110us) write_op.cc:270] Start()
0928 10:44:17.356177 (+ 41us) write_op.cc:276] Timestamp: P: 1790592245655168 usec, L: 0
0928 10:44:17.356356 (+ 179us) write_op.cc:270] Start()
0928 10:44:17.356375 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245655881 usec, L: 0
0928 10:44:17.356492 (+ 117us) write_op.cc:270] Start()
0928 10:44:17.356508 (+ 16us) write_op.cc:276] Timestamp: P: 1790592245668502 usec, L: 0
0928 10:44:17.356638 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.356664 (+ 26us) write_op.cc:276] Timestamp: P: 1790592245669799 usec, L: 0
0928 10:44:17.356796 (+ 132us) write_op.cc:270] Start()
0928 10:44:17.356813 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245671371 usec, L: 0
0928 10:44:17.356946 (+ 133us) write_op.cc:270] Start()
0928 10:44:17.356963 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245673975 usec, L: 0
0928 10:44:17.357060 (+ 97us) write_op.cc:270] Start()
0928 10:44:17.357076 (+ 16us) write_op.cc:276] Timestamp: P: 1790592245696362 usec, L: 0
0928 10:44:17.357201 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.357218 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245697288 usec, L: 0
0928 10:44:17.357331 (+ 113us) write_op.cc:270] Start()
0928 10:44:17.357346 (+ 15us) write_op.cc:276] Timestamp: P: 1790592245709427 usec, L: 0
0928 10:44:17.357459 (+ 113us) write_op.cc:270] Start()
0928 10:44:17.357476 (+ 17us) write_op.cc:276] Timestamp: P: 1790592245718386 usec, L: 0
0928 10:44:17.357586 (+ 110us) write_op.cc:270] Start()
0928 10:44:17.357613 (+ 27us) write_op.cc:276] Timestamp: P: 1790592245741754 usec, L: 0
0928 10:44:17.357757 (+ 144us) write_op.cc:270] Start()
0928 10:44:17.357778 (+ 21us) write_op.cc:276] Timestamp: P: 1790592245743066 usec, L: 0
0928 10:44:17.357912 (+ 134us) write_op.cc:270] Start()
0928 10:44:17.357931 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245744410 usec, L: 0
0928 10:44:17.358058 (+ 127us) write_op.cc:270] Start()
0928 10:44:17.358077 (+ 19us) write_op.cc:276] Timestamp: P: 1790592245745359 usec, L: 0
0928 10:44:17.358291 (+ 214us) write_op.cc:270] Start()
0928 10:44:17.358320 (+ 29us) write_op.cc:276] Timestamp: P: 1790592245893744 usec, L: 0
0928 10:44:17.406612 (+ 48292us) write_op.cc:270] Start()
0928 10:44:17.406667 (+ 55us) write_op.cc:276] Timestamp: P: 1790592245894416 usec, L: 0
0928 10:44:17.411061 (+ 4394us) write_op.cc:270] Start()
0928 10:44:17.411111 (+ 50us) write_op.cc:276] Timestamp: P: 1790592245894980 usec, L: 0
0928 10:44:17.411297 (+ 186us) write_op.cc:270] Start()
0928 10:44:17.411319 (+ 22us) write_op.cc:276] Timestamp: P: 1790592245921291 usec, L: 0
0928 10:44:17.417979 (+ 6660us) write_op.cc:270] Start()
0928 10:44:17.418026 (+ 47us) write_op.cc:276] Timestamp: P: 1790592245976824 usec, L: 0
0928 10:44:17.418303 (+ 277us) write_op.cc:270] Start()
0928 10:44:17.418325 (+ 22us) write_op.cc:276] Timestamp: P: 1790592246006657 usec, L: 0
0928 10:44:17.418433 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.418450 (+ 17us) write_op.cc:276] Timestamp: P: 1790592246007869 usec, L: 0
0928 10:44:17.418635 (+ 185us) write_op.cc:270] Start()
0928 10:44:17.418675 (+ 40us) write_op.cc:276] Timestamp: P: 1790592246008807 usec, L: 0
0928 10:44:17.418939 (+ 264us) write_op.cc:270] Start()
0928 10:44:17.418962 (+ 23us) write_op.cc:276] Timestamp: P: 1790592246009714 usec, L: 0
0928 10:44:17.419093 (+ 131us) write_op.cc:270] Start()
0928 10:44:17.419111 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246100322 usec, L: 0
0928 10:44:17.419224 (+ 113us) write_op.cc:270] Start()
0928 10:44:17.419242 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246102230 usec, L: 0
0928 10:44:17.419364 (+ 122us) write_op.cc:270] Start()
0928 10:44:17.419380 (+ 16us) write_op.cc:276] Timestamp: P: 1790592246154969 usec, L: 0
0928 10:44:17.419494 (+ 114us) write_op.cc:270] Start()
0928 10:44:17.419513 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246155704 usec, L: 0
0928 10:44:17.419656 (+ 143us) write_op.cc:270] Start()
0928 10:44:17.419675 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246156369 usec, L: 0
0928 10:44:17.419790 (+ 115us) write_op.cc:270] Start()
0928 10:44:17.419810 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246156970 usec, L: 0
0928 10:44:17.419928 (+ 118us) write_op.cc:270] Start()
0928 10:44:17.419946 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246175796 usec, L: 0
0928 10:44:17.420105 (+ 159us) write_op.cc:270] Start()
0928 10:44:17.420124 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246180591 usec, L: 0
0928 10:44:17.420228 (+ 104us) write_op.cc:270] Start()
0928 10:44:17.420244 (+ 16us) write_op.cc:276] Timestamp: P: 1790592246183129 usec, L: 0
0928 10:44:17.420349 (+ 105us) write_op.cc:270] Start()
0928 10:44:17.420371 (+ 22us) write_op.cc:276] Timestamp: P: 1790592246187578 usec, L: 0
0928 10:44:17.420496 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.420518 (+ 22us) write_op.cc:276] Timestamp: P: 1790592246190501 usec, L: 0
0928 10:44:17.420643 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.420666 (+ 23us) write_op.cc:276] Timestamp: P: 1790592246192578 usec, L: 0
0928 10:44:17.420796 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.420815 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246199582 usec, L: 0
0928 10:44:17.420924 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.420942 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246204828 usec, L: 0
0928 10:44:17.442556 (+ 21614us) write_op.cc:270] Start()
0928 10:44:17.442600 (+ 44us) write_op.cc:276] Timestamp: P: 1790592246208162 usec, L: 0
0928 10:44:17.442866 (+ 266us) write_op.cc:270] Start()
0928 10:44:17.442893 (+ 27us) write_op.cc:276] Timestamp: P: 1790592246270742 usec, L: 0
0928 10:44:17.443083 (+ 190us) write_op.cc:270] Start()
0928 10:44:17.443107 (+ 24us) write_op.cc:276] Timestamp: P: 1790592246278337 usec, L: 0
0928 10:44:17.443243 (+ 136us) write_op.cc:270] Start()
0928 10:44:17.443264 (+ 21us) write_op.cc:276] Timestamp: P: 1790592246308649 usec, L: 0
0928 10:44:17.443387 (+ 123us) write_op.cc:270] Start()
0928 10:44:17.443408 (+ 21us) write_op.cc:276] Timestamp: P: 1790592246313144 usec, L: 0
0928 10:44:17.443536 (+ 128us) write_op.cc:270] Start()
0928 10:44:17.443556 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246314089 usec, L: 0
0928 10:44:17.443699 (+ 143us) write_op.cc:270] Start()
0928 10:44:17.443718 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246315548 usec, L: 0
0928 10:44:17.443844 (+ 126us) write_op.cc:270] Start()
0928 10:44:17.443863 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246320935 usec, L: 0
0928 10:44:17.444008 (+ 145us) write_op.cc:270] Start()
0928 10:44:17.444028 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246323438 usec, L: 0
0928 10:44:17.444171 (+ 143us) write_op.cc:270] Start()
0928 10:44:17.444191 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246381676 usec, L: 0
0928 10:44:17.444316 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.444336 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246445222 usec, L: 0
0928 10:44:17.444490 (+ 154us) write_op.cc:270] Start()
0928 10:44:17.444513 (+ 23us) write_op.cc:276] Timestamp: P: 1790592246459771 usec, L: 0
0928 10:44:17.444654 (+ 141us) write_op.cc:270] Start()
0928 10:44:17.444676 (+ 22us) write_op.cc:276] Timestamp: P: 1790592246466670 usec, L: 0
0928 10:44:17.444808 (+ 132us) write_op.cc:270] Start()
0928 10:44:17.444828 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246475129 usec, L: 0
0928 10:44:17.444960 (+ 132us) write_op.cc:270] Start()
0928 10:44:17.444979 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246475923 usec, L: 0
0928 10:44:17.445104 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.445122 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246489439 usec, L: 0
0928 10:44:17.445247 (+ 125us) write_op.cc:270] Start()
0928 10:44:17.445276 (+ 29us) write_op.cc:276] Timestamp: P: 1790592246525146 usec, L: 0
0928 10:44:17.445402 (+ 126us) write_op.cc:270] Start()
0928 10:44:17.445421 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246525983 usec, L: 0
0928 10:44:17.445536 (+ 115us) write_op.cc:270] Start()
0928 10:44:17.445555 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246527264 usec, L: 0
0928 10:44:17.445708 (+ 153us) write_op.cc:270] Start()
0928 10:44:17.445728 (+ 20us) write_op.cc:276] Timestamp: P: 1790592246529151 usec, L: 0
0928 10:44:17.445899 (+ 171us) write_op.cc:270] Start()
0928 10:44:17.445920 (+ 21us) write_op.cc:276] Timestamp: P: 1790592246531371 usec, L: 0
0928 10:44:17.446038 (+ 118us) write_op.cc:270] Start()
0928 10:44:17.446069 (+ 31us) write_op.cc:276] Timestamp: P: 1790592246736793 usec, L: 0
0928 10:44:17.446208 (+ 139us) write_op.cc:270] Start()
0928 10:44:17.446227 (+ 19us) write_op.cc:276] Timestamp: P: 1790592246743190 usec, L: 0
0928 10:44:17.446335 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.446387 (+ 52us) write_op.cc:276] Timestamp: P: 1790592246776556 usec, L: 0
0928 10:44:17.481702 (+ 35315us) write_op.cc:270] Start()
0928 10:44:17.481739 (+ 37us) write_op.cc:276] Timestamp: P: 1790592246937382 usec, L: 0
0928 10:44:17.481905 (+ 166us) write_op.cc:270] Start()
0928 10:44:17.481923 (+ 18us) write_op.cc:276] Timestamp: P: 1790592246976435 usec, L: 0
0928 10:44:17.482044 (+ 121us) write_op.cc:270] Start()
0928 10:44:17.482093 (+ 49us) write_op.cc:276] Timestamp: P: 1790592247035824 usec, L: 0
0928 10:44:17.482211 (+ 118us) write_op.cc:270] Start()
0928 10:44:17.482228 (+ 17us) write_op.cc:276] Timestamp: P: 1790592247067473 usec, L: 0
0928 10:44:17.482337 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.482353 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247068166 usec, L: 0
0928 10:44:17.482445 (+ 92us) write_op.cc:270] Start()
0928 10:44:17.482462 (+ 17us) write_op.cc:276] Timestamp: P: 1790592247068736 usec, L: 0
0928 10:44:17.482594 (+ 132us) write_op.cc:270] Start()
0928 10:44:17.482616 (+ 22us) write_op.cc:276] Timestamp: P: 1790592247069227 usec, L: 0
0928 10:44:17.482724 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.482740 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247069706 usec, L: 0
0928 10:44:17.482847 (+ 107us) write_op.cc:270] Start()
0928 10:44:17.482870 (+ 23us) write_op.cc:276] Timestamp: P: 1790592247072372 usec, L: 0
0928 10:44:17.483014 (+ 144us) write_op.cc:270] Start()
0928 10:44:17.483032 (+ 18us) write_op.cc:276] Timestamp: P: 1790592247108174 usec, L: 0
0928 10:44:17.483141 (+ 109us) write_op.cc:270] Start()
0928 10:44:17.483157 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247165397 usec, L: 0
0928 10:44:17.483255 (+ 98us) write_op.cc:270] Start()
0928 10:44:17.483271 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247166077 usec, L: 0
0928 10:44:17.483401 (+ 130us) write_op.cc:270] Start()
0928 10:44:17.483418 (+ 17us) write_op.cc:276] Timestamp: P: 1790592247166787 usec, L: 0
0928 10:44:17.483525 (+ 107us) write_op.cc:270] Start()
0928 10:44:17.483540 (+ 15us) write_op.cc:276] Timestamp: P: 1790592247167345 usec, L: 0
0928 10:44:17.483642 (+ 102us) write_op.cc:270] Start()
0928 10:44:17.483660 (+ 18us) write_op.cc:276] Timestamp: P: 1790592247189454 usec, L: 0
0928 10:44:17.483761 (+ 101us) write_op.cc:270] Start()
0928 10:44:17.483777 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247194111 usec, L: 0
0928 10:44:17.483876 (+ 99us) write_op.cc:270] Start()
0928 10:44:17.483892 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247194726 usec, L: 0
0928 10:44:17.483981 (+ 89us) write_op.cc:270] Start()
0928 10:44:17.483997 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247195222 usec, L: 0
0928 10:44:17.484118 (+ 121us) write_op.cc:270] Start()
0928 10:44:17.484135 (+ 17us) write_op.cc:276] Timestamp: P: 1790592247212047 usec, L: 0
0928 10:44:17.484266 (+ 131us) write_op.cc:270] Start()
0928 10:44:17.484282 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247218996 usec, L: 0
0928 10:44:17.484390 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.484405 (+ 15us) write_op.cc:276] Timestamp: P: 1790592247220167 usec, L: 0
0928 10:44:17.484518 (+ 113us) write_op.cc:270] Start()
0928 10:44:17.484534 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247234162 usec, L: 0
0928 10:44:17.484642 (+ 108us) write_op.cc:270] Start()
0928 10:44:17.484659 (+ 17us) write_op.cc:276] Timestamp: P: 1790592247238139 usec, L: 0
0928 10:44:17.523193 (+ 38534us) write_op.cc:270] Start()
0928 10:44:17.523235 (+ 42us) write_op.cc:276] Timestamp: P: 1790592247270716 usec, L: 0
0928 10:44:17.523432 (+ 197us) write_op.cc:270] Start()
0928 10:44:17.523453 (+ 21us) write_op.cc:276] Timestamp: P: 1790592247271611 usec, L: 0
0928 10:44:17.523565 (+ 112us) write_op.cc:270] Start()
0928 10:44:17.523646 (+ 81us) write_op.cc:276] Timestamp: P: 1790592247277476 usec, L: 0
0928 10:44:17.523774 (+ 128us) write_op.cc:270] Start()
0928 10:44:17.523790 (+ 16us) write_op.cc:276] Timestamp: P: 1790592247282043 usec, L: 0
0928 10:44:17.523896 (+ 106us) write_op.cc:270] S
I20260928 10:44:19.068951 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 30fb3f88e66b4f8582fb348e035af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:19.070147 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9da796356b8f45248a331412588136fc consensus state has no leader
I20260928 10:44:19.070657 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_08d92c5a2cb04347ac3210e7511a8dbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.071265 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08d92c5a2cb04347ac3210e7511a8dbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.075385 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6eb4514772cd4d52acbd6f76f0dc0304" } new_table_name: "default.Table_8b55c3a4cbaf492799a5aac4b20c0285" modify_external_catalogs: true
I20260928 10:44:19.077836 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 4f5c26637f264087a6d613d63a89238c from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:19.078120 6269 ts_tablet_manager.cc:1918] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.078337 6269 log.cc:1196] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/877e2d1c734a4e2891119f308f9f3ae8
I20260928 10:44:19.078866 6269 ts_tablet_manager.cc:1939] T 877e2d1c734a4e2891119f308f9f3ae8 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.079613 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 859) took 7941 ms. Trace:
I20260928 10:44:19.084574 6273 tablet_bootstrap.cc:492] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.085556 6269 rpcz_store.cc:276] 0928 10:44:11.138610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.140098 (+ 1488us) service_pool.cc:227] Handling call
0928 10:44:19.048008 (+7907910us) ts_tablet_manager.cc:1145] Deleting tablet 877e2d1c734a4e2891119f308f9f3ae8
0928 10:44:19.048020 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.061830 (+ 13810us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.077978 (+ 16148us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.079579 (+ 1601us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7907758}
I20260928 10:44:19.085737 6273 ts_tablet_manager.cc:1397] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.122s user 0.021s sys 0.009s
I20260928 10:44:19.086040 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 877e2d1c734a4e2891119f308f9f3ae8 (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
I20260928 10:44:19.089761 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_14f7bfd3d5f8493c96fcc866e5160507" } new_table_name: "default.Table_571da65303104a1180f4d7f67a75ebbb" modify_external_catalogs: true
I20260928 10:44:19.092051 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_da453b1c08bf4157826d53f8fc65d2e5" } modify_external_catalogs: true
I20260928 10:44:19.092236 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_da453b1c08bf4157826d53f8fc65d2e5" } modify_external_catalogs: true
I20260928 10:44:19.093293 7499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:19.093564 7499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:44:19.095100 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_833e6a9969bb4181a615685d78f21112" } modify_external_catalogs: true
I20260928 10:44:19.095278 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_833e6a9969bb4181a615685d78f21112" } modify_external_catalogs: true
I20260928 10:44:19.110317 6269 tablet_replica.cc:330] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.110657 6269 raft_consensus.cc:2229] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.110666 6273 raft_consensus.cc:348] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.110895 6269 raft_consensus.cc:2258] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.110967 6273 raft_consensus.cc:374] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.111043 6273 raft_consensus.cc:729] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.111292 6273 consensus_queue.cc:260] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.116895 6273 ts_tablet_manager.cc:1428] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260928 10:44:19.117281 6273 tablet_bootstrap.cc:492] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.118757 6269 ts_tablet_manager.cc:1905] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:19.122617 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 359237us
I20260928 10:44:19.123689 5957 leader_election.cc:302] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:19.123996 7675 raft_consensus.cc:2781] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:19.124114 7675 raft_consensus.cc:686] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:19.124343 7675 consensus_queue.cc:237] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:19.125454 6273 tablet_bootstrap.cc:654] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.128566 6269 ts_tablet_manager.cc:1918] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.128712 6269 log.cc:1196] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:19.129068 6269 ts_tablet_manager.cc:1939] T 1072cf156cdf4c2a8c9d9764de110c6d P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.129449 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 860) took 7990 ms. Trace:
I20260928 10:44:19.130957 6273 tablet_bootstrap.cc:492] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.133275 6273 ts_tablet_manager.cc:1397] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260928 10:44:19.133916 6269 rpcz_store.cc:276] 0928 10:44:11.138766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.140337 (+ 1571us) service_pool.cc:227] Handling call
0928 10:44:19.086332 (+7945995us) ts_tablet_manager.cc:1145] Deleting tablet 1072cf156cdf4c2a8c9d9764de110c6d
0928 10:44:19.086343 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.122406 (+ 36063us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.128412 (+ 6006us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.129407 (+ 995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7945812}
I20260928 10:44:19.134495 6269 tablet_replica.cc:330] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.134626 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1072cf156cdf4c2a8c9d9764de110c6d (table default.Table_8fbb02cd83954bd2ad721b776064fa23 [id=aa0fbbc798a8402e98d41714bad869b7]) successfully deleted
I20260928 10:44:19.134785 6269 raft_consensus.cc:2229] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.136348 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf0bef2dfc4cbc848f20a4f469659b (DEFAULT_TABLE table=default.Table_c297c1156d4741088c7c1ce711d91cc7 [id=91ec88b4141f45c2994350c515203e48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.139786 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4297f5d615074e28965ea88204aa007c
I20260928 10:44:19.142165 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:19.142401 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:19.143922 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 4297f5d615074e28965ea88204aa007c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.144929 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 4297f5d615074e28965ea88204aa007c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.145974 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e94c1f9d646646d88e675d56046c5392
I20260928 10:44:19.147087 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet e94c1f9d646646d88e675d56046c5392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.147611 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet e94c1f9d646646d88e675d56046c5392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.148772 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1d245c3bafda41cd8fbcdfb061c2e13b" } modify_external_catalogs: true
I20260928 10:44:19.149011 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1d245c3bafda41cd8fbcdfb061c2e13b" } modify_external_catalogs: true
W20260928 10:44:19.152530 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f0ea5e9d7cb4cf1834c42517fc9bdbf consensus state has no leader
I20260928 10:44:19.152980 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4e984fec74147a8af24c4cf9dfa3284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.152935 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6661e71ec33a42e6b191196785162b9f" } new_table_name: "default.Table_df354384bd76407fb7e6fec68e957639" modify_external_catalogs: true
I20260928 10:44:19.155107 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4f5c26637f264087a6d613d63a89238c
I20260928 10:44:19.157012 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c294fef855ea460fabe78b8ab5e4ac80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.159858 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5c26637f264087a6d613d63a89238c with delete_type TABLET_DATA_DELETED (replaced by tablet 5b0bc94471ad4608af7a85f27b60af68) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.160387 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5c26637f264087a6d613d63a89238c with delete_type TABLET_DATA_DELETED (replaced by tablet 5b0bc94471ad4608af7a85f27b60af68) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.160626 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 4f5c26637f264087a6d613d63a89238c deleted and replaced by tablet 5b0bc94471ad4608af7a85f27b60af68
I20260928 10:44:19.161497 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_53b45401a11d480983d2e28849b9ec52" } modify_external_catalogs: true
I20260928 10:44:19.161731 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_53b45401a11d480983d2e28849b9ec52" } modify_external_catalogs: true
W20260928 10:44:19.162828 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95fd004a4f724ae5bb285af67218d8d7 has no consensus state
I20260928 10:44:19.163314 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_6a85a780a1a941daa29448ce00f5231f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.163908 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a85a780a1a941daa29448ce00f5231f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.164847 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0e7ff119e8488dbe89a3796d7ce228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.167478 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eff1d60da628455ea5d70486f28df058" } new_table_name: "default.Table_eb723503bf41424387d94fbbb18bca56" modify_external_catalogs: true
I20260928 10:44:19.170742 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32258185a7144e0282c9ae8f246faeda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.175977 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77034afc1df8428eaf152fc7151cca39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.176321 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1070) took 1288 ms. Trace:
I20260928 10:44:19.176419 7557 rpcz_store.cc:276] 0928 10:44:17.887644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.887691 (+ 47us) service_pool.cc:227] Handling call
0928 10:44:18.988059 (+1100368us) ts_tablet_manager.cc:1145] Deleting tablet 2c3a6c8d0bf1402dbac60afd9298f4e6
0928 10:44:19.176206 (+188147us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.176305 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100166}
I20260928 10:44:19.176708 7557 tablet_replica.cc:330] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:19.176903 7557 raft_consensus.cc:2229] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.177047 7557 raft_consensus.cc:2258] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.178318 7557 ts_tablet_manager.cc:1905] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:19.183434 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 already in progress: creating tablet
I20260928 10:44:19.185809 7557 ts_tablet_manager.cc:1918] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.190968 7557 log.cc:1196] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c5c1a1c5e22e455d91de92f0aa3535c7
I20260928 10:44:19.191648 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9d69f9b5487145ebbad923d0330e69bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.192227 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d69f9b5487145ebbad923d0330e69bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.139755 5858 tablet_service.cc:1467] Processing CreateTablet for tablet a2997060d74d410083e605bcc340d4d9 (DEFAULT_TABLE table=default.Table_46da627f37a140bc842d319c71955e03 [id=778ffcffdac3468f8c49e462eae91b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.200738 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2997060d74d410083e605bcc340d4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.145632 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 4297f5d615074e28965ea88204aa007c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.148402 5991 tablet_service.cc:1514] Processing DeleteTablet for tablet e94c1f9d646646d88e675d56046c5392 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.202870 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf0bef2dfc4cbc848f20a4f469659b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.213164 6270 ts_tablet_manager.cc:1918] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.213419 6270 log.cc:1196] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9956318fe8ef4d1cbc92eda9caa98602
I20260928 10:44:19.214033 6270 ts_tablet_manager.cc:1939] T 9956318fe8ef4d1cbc92eda9caa98602 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:19.217694 6275 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:19.219309 6275 tablet_bootstrap.cc:654] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.229959 7762 raft_consensus.cc:482] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.245990 7762 raft_consensus.cc:504] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.246717 7762 leader_election.cc:288] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.230289 6273 raft_consensus.cc:348] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.230702 6269 raft_consensus.cc:2258] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.247119 6273 raft_consensus.cc:374] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.247207 6273 raft_consensus.cc:729] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.247426 6273 consensus_queue.cc:260] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.247639 6269 ts_tablet_manager.cc:1905] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.230842 7616 raft_consensus.cc:482] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.247819 7616 raft_consensus.cc:504] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.248000 6273 ts_tablet_manager.cc:1428] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.115s user 0.002s sys 0.000s
I20260928 10:44:19.248314 6273 tablet_bootstrap.cc:492] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.248376 7616 leader_election.cc:288] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.238655 7781 raft_consensus.cc:482] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.248605 7781 raft_consensus.cc:504] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.249123 7781 leader_election.cc:288] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.249115 7455 raft_consensus.cc:482] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.249244 7455 raft_consensus.cc:504] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:19.249814 7455 leader_election.cc:288] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.256866 6269 ts_tablet_manager.cc:1918] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.257125 6269 log.cc:1196] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/463cf5ecb52d40069b564698433c6781
I20260928 10:44:19.257505 6269 ts_tablet_manager.cc:1939] T 463cf5ecb52d40069b564698433c6781 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.257889 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 861) took 8119 ms. Trace:
I20260928 10:44:19.258054 6269 rpcz_store.cc:276] 0928 10:44:11.138853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.140619 (+ 1766us) service_pool.cc:227] Handling call
0928 10:44:19.134390 (+7993771us) ts_tablet_manager.cc:1145] Deleting tablet 463cf5ecb52d40069b564698433c6781
0928 10:44:19.134404 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.253900 (+119496us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.256759 (+ 2859us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.257870 (+ 1111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":95626,"tablet-delete.queue_time_us":7993566}
I20260928 10:44:19.258719 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 463cf5ecb52d40069b564698433c6781 (table default.Table_2e92501b07184f8d9021b31cc4f752fb [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
I20260928 10:44:19.259122 6269 tablet_replica.cc:330] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.259357 6269 raft_consensus.cc:2229] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.259572 6269 raft_consensus.cc:2258] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.260116 6269 ts_tablet_manager.cc:1905] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.269529 6269 ts_tablet_manager.cc:1918] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.151506 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c780d8c23a764f769848fa04550ceff6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.186379 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5c26637f264087a6d613d63a89238c with delete_type TABLET_DATA_DELETED (replaced by tablet 5b0bc94471ad4608af7a85f27b60af68) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.195557 6271 raft_consensus.cc:348] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.201223 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.201742 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25a2f20766024978a16b6bccd366a848" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.201853 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270d4148268a47e5a6a5e71651eb0b12" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.279124 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1030) took 2732 ms. Trace:
W20260928 10:44:19.151294 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 342086us
I20260928 10:44:19.250581 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.279274 6270 rpcz_store.cc:276] 0928 10:44:16.546449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.546515 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:18.555045 (+2008530us) ts_tablet_manager.cc:1145] Deleting tablet 9956318fe8ef4d1cbc92eda9caa98602
0928 10:44:18.555056 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:18.739392 (+184336us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:18.792309 (+ 52917us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.279069 (+486760us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2008363}
I20260928 10:44:19.279608 6270 tablet_replica.cc:330] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
W20260928 10:44:19.279765 5955 consensus_peers.cc:487] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.279807 6270 raft_consensus.cc:2229] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:19.279994 6270 pending_rounds.cc:62] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:19.279961 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9956318fe8ef4d1cbc92eda9caa98602 (table default.Table_32e4b27c2c494235acd8e4bd96b9270b [id=b97213ac749448e9a97fde5cf9246b9d]) successfully deleted
I20260928 10:44:19.280046 6270 pending_rounds.cc:68] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265886528905216 op_type: NO_OP noop_request { }
W20260928 10:44:19.280169 5955 consensus_peers.cc:487] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.280192 6270 raft_consensus.cc:2866] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:19.280222 6269 log.cc:1196] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/8a3443d4c6674342b4124156414dcc13
I20260928 10:44:19.280303 6270 raft_consensus.cc:2258] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.280539 6269 ts_tablet_manager.cc:1939] T 8a3443d4c6674342b4124156414dcc13 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.280817 6270 ts_tablet_manager.cc:1905] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.281230 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 865) took 8101 ms. Trace:
I20260928 10:44:19.281313 6269 rpcz_store.cc:276] 0928 10:44:11.179970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.180028 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:19.259067 (+8079039us) ts_tablet_manager.cc:1145] Deleting tablet 8a3443d4c6674342b4124156414dcc13
0928 10:44:19.259080 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.266657 (+ 7577us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.269420 (+ 2763us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.281210 (+ 11790us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8078800}
I20260928 10:44:19.281361 7707 consensus_queue.cc:1035] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.281709 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 8a3443d4c6674342b4124156414dcc13 (table default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]) successfully deleted
I20260928 10:44:19.282078 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 867) took 8044 ms. Trace:
I20260928 10:44:19.282150 6269 rpcz_store.cc:276] 0928 10:44:11.237902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.238025 (+ 123us) service_pool.cc:227] Handling call
0928 10:44:19.281952 (+8043927us) ts_tablet_manager.cc:1145] Deleting tablet bc5d744dbc904525858a39c27636443e
0928 10:44:19.281964 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.282059 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8036017}
W20260928 10:44:19.282527 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet bc5d744dbc904525858a39c27636443e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5d744dbc904525858a39c27636443e already in progress: creating tablet
I20260928 10:44:19.275805 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 3e78bfa994d041678796ba73a22ee414 (DEFAULT_TABLE table=default.Table_9d8fe2a3cf6d4876baa28468029c3157 [id=9294b66f9f8149a49414b4ddffba02a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.283071 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e78bfa994d041678796ba73a22ee414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.285989 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 866) took 8048 ms. Trace:
W20260928 10:44:19.273635 5992 consensus_meta.cc:287] T c1ffbf968fc7478b99ca11e307398363 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent flushing consensus metadata: real 0.529s user 0.004s sys 0.000s
I20260928 10:44:19.286737 6271 raft_consensus.cc:374] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.286859 6269 rpcz_store.cc:276] 0928 10:44:11.237776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.238329 (+ 553us) service_pool.cc:227] Handling call
0928 10:44:19.285873 (+8047544us) ts_tablet_manager.cc:1145] Deleting tablet ddd0439f5f6d4323978bb5fe2d039f75
0928 10:44:19.285884 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.285970 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8039875}
I20260928 10:44:19.287251 6271 raft_consensus.cc:729] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:19.287382 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet ddd0439f5f6d4323978bb5fe2d039f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddd0439f5f6d4323978bb5fe2d039f75 already in progress: creating tablet
I20260928 10:44:19.287767 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 868) took 8022 ms. Trace:
I20260928 10:44:19.287863 6269 rpcz_store.cc:276] 0928 10:44:11.265580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.265635 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:19.287660 (+8022025us) ts_tablet_manager.cc:1145] Deleting tablet 4a5564088c5e45788794f130134b5ba5
0928 10:44:19.287670 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.287750 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8021782}
W20260928 10:44:19.288242 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4a5564088c5e45788794f130134b5ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a5564088c5e45788794f130134b5ba5 already in progress: creating tablet
I20260928 10:44:19.288594 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 869) took 7973 ms. Trace:
I20260928 10:44:19.288686 6269 rpcz_store.cc:276] 0928 10:44:11.315023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.315142 (+ 119us) service_pool.cc:227] Handling call
0928 10:44:19.288485 (+7973343us) ts_tablet_manager.cc:1145] Deleting tablet 88f81c47745142568f7a4dd30d468220
0928 10:44:19.288494 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.288577 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7973074}
W20260928 10:44:19.289083 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 88f81c47745142568f7a4dd30d468220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88f81c47745142568f7a4dd30d468220 already in progress: creating tablet
I20260928 10:44:19.288991 6271 consensus_queue.cc:260] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.289448 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 870) took 7874 ms. Trace:
I20260928 10:44:19.289563 6269 rpcz_store.cc:276] 0928 10:44:11.414870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.414927 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:19.289355 (+7874428us) ts_tablet_manager.cc:1145] Deleting tablet b6bf7ae81883467095a04ff22fe0c7f8
0928 10:44:19.289364 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.289433 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7874251}
W20260928 10:44:19.289938 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b6bf7ae81883467095a04ff22fe0c7f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6bf7ae81883467095a04ff22fe0c7f8 already in progress: creating tablet
I20260928 10:44:19.290535 6269 tablet_replica.cc:330] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.290766 6269 raft_consensus.cc:2229] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.290958 6269 raft_consensus.cc:2258] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.292131 6271 ts_tablet_manager.cc:1428] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.354s user 0.000s sys 0.002s
I20260928 10:44:19.292869 6271 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:19.292881 6269 ts_tablet_manager.cc:1905] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.293761 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f714f8d6e0d49ab885760bf4f2aa37a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:19.293956 5884 raft_consensus.cc:2379] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:19.297547 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4082931c332f40fc9c6530190fb61017" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:19.298098 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c40696fe8645de9b639d2293f41403" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:19.298290 5884 raft_consensus.cc:2379] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:19.300761 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.301484 5817 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.304472 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet b508c7a57bf04f4c9d7293a5e8a55935
I20260928 10:44:19.305184 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01958d46e9064e34966558e06b2d3cb7" } new_table_name: "default.Table_0eaf0216af2946688678ea2816fef1d1" modify_external_catalogs: true
I20260928 10:44:19.305325 6269 ts_tablet_manager.cc:1918] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.305428 6269 log.cc:1196] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/490f8a4f1f9245cfab168b96511e18de
I20260928 10:44:19.305712 6269 ts_tablet_manager.cc:1939] T 490f8a4f1f9245cfab168b96511e18de P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.306932 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_601cf51af57b4b9d91d6e9293655f992"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.307469 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_601cf51af57b4b9d91d6e9293655f992 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.311362 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.312637 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 871) took 7890 ms. Trace:
I20260928 10:44:19.313946 6269 rpcz_store.cc:276] 0928 10:44:11.421694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.421746 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:19.290450 (+7868704us) ts_tablet_manager.cc:1145] Deleting tablet 490f8a4f1f9245cfab168b96511e18de
0928 10:44:19.290459 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.301116 (+ 10657us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.305225 (+ 4109us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.312614 (+ 7389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7868525}
I20260928 10:44:19.314435 6269 tablet_replica.cc:330] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.314620 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 490f8a4f1f9245cfab168b96511e18de (table default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]) successfully deleted
I20260928 10:44:19.315958 6269 raft_consensus.cc:2229] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.316179 6269 raft_consensus.cc:2258] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.316759 6269 ts_tablet_manager.cc:1905] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.320887 6510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a1529a7b0d7479db7dabebf471795b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1089 } } ignore_live_leader: false dest_uuid: "a2eb817eda984ab99ec4704c47699846" is_pre_election: true
I20260928 10:44:19.325088 6273 tablet_bootstrap.cc:654] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.331923 6269 ts_tablet_manager.cc:1918] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.332253 6269 log.cc:1196] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:19.332314 5712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a1529a7b0d7479db7dabebf471795b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1089 } } ignore_live_leader: false dest_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" is_pre_election: true
I20260928 10:44:19.333086 7039 leader_election.cc:302] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1529a7b0d7479db7dabebf471795b5; no voters: 0ef695111ecc46a1bc1439b0b1a282bf, a2eb817eda984ab99ec4704c47699846
I20260928 10:44:19.334523 6269 ts_tablet_manager.cc:1939] T 1f3d2c79118e44bca3540d3e3ff524a6 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.335467 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 872) took 7912 ms. Trace:
W20260928 10:44:19.340210 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a21f82b24cd4116b3d59eec934bcb1f has no consensus state
I20260928 10:44:19.340654 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e163f5999dfe49f398e5a3757fd3342c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.341228 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e163f5999dfe49f398e5a3757fd3342c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.342728 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_61f24832d418408ba2b4d047a1a17174"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.343243 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61f24832d418408ba2b4d047a1a17174 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.345268 6269 rpcz_store.cc:276] 0928 10:44:11.423156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.423206 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:19.314384 (+7891178us) ts_tablet_manager.cc:1145] Deleting tablet 1f3d2c79118e44bca3540d3e3ff524a6
0928 10:44:19.314397 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.319576 (+ 5179us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.331791 (+ 12215us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.335442 (+ 3651us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7891004}
I20260928 10:44:19.345880 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 873) took 7889 ms. Trace:
I20260928 10:44:19.345875 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1f3d2c79118e44bca3540d3e3ff524a6 (table default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]) successfully deleted
I20260928 10:44:19.346079 6269 rpcz_store.cc:276] 0928 10:44:11.456683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.456750 (+ 67us) service_pool.cc:227] Handling call
0928 10:44:19.345736 (+7888986us) ts_tablet_manager.cc:1145] Deleting tablet e9c596f9cd28453883d0299e698fba31
0928 10:44:19.345751 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.345861 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7888758}
I20260928 10:44:19.346469 6269 tablet_replica.cc:330] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.336972 7780 raft_consensus.cc:482] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:19.346590 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e9c596f9cd28453883d0299e698fba31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9c596f9cd28453883d0299e698fba31 already in progress: creating tablet
I20260928 10:44:19.346719 7780 raft_consensus.cc:504] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.347359 7780 leader_election.cc:288] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.348074 6269 raft_consensus.cc:2229] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.348309 6269 raft_consensus.cc:2258] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.349182 6269 ts_tablet_manager.cc:1905] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:19.351511 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a658dce02ff740f086774aa44aef9fb8 consensus state has no leader
I20260928 10:44:19.352476 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7822dc5c44304c04b64ea25a22ac2363"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.353188 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7822dc5c44304c04b64ea25a22ac2363 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:19.353806 5818 leader_election.cc:341] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.358608 5818 leader_election.cc:302] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:19.361109 7780 raft_consensus.cc:2726] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:19.361629 5818 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.362762 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a3968544e84b4a68934e7318ddcf78ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.363337 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3968544e84b4a68934e7318ddcf78ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.364408 7780 raft_consensus.cc:482] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.364470 5818 leader_election.cc:302] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:19.364529 7780 raft_consensus.cc:504] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.365279 7780 leader_election.cc:288] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.355643 6269 ts_tablet_manager.cc:1918] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.365571 6269 log.cc:1196] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/00b7e26971914613a2372476b348b702
I20260928 10:44:19.366019 6269 ts_tablet_manager.cc:1939] T 00b7e26971914613a2372476b348b702 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.367669 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 874) took 7507 ms. Trace:
I20260928 10:44:19.367818 6269 rpcz_store.cc:276] 0928 10:44:11.860617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.860819 (+ 202us) service_pool.cc:227] Handling call
0928 10:44:19.346424 (+7485605us) ts_tablet_manager.cc:1145] Deleting tablet 00b7e26971914613a2372476b348b702
0928 10:44:19.346435 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.352659 (+ 6224us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.355487 (+ 2828us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.367650 (+ 12163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7485400}
I20260928 10:44:19.368330 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 00b7e26971914613a2372476b348b702 (table default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]) successfully deleted
I20260928 10:44:19.368425 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 875) took 7487 ms. Trace:
I20260928 10:44:19.368492 6269 rpcz_store.cc:276] 0928 10:44:11.881144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.881204 (+ 60us) service_pool.cc:227] Handling call
0928 10:44:19.368299 (+7487095us) ts_tablet_manager.cc:1145] Deleting tablet 19f68e9f9bf44cf09fc87f102de60f28
0928 10:44:19.368310 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.368410 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7486898}
I20260928 10:44:19.368826 6269 tablet_replica.cc:330] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:19.368973 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 19f68e9f9bf44cf09fc87f102de60f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f68e9f9bf44cf09fc87f102de60f28 already in progress: creating tablet
I20260928 10:44:19.369122 6269 raft_consensus.cc:2229] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.369302 6269 raft_consensus.cc:2258] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.369514 7780 raft_consensus.cc:2726] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.370329 6269 ts_tablet_manager.cc:1905] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.371637 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a28e0e7c22924ebd924df72e2eec894a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.372164 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a28e0e7c22924ebd924df72e2eec894a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:19.369673 5818 leader_election.cc:341] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.373870 5818 leader_election.cc:302] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:19.374202 7780 raft_consensus.cc:2726] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.370398 6273 tablet_bootstrap.cc:492] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:19.374359 5818 leader_election.cc:341] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.374468 6273 ts_tablet_manager.cc:1397] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.126s user 0.013s sys 0.002s
I20260928 10:44:19.374799 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_016f3ae69c4441799d03955f4520ab88" } modify_external_catalogs: true
I20260928 10:44:19.374965 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_016f3ae69c4441799d03955f4520ab88" } modify_external_catalogs: true
I20260928 10:44:19.375121 6273 raft_consensus.cc:348] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.375300 6273 raft_consensus.cc:374] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.374521 5818 leader_election.cc:302] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:19.381464 7780 raft_consensus.cc:2726] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.382754 7780 raft_consensus.cc:482] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.382849 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d740f4b774d24747abdc1a2bbf45b43c" } modify_external_catalogs: true
I20260928 10:44:19.383010 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d740f4b774d24747abdc1a2bbf45b43c" } modify_external_catalogs: true
I20260928 10:44:19.382860 7780 raft_consensus.cc:504] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.383498 7780 leader_election.cc:288] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.384820 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2357f1366fe443be8c84b81b162dc35a" } new_table_name: "default.Table_62812cefd5b44da7a231a4e62521f052" modify_external_catalogs: true
I20260928 10:44:19.381120 6269 ts_tablet_manager.cc:1918] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.381222 6273 raft_consensus.cc:729] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.386762 6273 consensus_queue.cc:260] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.387450 6273 ts_tablet_manager.cc:1428] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260928 10:44:19.387473 7785 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:19.387744 6273 tablet_bootstrap.cc:492] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.389035 6273 tablet_bootstrap.cc:654] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.389632 7096 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" instance_seqno: 1790592234011625) as {username='slave'} at 127.5.100.67:40015; Asking this server to re-register.
I20260928 10:44:19.391324 6203 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:19.399845 7095 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" instance_seqno: 1790592233072395) as {username='slave'} at 127.5.100.65:55187; Asking this server to re-register.
I20260928 10:44:19.401168 6269 log.cc:1196] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:19.402061 7096 ts_manager.cc:194] Registered new tserver with Master: 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.402570 6269 ts_tablet_manager.cc:1939] T f95e1588a3d04142ab8d6bb257235dab P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.406399 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7e60a46790b94fb598a978cae4ef4696" } new_table_name: "default.Table_c770a8bf7bd44cc390e398afb5dde218" modify_external_catalogs: true
I20260928 10:44:19.407100 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 876) took 7492 ms. Trace:
I20260928 10:44:19.407220 6269 rpcz_store.cc:276] 0928 10:44:11.915084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:11.915384 (+ 300us) service_pool.cc:227] Handling call
0928 10:44:19.368787 (+7453403us) ts_tablet_manager.cc:1145] Deleting tablet f95e1588a3d04142ab8d6bb257235dab
0928 10:44:19.368798 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.378169 (+ 9371us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.381032 (+ 2863us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.407076 (+ 26044us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7453190}
I20260928 10:44:19.407565 6269 tablet_replica.cc:330] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:19.407694 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f95e1588a3d04142ab8d6bb257235dab (table default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]) successfully deleted
I20260928 10:44:19.407764 6269 raft_consensus.cc:2229] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.407909 6269 raft_consensus.cc:2258] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.409534 6269 ts_tablet_manager.cc:1905] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.410753 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d0ca9a65dc4a4795a42c3f368a1f1816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.411511 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0ca9a65dc4a4795a42c3f368a1f1816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.410099 5931 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:19.419204 7096 ts_manager.cc:194] Registered new tserver with Master: ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:19.434293 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cecdbd0494354e68b55b545b9a307615 has no consensus state
I20260928 10:44:19.435087 6273 tablet_bootstrap.cc:492] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.435025 7455 raft_consensus.cc:482] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.435422 6273 ts_tablet_manager.cc:1397] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.003s
I20260928 10:44:19.436149 7780 raft_consensus.cc:482] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.436270 7780 raft_consensus.cc:504] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.436219 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1581845aef95412d8c2bf5c28f4ff2cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.436784 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1581845aef95412d8c2bf5c28f4ff2cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.436856 7780 leader_election.cc:288] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.437444 6273 raft_consensus.cc:348] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.438055 6273 raft_consensus.cc:374] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.438161 6273 raft_consensus.cc:729] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:19.438548 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c67f960eb84426f9ebdfef33306a9d0 consensus state has no leader
I20260928 10:44:19.438469 6273 consensus_queue.cc:260] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.439338 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet 30fb3f88e66b4f8582fb348e035af290 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:19.298981 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.330174 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.332954 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.333611 7642 consensus_queue.cc:1035] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.333994 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.342886 7585 consensus_queue.cc:1035] T fe50a4f375244d0bbc507cc638bb2f35 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:19.343794 5957 consensus_peers.cc:487] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1072cf156cdf4c2a8c9d9764de110c6d. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:19.447866 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 104072us
I20260928 10:44:19.448654 7585 raft_consensus.cc:482] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.448817 7585 raft_consensus.cc:504] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.448966 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:19.449069 5957 consensus_peers.cc:487] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3abfedf425b84f679b22d6ca9bef718a. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.449399 7585 leader_election.cc:288] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:19.449461 5957 consensus_peers.cc:487] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 877e2d1c734a4e2891119f308f9f3ae8. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.449352 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ea1325da4e460da08377f5d6d6a055" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.449872 6271 tablet_bootstrap.cc:654] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.449878 7710 consensus_queue.cc:1035] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.450244 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.450656 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c8c53b5ae244cda8dff396935fc8e82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.414358 6270 ts_tablet_manager.cc:1918] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:19.451339 6270 log.cc:1196] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/85583238d6b54f1d89ff5b53b40e73bb
I20260928 10:44:19.451768 6270 ts_tablet_manager.cc:1939] T 85583238d6b54f1d89ff5b53b40e73bb P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:19.452772 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1031) took 2905 ms. Trace:
I20260928 10:44:19.453109 6270 rpcz_store.cc:276] 0928 10:44:16.546919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.546961 (+ 42us) service_pool.cc:227] Handling call
0928 10:44:19.279534 (+2732573us) ts_tablet_manager.cc:1145] Deleting tablet 85583238d6b54f1d89ff5b53b40e73bb
0928 10:44:19.279546 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.374850 (+ 95304us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.414227 (+ 39377us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.452719 (+ 38492us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2732437}
I20260928 10:44:19.453758 6270 tablet_replica.cc:330] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:19.454070 6270 raft_consensus.cc:2229] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:19.454512 6270 raft_consensus.cc:2258] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.455232 6270 ts_tablet_manager.cc:1905] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.458199 6273 ts_tablet_manager.cc:1428] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
W20260928 10:44:19.458160 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 177534us
I20260928 10:44:19.458597 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 85583238d6b54f1d89ff5b53b40e73bb (table default.Table_e7cdd96b23534cf9a61ec1e66e419155 [id=2ff0d03c75a046f5b76951e171ee8e38]) successfully deleted
I20260928 10:44:19.463372 7095 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" instance_seqno: 1790592233535593) as {username='slave'} at 127.5.100.66:52877; Asking this server to re-register.
I20260928 10:44:19.465634 6155 raft_consensus.cc:3037] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.467451 6273 tablet_bootstrap.cc:492] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.470852 6273 tablet_bootstrap.cc:654] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.473907 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.474326 6273 tablet_bootstrap.cc:492] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.474285 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.474463 6273 ts_tablet_manager.cc:1397] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:19.474575 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet b508c7a57bf04f4c9d7293a5e8a55935 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.474727 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c8c53b5ae244cda8dff396935fc8e82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.474947 6091 leader_election.cc:302] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:19.475142 6273 raft_consensus.cc:348] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.475335 6273 raft_consensus.cc:374] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.475389 6273 raft_consensus.cc:729] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.475277 7455 raft_consensus.cc:504] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.475574 6273 consensus_queue.cc:260] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.475823 7455 leader_election.cc:288] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.476069 6273 ts_tablet_manager.cc:1428] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260928 10:44:19.476059 7455 raft_consensus.cc:2726] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.476354 6273 tablet_bootstrap.cc:492] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.473889 6149 raft_consensus.cc:3037] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.477723 6273 tablet_bootstrap.cc:654] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:19.478538 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 127508us
W20260928 10:44:19.478907 5817 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:19.479228 5817 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:19.479496 5817 leader_election.cc:341] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.473862 6275 tablet_bootstrap.cc:492] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:19.479735 7781 raft_consensus.cc:482] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.479771 6275 ts_tablet_manager.cc:1397] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.262s user 0.004s sys 0.008s
I20260928 10:44:19.479846 7781 raft_consensus.cc:504] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.480348 7781 leader_election.cc:288] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.480443 6275 raft_consensus.cc:348] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.480615 6275 raft_consensus.cc:374] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.480660 6275 raft_consensus.cc:729] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.480834 6275 consensus_queue.cc:260] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.481328 6275 ts_tablet_manager.cc:1428] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260928 10:44:19.481554 6275 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:19.483551 6144 raft_consensus.cc:3037] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.484540 6151 raft_consensus.cc:3037] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.484917 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.485077 6273 tablet_bootstrap.cc:492] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.485183 6273 ts_tablet_manager.cc:1397] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260928 10:44:19.485316 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.485689 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ea1325da4e460da08377f5d6d6a055" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.485769 6273 raft_consensus.cc:348] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.485950 6273 raft_consensus.cc:374] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.485999 6273 raft_consensus.cc:729] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.486065 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcecdf79aafe497080e2a1f6256ef6fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.486157 6273 consensus_queue.cc:260] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:19.486315 6091 leader_election.cc:341] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 3cb9c554d363441b8006abc2d9bdd856
I20260928 10:44:19.486407 6091 leader_election.cc:302] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:19.486644 6273 ts_tablet_manager.cc:1428] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260928 10:44:19.486814 7455 raft_consensus.cc:2726] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.486876 6273 tablet_bootstrap.cc:492] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:19.487283 6091 leader_election.cc:341] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 877e2d1c734a4e2891119f308f9f3ae8
I20260928 10:44:19.487370 6091 leader_election.cc:302] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:19.487535 7455 raft_consensus.cc:2726] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:19.487533 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.488056 6273 tablet_bootstrap.cc:654] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.488040 6091 leader_election.cc:302] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:19.488229 7455 raft_consensus.cc:2726] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.488528 6091 leader_election.cc:302] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:19.488776 6154 raft_consensus.cc:3037] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.489007 7455 raft_consensus.cc:2726] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:19.489164 6069 heartbeater.cc:464] Registering TS with master...
I20260928 10:44:19.491705 6146 raft_consensus.cc:3037] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.491775 6273 tablet_bootstrap.cc:492] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.491875 6273 ts_tablet_manager.cc:1397] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
W20260928 10:44:19.492115 5817 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.492483 6273 raft_consensus.cc:348] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.492671 6273 raft_consensus.cc:374] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.492713 6273 raft_consensus.cc:729] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
W20260928 10:44:19.492690 5817 leader_election.cc:341] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.492911 6273 consensus_queue.cc:260] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:19.493058 5817 leader_election.cc:341] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:19.493078 5955 consensus_peers.cc:487] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.493381 6273 ts_tablet_manager.cc:1428] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
W20260928 10:44:19.493431 5817 leader_election.cc:341] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.493626 6273 tablet_bootstrap.cc:492] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.494954 6273 tablet_bootstrap.cc:654] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.495566 7707 consensus_queue.cc:1035] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.495894 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3abfedf425b84f679b22d6ca9bef718a" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:19.496918 5955 consensus_peers.cc:487] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.497926 6142 raft_consensus.cc:3037] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:19.498790 5955 consensus_peers.cc:487] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:19.499683 7707 consensus_queue.cc:1035] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:19.502099 5955 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.503079 6275 tablet_bootstrap.cc:654] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.503348 7782 consensus_queue.cc:1035] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.504194 7782 consensus_queue.cc:1035] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:19.506915 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96bc9de9fa5e4ef1999c61dece36c6dc" } modify_external_catalogs: true
I20260928 10:44:19.507231 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_96bc9de9fa5e4ef1999c61dece36c6dc" } modify_external_catalogs: true
I20260928 10:44:19.509675 7096 ts_manager.cc:194] Registered new tserver with Master: 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.510624 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8ed673d63eb24c21a0dbe7e30f8e7951"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.511483 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ed673d63eb24c21a0dbe7e30f8e7951 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.513397 6273 tablet_bootstrap.cc:492] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:19.513576 6273 ts_tablet_manager.cc:1397] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260928 10:44:19.514300 6273 raft_consensus.cc:348] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.514572 6273 raft_consensus.cc:374] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.514720 6273 raft_consensus.cc:729] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.514935 6273 consensus_queue.cc:260] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.515512 6273 ts_tablet_manager.cc:1428] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:19.515806 6273 tablet_bootstrap.cc:492] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:19.517508 6273 tablet_bootstrap.cc:654] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.529435 6271 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:19.529762 6271 ts_tablet_manager.cc:1397] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.237s user 0.003s sys 0.001s
I20260928 10:44:19.530781 6271 raft_consensus.cc:348] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.531126 6271 raft_consensus.cc:374] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.531255 6271 raft_consensus.cc:729] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.531662 6271 consensus_queue.cc:260] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.532387 6271 ts_tablet_manager.cc:1428] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:19.539413 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:19.539794 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 270d4148268a47e5a6a5e71651eb0b12 (table default.Table_8944b80f4d5541e190437e9bc4dcd89b [id=edb4ef9a96d34d53b907edcc030a4491]). Expected version 1 got 0
I20260928 10:44:19.539989 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:19.540349 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63 (DEFAULT_TABLE table=default.Table_a3462af0b92048c4be77613275780644 [id=39645aecd43447018b0cd41a999bdc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.540723 5694 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_d650a78055d649f1b107e9bd8789967c [id=6bef1aebacdc4a03b212adda83e80f1e] alter complete (version 1)
I20260928 10:44:19.540910 5700 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e [id=0334f9b1aea343a2b20a0b0aa513d18e] alter complete (version 1)
I20260928 10:44:19.541179 6271 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:19.541627 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 15f3f3bff84a416494431a19887bb88d
W20260928 10:44:19.542819 5694 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 163) took 783 ms (client timeout 1000 ms). Trace:
W20260928 10:44:19.542910 5694 rpcz_store.cc:269] 0928 10:44:18.759321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.812413 (+ 53092us) service_pool.cc:227] Handling call
0928 10:44:18.932938 (+120525us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:19.542795 (+609857us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:19.057154 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:19.057293 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:19.057300 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:19.057303 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:19.057584 (+ 281us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:19.057599 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:19.057605 (+ 6us) tablet.cc:683] Acquiring locks for 5 operations
0928 10:44:19.057787 (+ 182us) tablet.cc:699] Row locks acquired
0928 10:44:19.057790 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:19.057840 (+ 50us) write_op.cc:270] Start()
0928 10:44:19.057884 (+ 44us) write_op.cc:276] Timestamp: P: 1790592259057805 usec, L: 0
0928 10:44:19.057888 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:19.058129 (+ 241us) log.cc:842] Serialized 2039 byte log entry
0928 10:44:19.091045 (+ 32916us) op_driver.cc:444] REPLICATION: finished
0928 10:44:19.094231 (+ 3186us) write_op.cc:301] APPLY: starting
0928 10:44:19.094246 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:19.094319 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:19.094344 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:19.094445 (+ 101us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:19.094509 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 10:44:19.094517 (+ 8us) write_op.cc:312] APPLY: finished
0928 10:44:19.094598 (+ 81us) log.cc:842] Serialized 47 byte log entry
0928 10:44:19.094658 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:19.094682 (+ 24us) write_op.cc:454] Released schema lock
0928 10:44:19.094689 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:19.094737 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:19.094741 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 10:44:19.105925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:19.106124 (+ 199us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:19.106131 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:19.106133 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:19.106232 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:19.106243 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:19.106248 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:19.106304 (+ 56us) tablet.cc:699] Row locks acquired
0928 10:44:19.106306 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:19.106339 (+ 33us) write_op.cc:270] Start()
0928 10:44:19.106374 (+ 35us) write_op.cc:276] Timestamp: P: 1790592259106302 usec, L: 0
0928 10:44:19.106377 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:19.109231 (+ 2854us) log.cc:842] Serialized 356 byte log entry
0928 10:44:19.136547 (+ 27316us) op_driver.cc:444] REPLICATION: finished
0928 10:44:19.139257 (+ 2710us) write_op.cc:301] APPLY: starting
0928 10:44:19.139265 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:19.139287 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:19.139305 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:19.139331 (+ 26us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:19.139352 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:19.139358 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:19.139394 (+ 36us) log.cc:842] Serialized 23 byte log entry
0928 10:44:19.139421 (+ 27us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:19.139432 (+ 11us) write_op.cc:454] Released schema lock
0928 10:44:19.139437 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:19.139474 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:19.139477 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"spinlock_wait_cycles":274958592,"child_traces":[["op",{"apply.queue_time_us":3130,"apply.run_cpu_time_us":563,"apply.run_wall_time_us":563,"num_ops":5,"prepare.queue_time_us":90917,"prepare.run_cpu_time_us":1015,"prepare.run_wall_time_us":1065,"replication_time_us":33133}],["op",{"apply.queue_time_us":2688,"apply.run_cpu_time_us":251,"apply.run_wall_time_us":250,"num_ops":1,"prepare.queue_time_us":5573,"prepare.run_cpu_time_us":840,"prepare.run_wall_time_us":3378,"replication_time_us":30160}]]}
I20260928 10:44:19.543705 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63 (DEFAULT_TABLE table=default.Table_a3462af0b92048c4be77613275780644 [id=39645aecd43447018b0cd41a999bdc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.544150 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.544327 6122 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.544505 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.544620 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f3f3bff84a416494431a19887bb88d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.546124 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f3f3bff84a416494431a19887bb88d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.546996 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f3f3bff84a416494431a19887bb88d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.547235 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.549629 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.549832 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.550444 7455 raft_consensus.cc:482] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.550609 7455 raft_consensus.cc:504] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.551170 7455 leader_election.cc:288] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.551667 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:19.552372 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f32fe38bfa5b45aab2858e07e4f14d8f" } new_table_name: "default.Table_34118ad16a7846aaa3403d4968760e25" modify_external_catalogs: true
I20260928 10:44:19.554109 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fb9482e4d3084f1291a9d2623996afdc" } new_table_name: "default.Table_ac3382f500e2403598a7004fd31acc46" modify_external_catalogs: true
I20260928 10:44:19.554143 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_bde62a266c834c28b2fdb923a4b93269"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.554647 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bde62a266c834c28b2fdb923a4b93269 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.563766 7557 ts_tablet_manager.cc:1939] T c5c1a1c5e22e455d91de92f0aa3535c7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:19.564178 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1077) took 1491 ms. Trace:
I20260928 10:44:19.564276 7557 rpcz_store.cc:276] 0928 10:44:18.072795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.072862 (+ 67us) service_pool.cc:227] Handling call
0928 10:44:19.176674 (+1103812us) ts_tablet_manager.cc:1145] Deleting tablet c5c1a1c5e22e455d91de92f0aa3535c7
0928 10:44:19.176684 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.181343 (+ 4659us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.185729 (+ 4386us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.564158 (+378429us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1103621}
I20260928 10:44:19.564826 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c5c1a1c5e22e455d91de92f0aa3535c7 (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
W20260928 10:44:19.565063 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b5dd8a3bbafa45549b88bfebbf3e8410 (table default.Table_4b496883c4594670b22467780b843420 [id=cfa304b7424546eea3029b06b3c640d7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b5dd8a3bbafa45549b88bfebbf3e8410 consensus state has no leader
I20260928 10:44:19.566321 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5b4e3c0c3dcd4fb3a0266851331247f2" } new_table_name: "default.Table_5520eeec07d7476c9bb1963d690e1c97" modify_external_catalogs: true
I20260928 10:44:19.575349 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a9bd4910ac124e6b935806ea96522396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.576030 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9bd4910ac124e6b935806ea96522396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.579979 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b
I20260928 10:44:19.580036 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 581f97bde63a48f0815b61e678890438
I20260928 10:44:19.581228 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet 581f97bde63a48f0815b61e678890438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.581277 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a61f862ae0da4763802ca3b28d5e2756
I20260928 10:44:19.582151 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 581f97bde63a48f0815b61e678890438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.582226 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet a61f862ae0da4763802ca3b28d5e2756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.582351 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.582551 6133 tablet_service.cc:1514] Processing DeleteTablet for tablet a61f862ae0da4763802ca3b28d5e2756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.583272 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet f4e984fec74147a8af24c4cf9dfa3284
I20260928 10:44:19.583583 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.584419 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.585294 7707 raft_consensus.cc:482] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.585456 7707 raft_consensus.cc:504] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.585731 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:19.586038 7707 leader_election.cc:288] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:19.586694 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb945bc6b99a44e0932b2a94f05db6c2 consensus state has no leader
I20260928 10:44:19.586767 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fe7d2b13a5074e87af92cd2b06b01287"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:19.587096 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet a61f862ae0da4763802ca3b28d5e2756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.587234 5698 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_0796215bba1f4ecc85937aef3b01bee7 [id=07eac26ccf134fb5b9bcc53ba57eb067] alter complete (version 1)
I20260928 10:44:19.587287 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet f4e984fec74147a8af24c4cf9dfa3284 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:19.587316 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe7d2b13a5074e87af92cd2b06b01287 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.588409 6000 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.588685 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 581f97bde63a48f0815b61e678890438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:19.588919 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a340eaeaa91547afa89425880f7ef1ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:19.589385 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:19.589422 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a340eaeaa91547afa89425880f7ef1ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.589547 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet c780d8c23a764f769848fa04550ceff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.589666 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c0af95fa58451490947176ec9301e3 with delete_type TABLET_DATA_DELETED (replaced by tablet b5be4edbfc11495b972a8ca68be46d38) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.589767 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.590137 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 877e2d1c734a4e2891119f308f9f3ae8 with delete_type TABLET_DATA_DELETED (replaced by tablet b254b5f8163d45cc8e1beb77d6ac4a65) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.590273 5850 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.590374 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c8c53b5ae244cda8dff396935fc8e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:19.590662 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:19.591135 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98bb42384222467eae73bb886043459a consensus state has no leader
I20260928 10:44:19.591110 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9781a630f3be483f9e3bbb3f79d5ba96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.591604 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9781a630f3be483f9e3bbb3f79d5ba96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.594969 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.596468 5955 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.608044 7782 raft_consensus.cc:482] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.608294 7782 raft_consensus.cc:504] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.608980 7782 leader_election.cc:288] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:19.610397 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63 (DEFAULT_TABLE table=default.Table_a3462af0b92048c4be77613275780644 [id=39645aecd43447018b0cd41a999bdc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.610716 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c8fd748c21af4b64bb491c536e5322ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:19.610913 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:19.611284 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8fd748c21af4b64bb491c536e5322ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.612156 5850 tablet_service.cc:1467] Processing CreateTablet for tablet cecdbd0494354e68b55b545b9a307615 (DEFAULT_TABLE table=default.Table_c770a8bf7bd44cc390e398afb5dde218 [id=ba1cae36765d45b5b6b5d109629ee88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.612541 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cecdbd0494354e68b55b545b9a307615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.613405 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7917f71e8bad497482a52f085eb60b7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:19.613868 5983 tablet_service.cc:1467] Processing CreateTablet for tablet cecdbd0494354e68b55b545b9a307615 (DEFAULT_TABLE table=default.Table_c770a8bf7bd44cc390e398afb5dde218 [id=ba1cae36765d45b5b6b5d109629ee88c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:19.614071 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7917f71e8bad497482a52f085eb60b7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.615780 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd65a860b00d4a7ba8ae92dde5818212" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.618947 5955 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.619174 6271 tablet_bootstrap.cc:654] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.619822 6128 tablet_service.cc:1467] Processing CreateTablet for tablet cecdbd0494354e68b55b545b9a307615 (DEFAULT_TABLE table=default.Table_c770a8bf7bd44cc390e398afb5dde218 [id=ba1cae36765d45b5b6b5d109629ee88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.620353 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cecdbd0494354e68b55b545b9a307615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.621640 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 173abe58eb7a46acb5d9539d521ca2fa (DEFAULT_TABLE table=default.Table_499f33aa4f674f90aa166f95140d0219 [id=a129bb4844df4d689580836ae586469f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.622025 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173abe58eb7a46acb5d9539d521ca2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.622332 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 173abe58eb7a46acb5d9539d521ca2fa (DEFAULT_TABLE table=default.Table_499f33aa4f674f90aa166f95140d0219 [id=a129bb4844df4d689580836ae586469f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.624574 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 (DEFAULT_TABLE table=default.Table_60ab33f1717f464f874105a5289f8a41 [id=fde74869f867431ca0d0c73cd9bf0ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.627242 6124 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 (DEFAULT_TABLE table=default.Table_60ab33f1717f464f874105a5289f8a41 [id=fde74869f867431ca0d0c73cd9bf0ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.627650 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2c0fdd8ee43d6a7b47b01583332c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:19.629881 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51d3d85454204faca17e5de63d330330 consensus state has no leader
I20260928 10:44:19.635952 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6a85a780a1a941daa29448ce00f5231f" } new_table_name: "default.Table_cf31e923002b44849bfcebd783af9be4" modify_external_catalogs: true
I20260928 10:44:19.637694 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 173abe58eb7a46acb5d9539d521ca2fa (DEFAULT_TABLE table=default.Table_499f33aa4f674f90aa166f95140d0219 [id=a129bb4844df4d689580836ae586469f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.638293 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173abe58eb7a46acb5d9539d521ca2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.640403 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_401439ae18274d0b922ac1bb235ee300" } new_table_name: "default.Table_0cb5f3cda89b4570a6d88355781a45db" modify_external_catalogs: true
I20260928 10:44:19.648552 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_37ef5e4706fa4906985ebd6d4b2396c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.649228 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37ef5e4706fa4906985ebd6d4b2396c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.651696 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_343bbafe328a46faafe00161524633ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.654305 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_343bbafe328a46faafe00161524633ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.655130 6154 raft_consensus.cc:3037] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:19.661875 7707 raft_consensus.cc:482] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.662061 7707 raft_consensus.cc:504] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.662703 7707 leader_election.cc:288] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:19.663857 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.670233 5955 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.675935 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 (DEFAULT_TABLE table=default.Table_60ab33f1717f464f874105a5289f8a41 [id=fde74869f867431ca0d0c73cd9bf0ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.676522 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2c0fdd8ee43d6a7b47b01583332c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.683360 7780 raft_consensus.cc:482] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.683501 7780 raft_consensus.cc:504] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.684028 7780 leader_election.cc:288] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.685441 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c30726853549dfbc57f65fd31603fa" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:19.686080 5817 leader_election.cc:341] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.687976 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 1e657c277a274d998564e3423512cda3 (DEFAULT_TABLE table=default.Table_00006401c21343899754201dd8e65597 [id=7fdcdb70ddbc4b50bf2e17f2769ed552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.688153 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 1e657c277a274d998564e3423512cda3 (DEFAULT_TABLE table=default.Table_00006401c21343899754201dd8e65597 [id=7fdcdb70ddbc4b50bf2e17f2769ed552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.688488 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e657c277a274d998564e3423512cda3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.693087 6124 tablet_service.cc:1467] Processing CreateTablet for tablet b5dd8a3bbafa45549b88bfebbf3e8410 (DEFAULT_TABLE table=default.Table_4b496883c4594670b22467780b843420 [id=cfa304b7424546eea3029b06b3c640d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.693585 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5dd8a3bbafa45549b88bfebbf3e8410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.693631 5991 tablet_service.cc:1467] Processing CreateTablet for tablet b5dd8a3bbafa45549b88bfebbf3e8410 (DEFAULT_TABLE table=default.Table_4b496883c4594670b22467780b843420 [id=cfa304b7424546eea3029b06b3c640d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.694207 5861 tablet_service.cc:1467] Processing CreateTablet for tablet b5dd8a3bbafa45549b88bfebbf3e8410 (DEFAULT_TABLE table=default.Table_4b496883c4594670b22467780b843420 [id=cfa304b7424546eea3029b06b3c640d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.694626 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5dd8a3bbafa45549b88bfebbf3e8410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.695461 5997 tablet_service.cc:1467] Processing CreateTablet for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705 (DEFAULT_TABLE table=default.Table_23b2d43e3e86401b9c5c9a3d7b6dfc5b [id=939db7d71cd84f8ca04310dc02b323cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.698848 6122 tablet_service.cc:1467] Processing CreateTablet for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705 (DEFAULT_TABLE table=default.Table_23b2d43e3e86401b9c5c9a3d7b6dfc5b [id=939db7d71cd84f8ca04310dc02b323cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.699280 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.699391 7819 tablet.cc:1722] T 9bd09430a2c34965a590f2e0852c686b P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:19.700256 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1081) took 1579 ms. Trace:
I20260928 10:44:19.700363 7557 rpcz_store.cc:276] 0928 10:44:18.120821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.120879 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:19.700075 (+1579196us) ts_tablet_manager.cc:1145] Deleting tablet 98689ee648a84666a783aef0d4601fc2
0928 10:44:19.700089 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.700234 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578968}
W20260928 10:44:19.700959 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 98689ee648a84666a783aef0d4601fc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98689ee648a84666a783aef0d4601fc2 already in progress: creating tablet
I20260928 10:44:19.701689 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 1e657c277a274d998564e3423512cda3 (DEFAULT_TABLE table=default.Table_00006401c21343899754201dd8e65597 [id=7fdcdb70ddbc4b50bf2e17f2769ed552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.702113 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e657c277a274d998564e3423512cda3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.703394 6271 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:19.703565 6271 ts_tablet_manager.cc:1397] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.162s user 0.002s sys 0.002s
I20260928 10:44:19.704723 6271 raft_consensus.cc:348] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.705044 6271 raft_consensus.cc:374] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.705601 6271 raft_consensus.cc:729] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.705869 6271 consensus_queue.cc:260] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.708017 6271 ts_tablet_manager.cc:1428] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 10:44:19.708238 5854 tablet_service.cc:1467] Processing CreateTablet for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705 (DEFAULT_TABLE table=default.Table_23b2d43e3e86401b9c5c9a3d7b6dfc5b [id=939db7d71cd84f8ca04310dc02b323cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.708372 6271 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:19.708724 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.709601 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1082) took 1520 ms. Trace:
I20260928 10:44:19.709700 7557 rpcz_store.cc:276] 0928 10:44:18.188711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.190558 (+ 1847us) service_pool.cc:227] Handling call
0928 10:44:19.709453 (+1518895us) ts_tablet_manager.cc:1145] Deleting tablet 47cd73e527d04194a7ca8c24a7134e09
0928 10:44:19.709465 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.709578 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1518659}
W20260928 10:44:19.710172 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 47cd73e527d04194a7ca8c24a7134e09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47cd73e527d04194a7ca8c24a7134e09 already in progress: creating tablet
I20260928 10:44:19.716460 7557 tablet_replica.cc:330] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:19.716719 7557 raft_consensus.cc:2229] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:19.716892 7557 raft_consensus.cc:2258] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:19.718732 5998 tablet_service.cc:1467] Processing CreateTablet for tablet c7f5420ddfa04f57bba2335b60bbb6d5 (DEFAULT_TABLE table=default.Table_07d6b2189b69472bb92c8da35bca6bf6 [id=981b5d9133914b6a861b1b8b888bc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.719450 6271 tablet_bootstrap.cc:654] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.719758 6122 tablet_service.cc:1467] Processing CreateTablet for tablet c7f5420ddfa04f57bba2335b60bbb6d5 (DEFAULT_TABLE table=default.Table_07d6b2189b69472bb92c8da35bca6bf6 [id=981b5d9133914b6a861b1b8b888bc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.720788 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f5420ddfa04f57bba2335b60bbb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.720942 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 2a21f82b24cd4116b3d59eec934bcb1f (DEFAULT_TABLE table=default.Table_eb723503bf41424387d94fbbb18bca56 [id=98b8189cb5894b85a54034cc6ee175e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.721252 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a21f82b24cd4116b3d59eec934bcb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.722239 7557 ts_tablet_manager.cc:1905] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:19.722271 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 2a21f82b24cd4116b3d59eec934bcb1f (DEFAULT_TABLE table=default.Table_eb723503bf41424387d94fbbb18bca56 [id=98b8189cb5894b85a54034cc6ee175e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.723080 5861 tablet_service.cc:1467] Processing CreateTablet for tablet c7f5420ddfa04f57bba2335b60bbb6d5 (DEFAULT_TABLE table=default.Table_07d6b2189b69472bb92c8da35bca6bf6 [id=981b5d9133914b6a861b1b8b888bc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.723519 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f5420ddfa04f57bba2335b60bbb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.726769 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 2a21f82b24cd4116b3d59eec934bcb1f (DEFAULT_TABLE table=default.Table_eb723503bf41424387d94fbbb18bca56 [id=98b8189cb5894b85a54034cc6ee175e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.727370 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a21f82b24cd4116b3d59eec934bcb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.728931 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 (DEFAULT_TABLE table=default.Table_571da65303104a1180f4d7f67a75ebbb [id=dafcbc21884e4f5ba315e6d5341160ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.733479 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3996233a7147148a5bb0b35fcdfc14 (DEFAULT_TABLE table=default.Table_cb93faf059524456a24a4639b828da64 [id=7b816b40b43d496f9e41039c88e27a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.733705 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 (DEFAULT_TABLE table=default.Table_571da65303104a1180f4d7f67a75ebbb [id=dafcbc21884e4f5ba315e6d5341160ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.733978 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3996233a7147148a5bb0b35fcdfc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.734138 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fd004a4f724ae5bb285af67218d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.740099 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3996233a7147148a5bb0b35fcdfc14 (DEFAULT_TABLE table=default.Table_cb93faf059524456a24a4639b828da64 [id=7b816b40b43d496f9e41039c88e27a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.740886 6131 tablet_service.cc:1467] Processing CreateTablet for tablet dc24f846ad71418195657ff37dbe418e (DEFAULT_TABLE table=default.Table_7ec18e8771694dd49b866b3da97e6386 [id=f4439cdc40354b2385ba6fe92e3273bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.741307 6131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc24f846ad71418195657ff37dbe418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.741415 7680 raft_consensus.cc:482] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dab87557ec9445dbe35ea05e3561a94)
I20260928 10:44:19.741454 5989 tablet_service.cc:1467] Processing CreateTablet for tablet dc24f846ad71418195657ff37dbe418e (DEFAULT_TABLE table=default.Table_7ec18e8771694dd49b866b3da97e6386 [id=f4439cdc40354b2385ba6fe92e3273bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.741601 7680 raft_consensus.cc:504] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:19.742245 7680 leader_election.cc:288] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:19.742262 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 2c3996233a7147148a5bb0b35fcdfc14 (DEFAULT_TABLE table=default.Table_cb93faf059524456a24a4639b828da64 [id=7b816b40b43d496f9e41039c88e27a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.742761 5851 tablet_service.cc:1467] Processing CreateTablet for tablet dc24f846ad71418195657ff37dbe418e (DEFAULT_TABLE table=default.Table_7ec18e8771694dd49b866b3da97e6386 [id=f4439cdc40354b2385ba6fe92e3273bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.742852 5986 tablet_service.cc:1467] Processing CreateTablet for tablet dcb9e303d28d4104a71d30746cce103e (DEFAULT_TABLE table=default.Table_8eb39b2da4e442bf82b9a70b87175b11 [id=e73a861370f34a8a907d2f4b00928047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.743110 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc24f846ad71418195657ff37dbe418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.744081 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ddb5219dc9654884a3cb905f60474969" } modify_external_catalogs: true
I20260928 10:44:19.744298 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ddb5219dc9654884a3cb905f60474969" } modify_external_catalogs: true
W20260928 10:44:19.744843 5955 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: 67f29acce3604e458d1981aad87f2eb9
I20260928 10:44:19.746748 5985 tablet_service.cc:1467] Processing CreateTablet for tablet e26894e5be1b4bc19453c55f06beeaaf (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.746907 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3996233a7147148a5bb0b35fcdfc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.747048 5859 tablet_service.cc:1467] Processing CreateTablet for tablet e26894e5be1b4bc19453c55f06beeaaf (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.747330 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26894e5be1b4bc19453c55f06beeaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.749972 5987 tablet_service.cc:1467] Processing CreateTablet for tablet c5a49133468840e6b7bed0126dd2182f (DEFAULT_TABLE table=default.Table_4d02fe9f7eae47fbbe27a15a2e408dec [id=64c5bcbc40664ec4b8145d4b9740474a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.750856 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 (DEFAULT_TABLE table=default.Table_571da65303104a1180f4d7f67a75ebbb [id=dafcbc21884e4f5ba315e6d5341160ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.751240 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fd004a4f724ae5bb285af67218d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.751504 5848 tablet_service.cc:1467] Processing CreateTablet for tablet c5a49133468840e6b7bed0126dd2182f (DEFAULT_TABLE table=default.Table_4d02fe9f7eae47fbbe27a15a2e408dec [id=64c5bcbc40664ec4b8145d4b9740474a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.751809 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5a49133468840e6b7bed0126dd2182f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.756899 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7aeda95dfe514ed09635b9e5db9389af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:19.757617 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7aeda95dfe514ed09635b9e5db9389af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:19.759487 5856 tablet_service.cc:1467] Processing CreateTablet for tablet dcb9e303d28d4104a71d30746cce103e (DEFAULT_TABLE table=default.Table_8eb39b2da4e442bf82b9a70b87175b11 [id=e73a861370f34a8a907d2f4b00928047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.759881 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb9e303d28d4104a71d30746cce103e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.765056 7780 raft_consensus.cc:482] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.765223 7780 raft_consensus.cc:504] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.765866 7780 leader_election.cc:288] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.766623 6121 tablet_service.cc:1467] Processing CreateTablet for tablet dcb9e303d28d4104a71d30746cce103e (DEFAULT_TABLE table=default.Table_8eb39b2da4e442bf82b9a70b87175b11 [id=e73a861370f34a8a907d2f4b00928047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.767084 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb9e303d28d4104a71d30746cce103e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.768203 6117 tablet_service.cc:1467] Processing CreateTablet for tablet a35ae7465e8b4ab0bd9c61127e56f32a (DEFAULT_TABLE table=default.Table_5458bf89cc6e49729a30125ff6a5f1bc [id=60858bd44b024482992e6813c83b2aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.768553 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a35ae7465e8b4ab0bd9c61127e56f32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.768198 6130 tablet_service.cc:1467] Processing CreateTablet for tablet c5a49133468840e6b7bed0126dd2182f (DEFAULT_TABLE table=default.Table_4d02fe9f7eae47fbbe27a15a2e408dec [id=64c5bcbc40664ec4b8145d4b9740474a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.771220 5984 tablet_service.cc:1467] Processing CreateTablet for tablet a35ae7465e8b4ab0bd9c61127e56f32a (DEFAULT_TABLE table=default.Table_5458bf89cc6e49729a30125ff6a5f1bc [id=60858bd44b024482992e6813c83b2aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.771919 6271 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:19.772090 6271 ts_tablet_manager.cc:1397] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20260928 10:44:19.772836 6271 raft_consensus.cc:348] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.773119 6271 raft_consensus.cc:374] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.773203 6271 raft_consensus.cc:729] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.773438 6271 consensus_queue.cc:260] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.774260 6271 ts_tablet_manager.cc:1428] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:19.776544 5851 tablet_service.cc:1467] Processing CreateTablet for tablet a35ae7465e8b4ab0bd9c61127e56f32a (DEFAULT_TABLE table=default.Table_5458bf89cc6e49729a30125ff6a5f1bc [id=60858bd44b024482992e6813c83b2aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.777034 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a35ae7465e8b4ab0bd9c61127e56f32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.781474 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5a49133468840e6b7bed0126dd2182f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.766625 6156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:19.782636 6132 tablet_service.cc:1467] Processing CreateTablet for tablet e26894e5be1b4bc19453c55f06beeaaf (DEFAULT_TABLE table=default.Table_c3fe3454521a4e2a883b0de7f7c22f85 [id=cb213c06567b4c5cadcc277f5b45296e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:19.782771 5817 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:19.782995 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26894e5be1b4bc19453c55f06beeaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.784552 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cc3ed363602c40ac9aaaba04d960f861" } modify_external_catalogs: true
I20260928 10:44:19.784742 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cc3ed363602c40ac9aaaba04d960f861" } modify_external_catalogs: true
I20260928 10:44:19.786053 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_87f60777a09c47299a48851d4774c1c0" } modify_external_catalogs: true
I20260928 10:44:19.786211 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_87f60777a09c47299a48851d4774c1c0" } modify_external_catalogs: true
I20260928 10:44:19.788617 5850 tablet_service.cc:1467] Processing CreateTablet for tablet e12cb66fdad747ba94d90bb1be2e7e0d (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.789490 6271 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:19.791283 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e12cb66fdad747ba94d90bb1be2e7e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.794453 5994 tablet_service.cc:1467] Processing CreateTablet for tablet e12cb66fdad747ba94d90bb1be2e7e0d (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.798795 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 (DEFAULT_TABLE table=default.Table_aed3c43316044362b92d3639149bff4b [id=b5c7f405002f46e1a2308966192ef88a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.799589 6271 tablet_bootstrap.cc:654] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.802119 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 (DEFAULT_TABLE table=default.Table_aed3c43316044362b92d3639149bff4b [id=b5c7f405002f46e1a2308966192ef88a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.802594 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcced40ef4f4cedb8542c1189b5cd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.802654 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 (DEFAULT_TABLE table=default.Table_aed3c43316044362b92d3639149bff4b [id=b5c7f405002f46e1a2308966192ef88a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.803050 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcced40ef4f4cedb8542c1189b5cd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.803836 6134 tablet_service.cc:1467] Processing CreateTablet for tablet e12cb66fdad747ba94d90bb1be2e7e0d (DEFAULT_TABLE table=default.Table_92f37c565b2747c09867652241d7ec6f [id=a5537a197902494b90265b5d946fc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.804242 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e12cb66fdad747ba94d90bb1be2e7e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.805423 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 4615e56288cf44a09212862a72d83f16 (DEFAULT_TABLE table=default.Table_1695a629b60c48909bb7938c1976d80f [id=c149f66454aa47f18d4243f02e94d6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.805411 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 4615e56288cf44a09212862a72d83f16 (DEFAULT_TABLE table=default.Table_1695a629b60c48909bb7938c1976d80f [id=c149f66454aa47f18d4243f02e94d6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.805749 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615e56288cf44a09212862a72d83f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.809669 7557 ts_tablet_manager.cc:1918] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.809872 7557 log.cc:1196] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/3cb9c554d363441b8006abc2d9bdd856
I20260928 10:44:19.810256 7557 ts_tablet_manager.cc:1939] T 3cb9c554d363441b8006abc2d9bdd856 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:19.811730 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 4615e56288cf44a09212862a72d83f16 (DEFAULT_TABLE table=default.Table_1695a629b60c48909bb7938c1976d80f [id=c149f66454aa47f18d4243f02e94d6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.812182 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615e56288cf44a09212862a72d83f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.821331 6269 ts_tablet_manager.cc:1918] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:19.821723 6269 log.cc:1196] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/25a2f20766024978a16b6bccd366a848
I20260928 10:44:19.822089 6269 ts_tablet_manager.cc:1939] T 25a2f20766024978a16b6bccd366a848 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:19.823100 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 888) took 7775 ms. Trace:
I20260928 10:44:19.823279 6269 rpcz_store.cc:276] 0928 10:44:12.047177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.058568 (+ 11391us) service_pool.cc:227] Handling call
0928 10:44:19.407507 (+7348939us) ts_tablet_manager.cc:1145] Deleting tablet 25a2f20766024978a16b6bccd366a848
0928 10:44:19.407519 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.413486 (+ 5967us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.821222 (+407736us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.823074 (+ 1852us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7348418}
I20260928 10:44:19.823977 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 25a2f20766024978a16b6bccd366a848 (table default.Table_0c283584d125415e848f4d61a2838a78 [id=2ce72178b0904798a75a6e756700bd26]) successfully deleted
I20260928 10:44:19.824301 6271 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:19.824491 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 887) took 7777 ms. Trace:
I20260928 10:44:19.824687 6269 rpcz_store.cc:276] 0928 10:44:12.047039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.058870 (+ 11831us) service_pool.cc:227] Handling call
0928 10:44:19.824342 (+7765472us) ts_tablet_manager.cc:1145] Deleting tablet 29b6d18cf0304edc8b3ca1d4d106decb
0928 10:44:19.824355 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.824471 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7764348}
W20260928 10:44:19.825150 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 29b6d18cf0304edc8b3ca1d4d106decb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b6d18cf0304edc8b3ca1d4d106decb already in progress: creating tablet
I20260928 10:44:19.825522 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 890) took 7736 ms. Trace:
I20260928 10:44:19.825599 6269 rpcz_store.cc:276] 0928 10:44:12.088890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.096426 (+ 7536us) service_pool.cc:227] Handling call
0928 10:44:19.825406 (+7728980us) ts_tablet_manager.cc:1145] Deleting tablet 46490066d50847ceb2362e35dce84f31
0928 10:44:19.825418 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.825506 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7728808}
W20260928 10:44:19.825981 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 46490066d50847ceb2362e35dce84f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46490066d50847ceb2362e35dce84f31 already in progress: creating tablet
I20260928 10:44:19.829089 6271 ts_tablet_manager.cc:1397] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260928 10:44:19.825049 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 18269ece430f46cba7e926b579ac33a1 (DEFAULT_TABLE table=default.Table_cb3b44ccee5a4a09af9172ca455c5b05 [id=67ad2648f0ce4cfc907655278f13c146]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.835655 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cb3b44ccee5a4a09af9172ca455c5b05" } modify_external_catalogs: true
I20260928 10:44:19.835911 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_cb3b44ccee5a4a09af9172ca455c5b05" } modify_external_catalogs: true
I20260928 10:44:19.837312 6271 raft_consensus.cc:348] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.837560 6271 raft_consensus.cc:374] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:19.837639 6271 raft_consensus.cc:729] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:19.837884 6271 consensus_queue.cc:260] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.838456 6271 ts_tablet_manager.cc:1428] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20260928 10:44:19.849833 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 18269ece430f46cba7e926b579ac33a1 (DEFAULT_TABLE table=default.Table_cb3b44ccee5a4a09af9172ca455c5b05 [id=67ad2648f0ce4cfc907655278f13c146]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.850399 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18269ece430f46cba7e926b579ac33a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.852721 7780 raft_consensus.cc:482] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f6ffbf4f0534383bf89d15aa37e3027)
I20260928 10:44:19.852906 7780 raft_consensus.cc:504] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.853596 7780 leader_election.cc:288] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:19.854772 5817 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:19.857861 5856 tablet_service.cc:1467] Processing CreateTablet for tablet a14fc8a96eac4202832c7a1e00246e7f (DEFAULT_TABLE table=default.Table_751cb522af9d4e9eae2571a2a05cf29f [id=4f26b00c29b0447c8fe01e7994ec68ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.858345 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14fc8a96eac4202832c7a1e00246e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.863808 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9d875157004a42ab49d40fda8379b0 (DEFAULT_TABLE table=default.Table_62778da60fec4dd4beeada7adc219568 [id=3fefb59cd8c544ddaae21cd3bbe81b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.863859 6120 tablet_service.cc:1467] Processing CreateTablet for tablet a14fc8a96eac4202832c7a1e00246e7f (DEFAULT_TABLE table=default.Table_751cb522af9d4e9eae2571a2a05cf29f [id=4f26b00c29b0447c8fe01e7994ec68ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.864220 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9d875157004a42ab49d40fda8379b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.874866 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9d875157004a42ab49d40fda8379b0 (DEFAULT_TABLE table=default.Table_62778da60fec4dd4beeada7adc219568 [id=3fefb59cd8c544ddaae21cd3bbe81b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.875322 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9d875157004a42ab49d40fda8379b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.878908 6271 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:19.880638 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 12fb38b8f81c4a269d775a1efa360ccd (DEFAULT_TABLE table=default.Table_582bec7fc1de458b9f8615e82e51928b [id=43830bc9d61746a6b82ded66ebb21b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.880995 6271 tablet_bootstrap.cc:654] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:19.881106 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12fb38b8f81c4a269d775a1efa360ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.881285 5848 tablet_service.cc:1467] Processing CreateTablet for tablet fb56456769a24d2ca228dd29ffed6748 (DEFAULT_TABLE table=default.Table_de8ffe56d2154e0c8ca4b46066aa0335 [id=84302c85a524470e8ba6abeb35f6b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.882427 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb56456769a24d2ca228dd29ffed6748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.883289 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 7e2cdf05d17f42e1864e02135d9b68d4 (DEFAULT_TABLE table=default.Table_d915567a3c924688b3ef70bf6ec31435 [id=b03c3ee559764d5b95619f6cb904ac45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.884300 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e2cdf05d17f42e1864e02135d9b68d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.891634 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c (DEFAULT_TABLE table=default.Table_76c6f9abd0af4d5ab3daa5d92b3db883 [id=dbc7e6d6878a4ab5aad905178c97d565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.892732 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.903910 7780 raft_consensus.cc:482] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.904091 7780 raft_consensus.cc:504] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:19.904744 7780 leader_election.cc:288] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:19.909636 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3ef54cf1bb4b2bb1fd25120b710c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.909888 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcced40ef4f4cedb8542c1189b5cd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.910305 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e657c277a274d998564e3423512cda3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.910578 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18269ece430f46cba7e926b579ac33a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.910854 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a21f82b24cd4116b3d59eec934bcb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.911046 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4615e56288cf44a09212862a72d83f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.911288 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26894e5be1b4bc19453c55f06beeaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.914269 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e12cb66fdad747ba94d90bb1be2e7e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.915776 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcb9e303d28d4104a71d30746cce103e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.917119 7780 raft_consensus.cc:482] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f6ffbf4f0534383bf89d15aa37e3027)
I20260928 10:44:19.917268 7780 raft_consensus.cc:504] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.917862 7780 leader_election.cc:288] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:19.918637 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f5420ddfa04f57bba2335b60bbb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.919034 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2c0fdd8ee43d6a7b47b01583332c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.922622 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c3996233a7147148a5bb0b35fcdfc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.922879 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5a49133468840e6b7bed0126dd2182f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.923085 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cecdbd0494354e68b55b545b9a307615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.923295 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173abe58eb7a46acb5d9539d521ca2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.927042 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5dd8a3bbafa45549b88bfebbf3e8410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.927255 5988 tablet_service.cc:1467] Processing CreateTablet for tablet a14fc8a96eac4202832c7a1e00246e7f (DEFAULT_TABLE table=default.Table_751cb522af9d4e9eae2571a2a05cf29f [id=4f26b00c29b0447c8fe01e7994ec68ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.927731 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14fc8a96eac4202832c7a1e00246e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.930756 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a35ae7465e8b4ab0bd9c61127e56f32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.934602 7642 raft_consensus.cc:482] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:19.934731 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc24f846ad71418195657ff37dbe418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.934763 7642 raft_consensus.cc:504] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:19.936106 7642 leader_election.cc:288] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:19.928725 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9d875157004a42ab49d40fda8379b0 (DEFAULT_TABLE table=default.Table_62778da60fec4dd4beeada7adc219568 [id=3fefb59cd8c544ddaae21cd3bbe81b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.936686 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9d875157004a42ab49d40fda8379b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.938060 5986 tablet_service.cc:1467] Processing CreateTablet for tablet fb56456769a24d2ca228dd29ffed6748 (DEFAULT_TABLE table=default.Table_de8ffe56d2154e0c8ca4b46066aa0335 [id=84302c85a524470e8ba6abeb35f6b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.938412 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb56456769a24d2ca228dd29ffed6748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.941486 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c (DEFAULT_TABLE table=default.Table_76c6f9abd0af4d5ab3daa5d92b3db883 [id=dbc7e6d6878a4ab5aad905178c97d565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.945397 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 12fb38b8f81c4a269d775a1efa360ccd (DEFAULT_TABLE table=default.Table_582bec7fc1de458b9f8615e82e51928b [id=43830bc9d61746a6b82ded66ebb21b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.948314 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7e2cdf05d17f42e1864e02135d9b68d4 (DEFAULT_TABLE table=default.Table_d915567a3c924688b3ef70bf6ec31435 [id=b03c3ee559764d5b95619f6cb904ac45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:19.965346 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fd004a4f724ae5bb285af67218d8d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.965626 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.969887 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfc416bb8de4c5ea4e0e8f25a0bc705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.971448 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e2cdf05d17f42e1864e02135d9b68d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:19.982219 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12fb38b8f81c4a269d775a1efa360ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.000908 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.001190 5884 raft_consensus.cc:2454] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:20.001403 5818 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.001513 5818 leader_election.cc:302] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.002558 5876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.002792 5876 raft_consensus.cc:2454] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:20.007332 6270 ts_tablet_manager.cc:1918] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.007481 6270 log.cc:1196] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/2ab439922c6e4ffea8d8cdb6b7d8d8d7
I20260928 10:44:20.007890 6270 ts_tablet_manager.cc:1939] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:20.008771 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1032) took 3461 ms. Trace:
I20260928 10:44:20.008886 6270 rpcz_store.cc:276] 0928 10:44:16.547328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.547370 (+ 42us) service_pool.cc:227] Handling call
0928 10:44:19.453676 (+2906306us) ts_tablet_manager.cc:1145] Deleting tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
0928 10:44:19.453689 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.459308 (+ 5619us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.007163 (+547855us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.008743 (+ 1580us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2906156}
I20260928 10:44:20.009227 6270 tablet_replica.cc:330] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:20.009405 6270 raft_consensus.cc:2229] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:20.009541 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (table default.Table_9d4a7be11896409ebc4138bc454bc2bb [id=b1363dbf11ec4d228eac4323ea1ad5d9]) successfully deleted
I20260928 10:44:20.009677 6270 raft_consensus.cc:2258] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.010233 6270 ts_tablet_manager.cc:1905] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.012786 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14fc8a96eac4202832c7a1e00246e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.015875 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1083) took 1810 ms. Trace:
I20260928 10:44:20.016065 7557 rpcz_store.cc:276] 0928 10:44:18.205619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.205692 (+ 73us) service_pool.cc:227] Handling call
0928 10:44:19.716390 (+1510698us) ts_tablet_manager.cc:1145] Deleting tablet 3cb9c554d363441b8006abc2d9bdd856
0928 10:44:19.716405 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:19.752387 (+ 35982us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:19.809561 (+ 57174us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.015850 (+206289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510456}
I20260928 10:44:20.016480 7557 tablet_replica.cc:330] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.016752 7557 raft_consensus.cc:2229] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.016999 7557 raft_consensus.cc:2258] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.017618 7557 ts_tablet_manager.cc:1905] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.019261 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c (DEFAULT_TABLE table=default.Table_76c6f9abd0af4d5ab3daa5d92b3db883 [id=dbc7e6d6878a4ab5aad905178c97d565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.019678 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd7ef7319814fb08c6e2bed2f9ada5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.019711 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 3cb9c554d363441b8006abc2d9bdd856 (table default.Table_e1bf6b61428c4c59b89c1570bf86cdde [id=eb77d2cf84924af988925fd4c745a5d6]) successfully deleted
W20260928 10:44:20.029734 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a0b6f281d104485a7f63bf7de5ece4e has no consensus state
W20260928 10:44:20.038763 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5afe4501ea584d44b511b89983e210e3 consensus state has no leader
I20260928 10:44:20.039155 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df354384bd76407fb7e6fec68e957639" } modify_external_catalogs: true
I20260928 10:44:20.039330 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_df354384bd76407fb7e6fec68e957639" } modify_external_catalogs: true
I20260928 10:44:20.040992 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ce114bd8e056414eb38914cbfbaa5c21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.041577 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce114bd8e056414eb38914cbfbaa5c21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.048206 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_76d30388f69f4b4295f41fe5c15c6d79" } new_table_name: "default.Table_5a0b60229554493cbe4d69c2d3250a48" modify_external_catalogs: true
I20260928 10:44:20.049573 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1f9fc7685a7541219b7207dc38b604e0
I20260928 10:44:20.050289 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9d8fe2a3cf6d4876baa28468029c3157" } new_table_name: "default.Table_201ee8242a3c44278cf7c886f0ddd7d5" modify_external_catalogs: true
I20260928 10:44:20.051911 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ef1d4e568ea4410aae673078c4915f63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.052472 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef1d4e568ea4410aae673078c4915f63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.053798 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c44e7c9d47c24c899ec65d6e7dd9f391
I20260928 10:44:20.053922 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 18269ece430f46cba7e926b579ac33a1
I20260928 10:44:20.054196 7780 raft_consensus.cc:2726] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.054576 7780 raft_consensus.cc:482] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.054699 7780 raft_consensus.cc:504] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.054812 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.055266 7780 leader_election.cc:288] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.055377 7780 raft_consensus.cc:482] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.055485 7780 raft_consensus.cc:504] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.055943 7780 leader_election.cc:288] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.058130 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 18269ece430f46cba7e926b579ac33a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.059427 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.060233 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 18269ece430f46cba7e926b579ac33a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.060633 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:20.062690 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 61291.3us
I20260928 10:44:20.063584 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.066259 6271 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:20.068902 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bbdcc310aed44e3688cf170f1d20ea55" } new_table_name: "default.Table_a7c31d959b0042e5bd6e5800876e0299" modify_external_catalogs: true
I20260928 10:44:20.069514 6271 ts_tablet_manager.cc:1397] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.191s user 0.018s sys 0.012s
I20260928 10:44:20.070786 6271 raft_consensus.cc:348] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.070865 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_42d9ac5604184e359e5bb0ad2aa34852"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.071444 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42d9ac5604184e359e5bb0ad2aa34852 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:20.072132 5818 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.072314 5818 leader_election.cc:302] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.072600 7780 raft_consensus.cc:2726] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.073139 5818 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.073311 5818 leader_election.cc:302] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.073577 7780 raft_consensus.cc:2726] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.073904 5818 leader_election.cc:341] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.074043 5818 leader_election.cc:302] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.074291 7780 raft_consensus.cc:2726] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.074851 6271 raft_consensus.cc:374] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.063642 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 892) took 7952 ms. Trace:
I20260928 10:44:20.075423 6271 raft_consensus.cc:729] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.075462 6269 rpcz_store.cc:276] 0928 10:44:12.111519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.111572 (+ 53us) service_pool.cc:227] Handling call
0928 10:44:20.063473 (+7951901us) ts_tablet_manager.cc:1145] Deleting tablet 6bfcdaa9d8bf45c98411cf0e6febd294
0928 10:44:20.063489 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.063609 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7951549}
I20260928 10:44:20.076006 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 893) took 7954 ms. Trace:
I20260928 10:44:20.076143 6269 rpcz_store.cc:276] 0928 10:44:12.121528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.121592 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:20.075862 (+7954270us) ts_tablet_manager.cc:1145] Deleting tablet a3b0ec0cf3bc4a09b0aaa15d18873f70
0928 10:44:20.075877 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.075989 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7944851}
I20260928 10:44:20.076467 6269 tablet_replica.cc:330] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:20.076483 6271 consensus_queue.cc:260] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.076736 6269 raft_consensus.cc:2229] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.076906 6269 raft_consensus.cc:2258] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.077507 6269 ts_tablet_manager.cc:1905] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.081326 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 12fb38b8f81c4a269d775a1efa360ccd (DEFAULT_TABLE table=default.Table_582bec7fc1de458b9f8615e82e51928b [id=43830bc9d61746a6b82ded66ebb21b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.085646 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.087153 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.087608 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12fb38b8f81c4a269d775a1efa360ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.091065 6271 ts_tablet_manager.cc:1428] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260928 10:44:20.094180 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 18269ece430f46cba7e926b579ac33a1 (DEFAULT_TABLE table=default.Table_cb3b44ccee5a4a09af9172ca455c5b05 [id=67ad2648f0ce4cfc907655278f13c146]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.094594 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18269ece430f46cba7e926b579ac33a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.095716 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 7e2cdf05d17f42e1864e02135d9b68d4 (DEFAULT_TABLE table=default.Table_d915567a3c924688b3ef70bf6ec31435 [id=b03c3ee559764d5b95619f6cb904ac45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.096729 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e2cdf05d17f42e1864e02135d9b68d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.103070 6271 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:20.108626 6271 tablet_bootstrap.cc:654] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.111020 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.111315 6125 tablet_service.cc:1467] Processing CreateTablet for tablet fb56456769a24d2ca228dd29ffed6748 (DEFAULT_TABLE table=default.Table_de8ffe56d2154e0c8ca4b46066aa0335 [id=84302c85a524470e8ba6abeb35f6b7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.111825 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb56456769a24d2ca228dd29ffed6748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.112406 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.112910 5817 leader_election.cc:341] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: ffa971239a2b4ac6bc309dfbacdbe12e
W20260928 10:44:20.113117 5817 leader_election.cc:341] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.113242 5817 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.114647 5955 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.115918 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet c44e7c9d47c24c899ec65d6e7dd9f391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:20.116124 6131 tablet_service.cc:1514] Processing DeleteTablet for tablet 18269ece430f46cba7e926b579ac33a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:20.128880 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 54963.5us
W20260928 10:44:20.129374 5818 leader_election.cc:341] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.129585 5818 leader_election.cc:302] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:20.130060 5818 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.130219 5818 leader_election.cc:302] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.130513 7780 raft_consensus.cc:2726] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.130692 7780 raft_consensus.cc:2726] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.131067 5818 leader_election.cc:341] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.131232 5818 leader_election.cc:302] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.131475 7780 raft_consensus.cc:2726] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.132392 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcecdf79aafe497080e2a1f6256ef6fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:20.133271 5957 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:20.133405 5957 leader_election.cc:302] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.133843 7782 raft_consensus.cc:2726] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.134573 5957 consensus_peers.cc:487] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 490f8a4f1f9245cfab168b96511e18de. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:20.135437 7780 raft_consensus.cc:482] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.135597 7780 raft_consensus.cc:504] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.136242 7780 leader_election.cc:288] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:20.136811 5957 consensus_peers.cc:487] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 463cf5ecb52d40069b564698433c6781. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:20.137328 7782 consensus_queue.cc:1035] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:20.139609 7782 consensus_queue.cc:1035] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:20.143699 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:20.146198 5817 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.146566 7830 raft_consensus.cc:482] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.146817 7830 raft_consensus.cc:504] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.147591 7830 leader_election.cc:288] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:20.152938 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6bfcdaa9d8bf45c98411cf0e6febd294 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bfcdaa9d8bf45c98411cf0e6febd294 already in progress: creating tablet
W20260928 10:44:20.153228 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b0ec0cf3bc4a09b0aaa15d18873f70 already in progress: creating tablet
I20260928 10:44:20.159456 7707 consensus_queue.cc:1035] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:20.160014 7707 raft_consensus.cc:482] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.160140 7707 raft_consensus.cc:504] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.160755 7707 leader_election.cc:288] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.146764 6138 raft_consensus.cc:3037] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:20.162020 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.145819 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d1021f0b844a348e3fbed913758650" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.163206 5955 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.181427 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381b12c993c74ba6ba78804c1f6c01e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.182273 5817 leader_election.cc:341] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.182595 6143 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s user 0.018s sys 0.057s
W20260928 10:44:20.182721 5817 leader_election.cc:341] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.183207 6143 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.613s user 0.018s sys 0.057s
W20260928 10:44:20.187744 6154 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.027s sys 0.035s
W20260928 10:44:20.188203 6154 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s user 0.027s sys 0.035s
I20260928 10:44:20.200634 6271 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:20.202201 6271 ts_tablet_manager.cc:1397] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.099s user 0.001s sys 0.015s
I20260928 10:44:20.203542 6271 raft_consensus.cc:348] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:20.204039 6155 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s user 0.012s sys 0.060s
W20260928 10:44:20.204195 6155 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s user 0.012s sys 0.060s
I20260928 10:44:20.204555 6271 raft_consensus.cc:374] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.204681 6271 raft_consensus.cc:729] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:20.204932 6151 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s user 0.011s sys 0.018s
W20260928 10:44:20.205106 6151 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s user 0.011s sys 0.018s
I20260928 10:44:20.204958 6271 consensus_queue.cc:260] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:20.205596 6271 ts_tablet_manager.cc:1428] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260928 10:44:20.222728 6273 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.705s user 0.182s sys 0.174s
W20260928 10:44:20.222956 6273 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.705s user 0.182s sys 0.174s
I20260928 10:44:20.223865 6273 tablet_bootstrap.cc:492] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:20.224090 6273 ts_tablet_manager.cc:1397] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.708s user 0.183s sys 0.174s
I20260928 10:44:20.224882 6273 raft_consensus.cc:348] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:20.225183 6273 raft_consensus.cc:374] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.225282 6273 raft_consensus.cc:729] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.225517 6273 consensus_queue.cc:260] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:20.217581 6147 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s user 0.008s sys 0.009s
I20260928 10:44:20.226181 6273 ts_tablet_manager.cc:1428] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260928 10:44:20.226235 6147 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.738s user 0.008s sys 0.009s
W20260928 10:44:20.217633 6275 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.713s user 0.017s sys 0.010s
W20260928 10:44:20.227907 6275 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.724s user 0.017s sys 0.010s
W20260928 10:44:20.227916 6146 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.023s sys 0.048s
W20260928 10:44:20.228201 6146 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.589s user 0.023s sys 0.048s
I20260928 10:44:20.228865 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c30726853549dfbc57f65fd31603fa" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.230895 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:20.217651 6142 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s user 0.006s sys 0.012s
W20260928 10:44:20.217603 6149 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s user 0.021s sys 0.006s
W20260928 10:44:20.236871 6149 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s user 0.021s sys 0.006s
W20260928 10:44:20.235971 6142 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s user 0.006s sys 0.012s
I20260928 10:44:20.238132 6275 tablet_bootstrap.cc:492] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.240082 6273 tablet_bootstrap.cc:492] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:20.241861 6273 tablet_bootstrap.cc:654] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.251662 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a658dce02ff740f086774aa44aef9fb8
I20260928 10:44:20.252417 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8edf4e5a87cb491f959adf009c1d0d0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.252926 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8edf4e5a87cb491f959adf009c1d0d0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.256444 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet a658dce02ff740f086774aa44aef9fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.258010 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet a658dce02ff740f086774aa44aef9fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:20.258538 5957 consensus_peers.cc:487] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00b7e26971914613a2372476b348b702. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:20.259151 5957 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:20.259356 5957 leader_election.cc:302] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.259862 7707 raft_consensus.cc:2726] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.257524 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet a658dce02ff740f086774aa44aef9fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:20.264097 6275 ts_tablet_manager.cc:1397] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.783s user 0.019s sys 0.011s
I20260928 10:44:20.264596 7707 raft_consensus.cc:482] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.264748 7707 raft_consensus.cc:504] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.264897 6275 raft_consensus.cc:348] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.265110 6275 raft_consensus.cc:374] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.265159 6275 raft_consensus.cc:729] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.265352 7707 leader_election.cc:288] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.265372 6275 consensus_queue.cc:260] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.270643 6271 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:20.271293 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.272418 5957 leader_election.cc:302] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.276042 7680 raft_consensus.cc:2781] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:20.276125 7680 raft_consensus.cc:482] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:20.276183 7680 raft_consensus.cc:3037] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:20.279261 7680 raft_consensus.cc:504] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.279942 7680 leader_election.cc:288] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:20.283234 5957 leader_election.cc:341] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: cd65a860b00d4a7ba8ae92dde5818212
I20260928 10:44:20.283449 5957 leader_election.cc:302] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.283543 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_46cd6f3ff6a044d0a67fb51c668012df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.284119 7707 raft_consensus.cc:2726] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.292325 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e78bfa994d041678796ba73a22ee414 consensus state has no leader
I20260928 10:44:20.292778 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2deeaf0a2af646009edec76f39b81a1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.293834 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b2c9214a568c4660b326618ee5d9b23c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.311327 6269 ts_tablet_manager.cc:1918] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:20.311641 6269 log.cc:1196] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c1a659100a124506a411c929ddc31f10
I20260928 10:44:20.312000 6271 tablet_bootstrap.cc:654] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.312266 6269 ts_tablet_manager.cc:1939] T c1a659100a124506a411c929ddc31f10 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:20.313577 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ced63ab7188472e80d4ff52350be3e0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.327350 7782 raft_consensus.cc:482] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:20.329062 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ae85d945b0242c289e2e930d1485758 consensus state has no leader
I20260928 10:44:20.337039 6270 ts_tablet_manager.cc:1918] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.337476 6270 log.cc:1196] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:20.275995 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.285401 6152 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s user 0.008s sys 0.011s
W20260928 10:44:20.294659 7822 log.cc:924] Time spent T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
W20260928 10:44:20.344970 6152 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s user 0.008s sys 0.011s
I20260928 10:44:20.321270 7557 ts_tablet_manager.cc:1918] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.347381 7557 log.cc:1196] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4bfb47ad184148d595830276bad311dc
I20260928 10:44:20.347956 7557 ts_tablet_manager.cc:1939] T 4bfb47ad184148d595830276bad311dc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.348373 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1084) took 2118 ms. Trace:
I20260928 10:44:20.348529 7557 rpcz_store.cc:276] 0928 10:44:18.230146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.230395 (+ 249us) service_pool.cc:227] Handling call
0928 10:44:20.016434 (+1786039us) ts_tablet_manager.cc:1145] Deleting tablet 4bfb47ad184148d595830276bad311dc
0928 10:44:20.016444 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.148859 (+132415us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.321118 (+172259us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.348358 (+ 27240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1785774}
I20260928 10:44:20.350543 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1085) took 2108 ms. Trace:
I20260928 10:44:20.350795 7557 rpcz_store.cc:276] 0928 10:44:18.241877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.241940 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:20.349484 (+2107544us) ts_tablet_manager.cc:1145] Deleting tablet c7f4ce1792fd494687863136583be109
0928 10:44:20.349501 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.350517 (+ 1016us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2107298}
I20260928 10:44:20.351091 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fbc9cdd536da4daa901a68955a40c424" } new_table_name: "default.Table_24cd9b070a6143739a36e9e9670978e1" modify_external_catalogs: true
I20260928 10:44:20.351660 7557 tablet_replica.cc:330] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.351945 7557 raft_consensus.cc:2229] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.352325 7557 raft_consensus.cc:2258] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.328048 7832 tablet.cc:1722] T 9bd09430a2c34965a590f2e0852c686b P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:20.357380 7557 ts_tablet_manager.cc:1905] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.349283 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4bfb47ad184148d595830276bad311dc (table default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]) successfully deleted
W20260928 10:44:20.363732 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46cd6f3ff6a044d0a67fb51c668012df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:20.363759 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c9214a568c4660b326618ee5d9b23c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:20.364281 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c7f4ce1792fd494687863136583be109 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f4ce1792fd494687863136583be109 already in progress: creating tablet
W20260928 10:44:20.363732 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2deeaf0a2af646009edec76f39b81a1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.327751 7782 raft_consensus.cc:504] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.370117 7782 leader_election.cc:288] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.370911 6270 ts_tablet_manager.cc:1939] T 1072cf156cdf4c2a8c9d9764de110c6d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:20.371770 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1033) took 3823 ms. Trace:
I20260928 10:44:20.372342 6270 rpcz_store.cc:276] 0928 10:44:16.547858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.547979 (+ 121us) service_pool.cc:227] Handling call
0928 10:44:20.009181 (+3461202us) ts_tablet_manager.cc:1145] Deleting tablet 1072cf156cdf4c2a8c9d9764de110c6d
0928 10:44:20.009191 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.155854 (+146663us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.276092 (+120238us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.371751 (+ 95659us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3461051}
I20260928 10:44:20.372886 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.373101 5879 raft_consensus.cc:2454] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:20.374603 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1072cf156cdf4c2a8c9d9764de110c6d (table default.Table_8fbb02cd83954bd2ad721b776064fa23 [id=aa0fbbc798a8402e98d41714bad869b7]) successfully deleted
W20260928 10:44:20.377183 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 93950.2us
W20260928 10:44:20.378038 5957 leader_election.cc:341] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 67f29acce3604e458d1981aad87f2eb9
I20260928 10:44:20.378937 5957 leader_election.cc:302] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.379458 6270 tablet_replica.cc:330] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:20.384850 6275 ts_tablet_manager.cc:1428] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.121s user 0.001s sys 0.001s
I20260928 10:44:20.385248 6275 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.385519 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_75ed8b29e5124e269ae766667d19c71c" } new_table_name: "default.Table_95435d55a3534def845b6e5ca3633afd" modify_external_catalogs: true
I20260928 10:44:20.387567 6275 tablet_bootstrap.cc:654] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.379618 7841 raft_consensus.cc:2726] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:20.381794 5957 leader_election.cc:302] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.388125 7841 raft_consensus.cc:2781] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:20.388206 7841 raft_consensus.cc:482] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:20.388262 7841 raft_consensus.cc:3037] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:20.388810 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 112084us
I20260928 10:44:20.389483 7819 tablet.cc:1722] T a229207ce7cc475c8f4492e62d122721 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:20.392661 6270 raft_consensus.cc:2229] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:20.398528 7792 raft_consensus.cc:482] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f6ffbf4f0534383bf89d15aa37e3027)
I20260928 10:44:20.398685 7792 raft_consensus.cc:504] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:20.399482 7792 leader_election.cc:288] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.402133 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 897) took 8217 ms. Trace:
I20260928 10:44:20.402249 6269 rpcz_store.cc:276] 0928 10:44:12.184734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.184961 (+ 227us) service_pool.cc:227] Handling call
0928 10:44:20.076424 (+7891463us) ts_tablet_manager.cc:1145] Deleting tablet c1a659100a124506a411c929ddc31f10
0928 10:44:20.076433 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.194566 (+118133us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.311146 (+116580us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.402108 (+ 90962us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7889988}
I20260928 10:44:20.394739 7841 raft_consensus.cc:504] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.402992 7841 leader_election.cc:288] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.399842 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.400084 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "463cf5ecb52d40069b564698433c6781" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.400342 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.404222 6270 raft_consensus.cc:2258] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.411753 6270 ts_tablet_manager.cc:1905] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:20.425412 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8389880591441a9c2aabf22d67005f consensus state has no leader
I20260928 10:44:20.427202 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_62ef942b3a1e4735adeb03b3f519b028"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.434633 6091 leader_election.cc:341] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 3abfedf425b84f679b22d6ca9bef718a
I20260928 10:44:20.434787 6091 leader_election.cc:302] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.435823 7792 raft_consensus.cc:2726] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.436312 6091 leader_election.cc:302] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:20.436740 7792 raft_consensus.cc:2726] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.440901 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.430702 5879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.441740 5879 raft_consensus.cc:2454] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:20.431217 5877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:20.442034 5877 raft_consensus.cc:3037] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:20.432333 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:20.442596 5878 raft_consensus.cc:2454] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:20.433944 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:20.442821 5883 raft_consensus.cc:3037] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:20.445544 5883 raft_consensus.cc:2454] T 871fb70fea304b08bebce18c60998209 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:20.448086 5877 raft_consensus.cc:2454] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:20.449146 6269 tablet_replica.cc:330] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:20.449580 6269 raft_consensus.cc:2229] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.449935 6269 raft_consensus.cc:2258] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.451053 6269 ts_tablet_manager.cc:1905] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.455387 6113 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 193) took 1658 ms. Trace:
I20260928 10:44:20.455613 6113 rpcz_store.cc:276] 0928 10:44:18.797336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.917333 (+119997us) service_pool.cc:227] Handling call
0928 10:44:19.505289 (+587956us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x615000148d24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.283498 (+778209us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x615000364aa4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.455350 (+171852us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2005822592}
I20260928 10:44:20.448838 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c1a659100a124506a411c929ddc31f10 (table default.Table_1acc77c2d6914c87a340fe67568a2d53 [id=1ab19896272247a6a5b8ba9d9ee8b463]) successfully deleted
W20260928 10:44:20.459968 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:20.463117 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62ef942b3a1e4735adeb03b3f519b028 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.465615 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f01023aa1540413faac360ea5703e6ca" } modify_external_catalogs: true
I20260928 10:44:20.465881 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f01023aa1540413faac360ea5703e6ca" } modify_external_catalogs: true
I20260928 10:44:20.473819 7557 ts_tablet_manager.cc:1918] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.475584 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_95942e5acb5d44ef91113b0a1ecb10cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.476145 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95942e5acb5d44ef91113b0a1ecb10cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:20.482792 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 93b4ac29f2ab4deeb61ca2897835d20f consensus state has no leader
I20260928 10:44:20.486025 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_571da65303104a1180f4d7f67a75ebbb" } modify_external_catalogs: true
I20260928 10:44:20.486251 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_571da65303104a1180f4d7f67a75ebbb" } modify_external_catalogs: true
I20260928 10:44:20.486752 7557 log.cc:1196] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/76a47129ab5444dcab0a3f92a16046db
I20260928 10:44:20.487475 6275 tablet_bootstrap.cc:492] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.487605 6275 ts_tablet_manager.cc:1397] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.000s
I20260928 10:44:20.488335 6275 raft_consensus.cc:348] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.488552 6275 raft_consensus.cc:374] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.488611 6275 raft_consensus.cc:729] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.488827 6275 consensus_queue.cc:260] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.435264 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d1021f0b844a348e3fbed913758650" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.435544 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381b12c993c74ba6ba78804c1f6c01e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:20.491145 6275 ts_tablet_manager.cc:1428] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260928 10:44:20.491426 6275 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.492938 6275 tablet_bootstrap.cc:654] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.496127 7557 ts_tablet_manager.cc:1939] T 76a47129ab5444dcab0a3f92a16046db P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.496549 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1086) took 1959 ms. Trace:
I20260928 10:44:20.496701 7557 rpcz_store.cc:276] 0928 10:44:18.537478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.538032 (+ 554us) service_pool.cc:227] Handling call
0928 10:44:20.351580 (+1813548us) ts_tablet_manager.cc:1145] Deleting tablet 76a47129ab5444dcab0a3f92a16046db
0928 10:44:20.351596 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.452806 (+101210us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.473711 (+ 20905us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.496533 (+ 22822us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1808826}
I20260928 10:44:20.497376 7557 tablet_replica.cc:330] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.498678 7557 raft_consensus.cc:2229] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.498922 7557 raft_consensus.cc:2258] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:20.447147 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 56621.7us
W20260928 10:44:20.499230 5955 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.501263 7557 ts_tablet_manager.cc:1905] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.501573 7819 tablet.cc:1722] T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:20.505766 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 60f0191c7dd347058749790b4e4159c2 (table default.Table_0eaf0216af2946688678ea2816fef1d1 [id=b708ecbb24f14ccca7c3a7f05b458809]). Expected version 1 got 0
I20260928 10:44:20.506036 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 40fca578bf324fedbe7b28f9615497c6 (DEFAULT_TABLE table=default.Table_9781a630f3be483f9e3bbb3f79d5ba96 [id=5fb19cdef72447219e25cd1187251af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.506156 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 9bd09430a2c34965a590f2e0852c686b (table default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6]). Expected version 1 got 0
I20260928 10:44:20.506423 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 502d275d161945ce86626594ab0d89b3 (table default.Table_992de79b82b84396a6afe0e91c2be532 [id=16bcd943724f4799be80c69f3e54bd37]). Expected version 1 got 0
I20260928 10:44:20.506531 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40fca578bf324fedbe7b28f9615497c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.506673 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:20.506876 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:20.507018 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:20.507619 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:20.507962 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:20.513715 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:20.514008 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:20.515302 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4082931c332f40fc9c6530190fb61017
I20260928 10:44:20.515897 5696 master_service.cc:946] ReplaceTablet: received request to replace tablet 29b6d18cf0304edc8b3ca1d4d106decb from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:20.516187 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 4082931c332f40fc9c6530190fb61017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.516724 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 84c30726853549dfbc57f65fd31603fa (table default.Table_657fa5819345488788e6612b8a05deaa [id=17317e8a64f24899884b053bbb419d54]). Expected version 1 got 0
I20260928 10:44:20.516908 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 60f0191c7dd347058749790b4e4159c2 (table default.Table_0eaf0216af2946688678ea2816fef1d1 [id=b708ecbb24f14ccca7c3a7f05b458809]). Expected version 1 got 0
I20260928 10:44:20.517056 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet bcecdf79aafe497080e2a1f6256ef6fd (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6]). Expected version 2 got 0
I20260928 10:44:20.517196 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 381b12c993c74ba6ba78804c1f6c01e3 (table default.Table_01c93471d7f34f44b0ffbea6e492c088 [id=adebad10f1c44a129db689cdaa9d327b]). Expected version 1 got 0
I20260928 10:44:20.517302 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 (table default.Table_bd415a38e4344ac0a4f2bfb479d01b58 [id=01274b7dde224a98ae1da73c01701045]). Expected version 1 got 0
I20260928 10:44:20.518985 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4082931c332f40fc9c6530190fb61017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:20.520493 5698 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bcecdf79aafe497080e2a1f6256ef6fd (table default.Table_a8807488d3d1426ea48e12acc8a1dcfc [id=2a6be2d4d87c4c1fb443221777c8c8e6], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet bcecdf79aafe497080e2a1f6256ef6fd consensus state has no leader
I20260928 10:44:20.521476 7782 raft_consensus.cc:482] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.521624 7782 raft_consensus.cc:504] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.522187 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet ba67a229f61e4a6b8078b59fe89fae7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.522236 7782 leader_election.cc:288] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.522418 5861 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d1021f0b844a348e3fbed913758650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.522605 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 20ea1325da4e460da08377f5d6d6a055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.522742 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 32560e881a1d4444a706bb8b60dda499 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.527254 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 40fca578bf324fedbe7b28f9615497c6 (DEFAULT_TABLE table=default.Table_9781a630f3be483f9e3bbb3f79d5ba96 [id=5fb19cdef72447219e25cd1187251af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.527585 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 66a627fbfd6e430683680ab6e4f1a5ba (DEFAULT_TABLE table=default.Table_a9bd4910ac124e6b935806ea96522396 [id=8759364261394c729c0b0b4e6fa4120f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.527784 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40fca578bf324fedbe7b28f9615497c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.527998 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a627fbfd6e430683680ab6e4f1a5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.532665 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 66a627fbfd6e430683680ab6e4f1a5ba (DEFAULT_TABLE table=default.Table_a9bd4910ac124e6b935806ea96522396 [id=8759364261394c729c0b0b4e6fa4120f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.532945 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1c9e223824a948b113afd1b3b5824 (DEFAULT_TABLE table=default.Table_a340eaeaa91547afa89425880f7ef1ee [id=23037f3508e74baa902ff9d7debf3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.533092 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a627fbfd6e430683680ab6e4f1a5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.533303 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1c9e223824a948b113afd1b3b5824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.501595 6115 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 195) took 1019 ms. Trace:
I20260928 10:44:20.509675 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.509944 7832 tablet.cc:1722] T 60f0191c7dd347058749790b4e4159c2 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:20.510584 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871fb70fea304b08bebce18c60998209" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:20.512476 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dddbd630c6d9446b9ff317c963cd00d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:20.518124 7844 raft_consensus.cc:482] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.539419 7844 raft_consensus.cc:504] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.540035 7844 leader_election.cc:288] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.539115 6115 rpcz_store.cc:276] 0928 10:44:19.482555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.482620 (+ 65us) service_pool.cc:227] Handling call
0928 10:44:20.210059 (+727439us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x6150003145a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.345927 (+135868us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x615000331924. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.373762 (+ 27835us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x6150000be624. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.408287 (+ 34525us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x615000208b24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.501571 (+ 93284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2054007552}
I20260928 10:44:20.544072 5996 tablet_service.cc:1467] Processing CreateTablet for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe (DEFAULT_TABLE table=default.Table_8ed673d63eb24c21a0dbe7e30f8e7951 [id=2e5b65901809483f8bc54254d8477560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.544492 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.546583 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1c9e223824a948b113afd1b3b5824 (DEFAULT_TABLE table=default.Table_a340eaeaa91547afa89425880f7ef1ee [id=23037f3508e74baa902ff9d7debf3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.548141 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.548511 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.548738 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1c9e223824a948b113afd1b3b5824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.548738 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.548902 5998 tablet_service.cc:1514] Processing DeleteTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.549052 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.549206 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:20.554289 5955 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.554512 5955 leader_election.cc:341] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.542193 6090 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 85583238d6b54f1d89ff5b53b40e73bb
W20260928 10:44:20.554654 5955 leader_election.cc:341] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.542647 7832 tablet.cc:1722] T a229207ce7cc475c8f4492e62d122721 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:20.532629 6275 tablet_bootstrap.cc:492] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.555694 6275 ts_tablet_manager.cc:1397] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.002s
I20260928 10:44:20.556456 6275 raft_consensus.cc:348] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.556756 6275 raft_consensus.cc:374] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.556847 6275 raft_consensus.cc:729] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.557068 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.557117 6275 consensus_queue.cc:260] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.557788 6275 ts_tablet_manager.cc:1428] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:20.558178 6275 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.562052 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 4082931c332f40fc9c6530190fb61017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:20.561928 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_881ad78ff327442f82d3bca9993b83f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.562574 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_881ad78ff327442f82d3bca9993b83f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.541405 6112 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45880 (request call id 194) took 1061 ms. Trace:
I20260928 10:44:20.563887 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_0df7a20f80d44aa9817bbe59ae3a0888" } new_table_name: "default.Table_32fc39d5462c458493d3cdf24fd92137" modify_external_catalogs: true
I20260928 10:44:20.563925 6112 rpcz_store.cc:276] 0928 10:44:19.479923 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.479977 (+ 54us) service_pool.cc:227] Handling call
0928 10:44:20.210510 (+730533us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x6150003145a4. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.346692 (+136182us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x615000331924. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.377038 (+ 30346us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x6150000be624. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.413408 (+ 36370us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x615000208b24. stack: 00007f6f8533766e 00007f6f85337430 00007f6f843be5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f6f9083f630 00007f6f94417c7f 00007f6f8ef83016 00007f6f8ef82d45 00007f6f8be739be 00007f6f8be7279e 00007f6f8be78b25 00007f6f8be7954f 00007f6f8be79378 00000000009edb7c
0928 10:44:20.541383 (+127975us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2068279424}
I20260928 10:44:20.565193 5700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6c2b98627d6646de9a34fba8f67cc203" } modify_external_catalogs: true
I20260928 10:44:20.565356 5700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6c2b98627d6646de9a34fba8f67cc203" } modify_external_catalogs: true
I20260928 10:44:20.566900 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4d02fe9f7eae47fbbe27a15a2e408dec" } modify_external_catalogs: true
I20260928 10:44:20.567133 6275 tablet_bootstrap.cc:654] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.567099 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4d02fe9f7eae47fbbe27a15a2e408dec" } modify_external_catalogs: true
I20260928 10:44:20.567584 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 40fca578bf324fedbe7b28f9615497c6 (DEFAULT_TABLE table=default.Table_9781a630f3be483f9e3bbb3f79d5ba96 [id=5fb19cdef72447219e25cd1187251af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.568050 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40fca578bf324fedbe7b28f9615497c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.569613 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8355c773c7064c6ca162bb655c4f281b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.570245 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8355c773c7064c6ca162bb655c4f281b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.571048 5854 tablet_service.cc:1467] Processing CreateTablet for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe (DEFAULT_TABLE table=default.Table_8ed673d63eb24c21a0dbe7e30f8e7951 [id=2e5b65901809483f8bc54254d8477560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.571588 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:20.573675 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cecdbd0494354e68b55b545b9a307615 (table default.Table_c770a8bf7bd44cc390e398afb5dde218 [id=ba1cae36765d45b5b6b5d109629ee88c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cecdbd0494354e68b55b545b9a307615 consensus state has no leader
I20260928 10:44:20.576787 7819 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:46336 (request call id 1151) took 1210 ms. Trace:
I20260928 10:44:20.577354 7819 rpcz_store.cc:276] 0928 10:44:19.366707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.366782 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:20.576768 (+1209986us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:19.367221 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 10:44:19.367316 (+ 95us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 10:44:19.367324 (+ 8us) alter_schema_op.cc:65] Acquired schema lock
0928 10:44:19.367330 (+ 6us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 10:44:19.367366 (+ 36us) alter_schema_op.cc:126] START. Timestamp: 1790592259367337
0928 10:44:19.367369 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:19.447358 (+ 79989us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x6160004d1da0. stack: 00007f07d55a366e 00007f07d55a3430 00007f07d462a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f07e0a10155 00007f07e0ad615c 00007f07e0ab22f7 00007f07e0ab1ba5 00007f07e1de47f1 00007f07e1de3359 00007f07e1deb1bb 00007f07e1deb038 00000000009edb7c 00007f07d55e9344
0928 10:44:19.447578 (+ 220us) log.cc:842] Serialized 173 byte log entry
0928 10:44:20.501118 (+1053540us) op_driver.cc:444] REPLICATION: finished
0928 10:44:20.501547 (+ 429us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0928 10:44:20.502012 (+ 465us) log.cc:842] Serialized 5 byte log entry
0928 10:44:20.576354 (+ 74342us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.576677 (+ 323us) log.cc:842] Serialized 14 byte log entry
0928 10:44:20.576722 (+ 45us) alter_schema_op.cc:71] Released schema lock
0928 10:44:20.576726 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":368,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":9441,"prepare.run_wall_time_us":105764,"replication_time_us":1133719,"spinlock_wait_cycles":183328000,"thread_start_us":80290,"threads_started":2,"wal-append.queue_time_us":79531,"wal-append.run_cpu_time_us":589,"wal-append.run_wall_time_us":1001275}]]}
I20260928 10:44:20.580386 5861 tablet_service.cc:1467] Processing CreateTablet for tablet d278a6ad7858460f80c7e2bb6cf07f39 (DEFAULT_TABLE table=default.Table_d0ca9a65dc4a4795a42c3f368a1f1816 [id=b295949550ca4cd2ad02d21a4601b1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.580761 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d278a6ad7858460f80c7e2bb6cf07f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.581020 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0d0878809846aab7e039aa6e2a0f40 (DEFAULT_TABLE table=default.Table_a28e0e7c22924ebd924df72e2eec894a [id=573a8dc23cf741cf969af409641ded7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.581414 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0d0878809846aab7e039aa6e2a0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.582201 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:20.582849 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 66a627fbfd6e430683680ab6e4f1a5ba (DEFAULT_TABLE table=default.Table_a9bd4910ac124e6b935806ea96522396 [id=8759364261394c729c0b0b4e6fa4120f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.583184 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a627fbfd6e430683680ab6e4f1a5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.587025 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1c9e223824a948b113afd1b3b5824 (DEFAULT_TABLE table=default.Table_a340eaeaa91547afa89425880f7ef1ee [id=23037f3508e74baa902ff9d7debf3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.587363 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1c9e223824a948b113afd1b3b5824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.588251 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0d0878809846aab7e039aa6e2a0f40 (DEFAULT_TABLE table=default.Table_a28e0e7c22924ebd924df72e2eec894a [id=573a8dc23cf741cf969af409641ded7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.588568 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0d0878809846aab7e039aa6e2a0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.580999 5996 tablet_service.cc:1467] Processing CreateTablet for tablet d278a6ad7858460f80c7e2bb6cf07f39 (DEFAULT_TABLE table=default.Table_d0ca9a65dc4a4795a42c3f368a1f1816 [id=b295949550ca4cd2ad02d21a4601b1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.590238 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d278a6ad7858460f80c7e2bb6cf07f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.591064 6129 tablet_service.cc:1467] Processing CreateTablet for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe (DEFAULT_TABLE table=default.Table_8ed673d63eb24c21a0dbe7e30f8e7951 [id=2e5b65901809483f8bc54254d8477560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.591373 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4c0d4d61c64ff5b340b41bd36a4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.599392 6275 tablet_bootstrap.cc:492] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.599649 6275 ts_tablet_manager.cc:1397] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.001s
I20260928 10:44:20.600499 6275 raft_consensus.cc:348] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.600870 6275 raft_consensus.cc:374] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.600987 6275 raft_consensus.cc:729] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.601295 6275 consensus_queue.cc:260] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.601898 6275 ts_tablet_manager.cc:1428] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:20.602656 6275 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.602882 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae733c805ee40479b168638ddc6b3cc (DEFAULT_TABLE table=default.Table_08d92c5a2cb04347ac3210e7511a8dbd [id=a1fec4d96db3461bbfc85533be499a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.603372 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae733c805ee40479b168638ddc6b3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.604287 6275 tablet_bootstrap.cc:654] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.606841 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 699848d9a04c40cb89df65d1b1fff0ef (DEFAULT_TABLE table=default.Table_c8fd748c21af4b64bb491c536e5322ad [id=83943dcb97ad4aa8ba013cf519bea452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.607528 5850 tablet_service.cc:1467] Processing CreateTablet for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f (DEFAULT_TABLE table=default.Table_0464858370af453b8ba8edfdd7f2c243 [id=22acca9247d64a90810693a542e6436b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.611963 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae733c805ee40479b168638ddc6b3cc (DEFAULT_TABLE table=default.Table_08d92c5a2cb04347ac3210e7511a8dbd [id=a1fec4d96db3461bbfc85533be499a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.612069 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 699848d9a04c40cb89df65d1b1fff0ef (DEFAULT_TABLE table=default.Table_c8fd748c21af4b64bb491c536e5322ad [id=83943dcb97ad4aa8ba013cf519bea452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.612402 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae733c805ee40479b168638ddc6b3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.612581 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699848d9a04c40cb89df65d1b1fff0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.616843 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0b6f281d104485a7f63bf7de5ece4e (DEFAULT_TABLE table=default.Table_cf31e923002b44849bfcebd783af9be4 [id=43af02656bd94568a7d6ee20a403153c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.618821 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0b6f281d104485a7f63bf7de5ece4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.618804 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 76a47129ab5444dcab0a3f92a16046db (table default.Table_5fad44d7253f493788268121109a5671 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]) successfully deleted
I20260928 10:44:20.619904 5848 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07e1e49f0c41fab20883678afbcef9 (DEFAULT_TABLE table=default.Table_fe7d2b13a5074e87af92cd2b06b01287 [id=b92b0ac4ab5a4cc8bac299f930a45b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.620466 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa (DEFAULT_TABLE table=default.Table_61f24832d418408ba2b4d047a1a17174 [id=26b89fa1707a40d4a76366e6a07a4fc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.621552 7642 raft_consensus.cc:482] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.621536 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0b6f281d104485a7f63bf7de5ece4e (DEFAULT_TABLE table=default.Table_cf31e923002b44849bfcebd783af9be4 [id=43af02656bd94568a7d6ee20a403153c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.621690 7642 raft_consensus.cc:504] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.622018 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae733c805ee40479b168638ddc6b3cc (DEFAULT_TABLE table=default.Table_08d92c5a2cb04347ac3210e7511a8dbd [id=a1fec4d96db3461bbfc85533be499a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.622283 7642 leader_election.cc:288] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.622471 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 699848d9a04c40cb89df65d1b1fff0ef (DEFAULT_TABLE table=default.Table_c8fd748c21af4b64bb491c536e5322ad [id=83943dcb97ad4aa8ba013cf519bea452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.622901 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f (DEFAULT_TABLE table=default.Table_0464858370af453b8ba8edfdd7f2c243 [id=22acca9247d64a90810693a542e6436b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.623301 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07e1e49f0c41fab20883678afbcef9 (DEFAULT_TABLE table=default.Table_fe7d2b13a5074e87af92cd2b06b01287 [id=b92b0ac4ab5a4cc8bac299f930a45b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.623737 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de0ff28393d479dadb5e2f3e415d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.624089 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa (DEFAULT_TABLE table=default.Table_61f24832d418408ba2b4d047a1a17174 [id=26b89fa1707a40d4a76366e6a07a4fc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.624814 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0d0878809846aab7e039aa6e2a0f40 (DEFAULT_TABLE table=default.Table_a28e0e7c22924ebd924df72e2eec894a [id=573a8dc23cf741cf969af409641ded7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.625502 6134 tablet_service.cc:1467] Processing CreateTablet for tablet d278a6ad7858460f80c7e2bb6cf07f39 (DEFAULT_TABLE table=default.Table_d0ca9a65dc4a4795a42c3f368a1f1816 [id=b295949550ca4cd2ad02d21a4601b1f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.627799 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.629426 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0b6f281d104485a7f63bf7de5ece4e (DEFAULT_TABLE table=default.Table_cf31e923002b44849bfcebd783af9be4 [id=43af02656bd94568a7d6ee20a403153c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.629583 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f (DEFAULT_TABLE table=default.Table_0464858370af453b8ba8edfdd7f2c243 [id=22acca9247d64a90810693a542e6436b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.629966 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.631187 5861 tablet_service.cc:1467] Processing CreateTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa (DEFAULT_TABLE table=default.Table_61f24832d418408ba2b4d047a1a17174 [id=26b89fa1707a40d4a76366e6a07a4fc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.633986 6275 tablet_bootstrap.cc:492] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.634212 6275 ts_tablet_manager.cc:1397] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.005s
I20260928 10:44:20.635565 6275 raft_consensus.cc:348] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.635883 6275 raft_consensus.cc:374] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.635978 6275 raft_consensus.cc:729] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.633827 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 7c07e1e49f0c41fab20883678afbcef9 (DEFAULT_TABLE table=default.Table_fe7d2b13a5074e87af92cd2b06b01287 [id=b92b0ac4ab5a4cc8bac299f930a45b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.638891 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07e1e49f0c41fab20883678afbcef9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:20.640661 5955 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.642123 5955 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.642836 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0b6f281d104485a7f63bf7de5ece4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.643429 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07e1e49f0c41fab20883678afbcef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.643833 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.643939 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:20.644173 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699848d9a04c40cb89df65d1b1fff0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.644152 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:20.644501 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae733c805ee40479b168638ddc6b3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.644491 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:20.644934 7557 ts_tablet_manager.cc:1918] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.645057 7557 log.cc:1196] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/877e2d1c734a4e2891119f308f9f3ae8
I20260928 10:44:20.645416 7557 ts_tablet_manager.cc:1939] T 877e2d1c734a4e2891119f308f9f3ae8 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.645583 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de0ff28393d479dadb5e2f3e415d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.645961 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d278a6ad7858460f80c7e2bb6cf07f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.647872 5984 tablet_service.cc:1467] Processing CreateTablet for tablet ab5b31555573454b99521a7848e48ffe (DEFAULT_TABLE table=default.Table_bde62a266c834c28b2fdb923a4b93269 [id=2708e291346444c2b8b13a8e25e6fa1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.648692 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5b31555573454b99521a7848e48ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.650542 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9fd04b3d044133adfd01bd677a60b7 (DEFAULT_TABLE table=default.Table_1581845aef95412d8c2bf5c28f4ff2cf [id=853ff81f4130454bb0a79d78bde44c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.650674 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 7e822e9d819b448ab83ab606ed2fd4a2 (DEFAULT_TABLE table=default.Table_de31a65edae9483083c7f278bb1d88aa [id=6e0b48c121834f16991581e87492f1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.650902 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9fd04b3d044133adfd01bd677a60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.651060 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e822e9d819b448ab83ab606ed2fd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.655049 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 27997b34ac484202874d09550ededfb8 (DEFAULT_TABLE table=default.Table_e163f5999dfe49f398e5a3757fd3342c [id=041622549b5d4c97b2967767c19ecce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.655417 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27997b34ac484202874d09550ededfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.657374 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1087) took 2119 ms. Trace:
I20260928 10:44:20.657480 7557 rpcz_store.cc:276] 0928 10:44:18.537598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.538223 (+ 625us) service_pool.cc:227] Handling call
0928 10:44:20.497329 (+1959106us) ts_tablet_manager.cc:1145] Deleting tablet 877e2d1c734a4e2891119f308f9f3ae8
0928 10:44:20.497339 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.536142 (+ 38803us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.644846 (+108704us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.657346 (+ 12500us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954621}
I20260928 10:44:20.658073 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1088) took 2024 ms. Trace:
I20260928 10:44:20.658181 7557 rpcz_store.cc:276] 0928 10:44:18.633516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.633574 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:20.657939 (+2024365us) ts_tablet_manager.cc:1145] Deleting tablet 1fab26669af04128871528af607785f9
0928 10:44:20.657950 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.658054 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2024123}
I20260928 10:44:20.658600 7557 tablet_replica.cc:330] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.659078 5998 tablet_service.cc:1467] Processing CreateTablet for tablet c93d712f68d0481ba9d06859d3801a2d (DEFAULT_TABLE table=default.Table_e6aec6578c9040cd9f2c18255f419558 [id=876e9945a742438aaed16b0bb4dcc610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.659287 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 7f7806f6a7194f649b34805233b3d981 (DEFAULT_TABLE table=default.Table_8bf674c9271c461c9453f493dddc8469 [id=941318ca56a54d0cb8fd3f9937df212e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.659669 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c93d712f68d0481ba9d06859d3801a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.659844 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f7806f6a7194f649b34805233b3d981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.662909 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 6f37298cccf44cb5a997813106d15e56 (DEFAULT_TABLE table=default.Table_601cf51af57b4b9d91d6e9293655f992 [id=725f29fdc5174d47babcfda845de8b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.663276 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f37298cccf44cb5a997813106d15e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.670720 7557 raft_consensus.cc:2229] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.672196 7557 raft_consensus.cc:2258] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.673221 7557 ts_tablet_manager.cc:1905] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.682310 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3518a0da5f498c9fb946a6484716dc (DEFAULT_TABLE table=default.Table_7822dc5c44304c04b64ea25a22ac2363 [id=66d78199972b451b9ccdf44ef7a84150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.682682 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0d0878809846aab7e039aa6e2a0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.684268 6275 consensus_queue.cc:260] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.686085 6275 ts_tablet_manager.cc:1428] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.052s user 0.014s sys 0.002s
I20260928 10:44:20.687816 6275 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.689736 6275 tablet_bootstrap.cc:654] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.682951 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.683311 6002 tablet_service.cc:1467] Processing CreateTablet for tablet e40f3de645114c2382cdfff53c22ce3c (DEFAULT_TABLE table=default.Table_9d69f9b5487145ebbad923d0330e69bd [id=b5bfe5a976ca408ab8136c3024203478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.691340 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b0bc94471ad4608af7a85f27b60af68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.684106 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 948e274977cd4d96b699fe10cfbe4b1a (DEFAULT_TABLE table=default.Table_9ad6a96c2add467eaf16ec5e62390b77 [id=47b851281de64b19870b72c269eccded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.691751 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948e274977cd4d96b699fe10cfbe4b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.694687 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f3de645114c2382cdfff53c22ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.697018 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3518a0da5f498c9fb946a6484716dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.698186 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9fd04b3d044133adfd01bd677a60b7 (DEFAULT_TABLE table=default.Table_1581845aef95412d8c2bf5c28f4ff2cf [id=853ff81f4130454bb0a79d78bde44c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.698316 5860 tablet_service.cc:1467] Processing CreateTablet for tablet ab5b31555573454b99521a7848e48ffe (DEFAULT_TABLE table=default.Table_bde62a266c834c28b2fdb923a4b93269 [id=2708e291346444c2b8b13a8e25e6fa1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.697428 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 495726dac8624c75aa20133c3e2757bc (DEFAULT_TABLE table=default.Table_6c2b98627d6646de9a34fba8f67cc203 [id=739511a472a24fb09e162cc7348b72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.698674 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9fd04b3d044133adfd01bd677a60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.698712 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495726dac8624c75aa20133c3e2757bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.699275 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9fd04b3d044133adfd01bd677a60b7 (DEFAULT_TABLE table=default.Table_1581845aef95412d8c2bf5c28f4ff2cf [id=853ff81f4130454bb0a79d78bde44c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.699985 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 7e822e9d819b448ab83ab606ed2fd4a2 (DEFAULT_TABLE table=default.Table_de31a65edae9483083c7f278bb1d88aa [id=6e0b48c121834f16991581e87492f1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.700730 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 27997b34ac484202874d09550ededfb8 (DEFAULT_TABLE table=default.Table_e163f5999dfe49f398e5a3757fd3342c [id=041622549b5d4c97b2967767c19ecce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.701717 5846 tablet_service.cc:1467] Processing CreateTablet for tablet c93d712f68d0481ba9d06859d3801a2d (DEFAULT_TABLE table=default.Table_e6aec6578c9040cd9f2c18255f419558 [id=876e9945a742438aaed16b0bb4dcc610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.703316 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 7f7806f6a7194f649b34805233b3d981 (DEFAULT_TABLE table=default.Table_8bf674c9271c461c9453f493dddc8469 [id=941318ca56a54d0cb8fd3f9937df212e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.704325 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 6f37298cccf44cb5a997813106d15e56 (DEFAULT_TABLE table=default.Table_601cf51af57b4b9d91d6e9293655f992 [id=725f29fdc5174d47babcfda845de8b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.704814 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3518a0da5f498c9fb946a6484716dc (DEFAULT_TABLE table=default.Table_7822dc5c44304c04b64ea25a22ac2363 [id=66d78199972b451b9ccdf44ef7a84150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.703975 6134 tablet_service.cc:1467] Processing CreateTablet for tablet ab5b31555573454b99521a7848e48ffe (DEFAULT_TABLE table=default.Table_bde62a266c834c28b2fdb923a4b93269 [id=2708e291346444c2b8b13a8e25e6fa1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.705389 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 495726dac8624c75aa20133c3e2757bc (DEFAULT_TABLE table=default.Table_6c2b98627d6646de9a34fba8f67cc203 [id=739511a472a24fb09e162cc7348b72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.705821 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5b31555573454b99521a7848e48ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.706605 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 948e274977cd4d96b699fe10cfbe4b1a (DEFAULT_TABLE table=default.Table_9ad6a96c2add467eaf16ec5e62390b77 [id=47b851281de64b19870b72c269eccded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.707955 5852 tablet_service.cc:1467] Processing CreateTablet for tablet e40f3de645114c2382cdfff53c22ce3c (DEFAULT_TABLE table=default.Table_9d69f9b5487145ebbad923d0330e69bd [id=b5bfe5a976ca408ab8136c3024203478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.709765 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.711879 7557 ts_tablet_manager.cc:1918] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.717337 7557 log.cc:1196] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/3abfedf425b84f679b22d6ca9bef718a
I20260928 10:44:20.719242 6275 tablet_bootstrap.cc:492] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.722723 6275 ts_tablet_manager.cc:1397] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260928 10:44:20.722893 7557 ts_tablet_manager.cc:1939] T 3abfedf425b84f679b22d6ca9bef718a P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.723434 6275 raft_consensus.cc:348] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.728968 6275 raft_consensus.cc:374] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.729094 6275 raft_consensus.cc:729] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:20.728952 5955 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.5.100.125:37939, user_credentials={real_user=slave}} blocked reactor thread for 85464.8us
I20260928 10:44:20.729347 6275 consensus_queue.cc:260] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.729516 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1089) took 2088 ms. Trace:
I20260928 10:44:20.729938 6275 ts_tablet_manager.cc:1428] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 10:44:20.732785 7557 rpcz_store.cc:276] 0928 10:44:18.641398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.641453 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:20.658560 (+2017107us) ts_tablet_manager.cc:1145] Deleting tablet 3abfedf425b84f679b22d6ca9bef718a
0928 10:44:20.658569 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.684205 (+ 25636us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.711751 (+ 27546us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.729495 (+ 17744us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016916}
I20260928 10:44:20.733386 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1092) took 1979 ms. Trace:
I20260928 10:44:20.735059 7557 rpcz_store.cc:276] 0928 10:44:18.753873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.753922 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:20.733253 (+1979331us) ts_tablet_manager.cc:1145] Deleting tablet 45814bb909ed4a15a39a0819973042d2
0928 10:44:20.733264 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.733368 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1979133}
I20260928 10:44:20.735579 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1094) took 1919 ms. Trace:
I20260928 10:44:20.735700 7557 rpcz_store.cc:276] 0928 10:44:18.815950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.816310 (+ 360us) service_pool.cc:227] Handling call
0928 10:44:20.735458 (+1919148us) ts_tablet_manager.cc:1145] Deleting tablet 7fd4f439f1ac4c368f18fc3bc2dacb07
0928 10:44:20.735468 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.735561 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1918955}
I20260928 10:44:20.736179 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1095) took 1920 ms. Trace:
I20260928 10:44:20.736282 7557 rpcz_store.cc:276] 0928 10:44:18.816184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.816540 (+ 356us) service_pool.cc:227] Handling call
0928 10:44:20.736067 (+1919527us) ts_tablet_manager.cc:1145] Deleting tablet cee82663abf948a8a2a36c1676a57a8d
0928 10:44:20.736077 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.736164 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919300}
I20260928 10:44:20.736712 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1097) took 1916 ms. Trace:
I20260928 10:44:20.736845 7557 rpcz_store.cc:276] 0928 10:44:18.820085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.840048 (+ 19963us) service_pool.cc:227] Handling call
0928 10:44:20.736620 (+1896572us) ts_tablet_manager.cc:1145] Deleting tablet 7a3cb198fb3d481eb6bdab29d968144e
0928 10:44:20.736629 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.736698 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895969}
I20260928 10:44:20.737190 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1117) took 1592 ms. Trace:
I20260928 10:44:20.737268 7557 rpcz_store.cc:276] 0928 10:44:19.144315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.144867 (+ 552us) service_pool.cc:227] Handling call
0928 10:44:20.737091 (+1592224us) ts_tablet_manager.cc:1145] Deleting tablet 4297f5d615074e28965ea88204aa007c
0928 10:44:20.737109 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.737177 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1592025}
I20260928 10:44:20.737708 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1118) took 1590 ms. Trace:
I20260928 10:44:20.737830 7557 rpcz_store.cc:276] 0928 10:44:19.147490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.147542 (+ 52us) service_pool.cc:227] Handling call
0928 10:44:20.737618 (+1590076us) ts_tablet_manager.cc:1145] Deleting tablet e94c1f9d646646d88e675d56046c5392
0928 10:44:20.737627 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.737695 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1589885}
I20260928 10:44:20.738278 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1119) took 1578 ms. Trace:
I20260928 10:44:20.738358 7557 rpcz_store.cc:276] 0928 10:44:19.160259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.160325 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:20.738189 (+1577864us) ts_tablet_manager.cc:1145] Deleting tablet 4f5c26637f264087a6d613d63a89238c
0928 10:44:20.738198 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.738266 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1577666}
I20260928 10:44:20.738831 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1120) took 1426 ms. Trace:
I20260928 10:44:20.738971 7557 rpcz_store.cc:276] 0928 10:44:19.311991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.312738 (+ 747us) service_pool.cc:227] Handling call
0928 10:44:20.738741 (+1426003us) ts_tablet_manager.cc:1145] Deleting tablet b508c7a57bf04f4c9d7293a5e8a55935
0928 10:44:20.738750 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.738817 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1264035}
I20260928 10:44:20.740072 5985 tablet_service.cc:1467] Processing CreateTablet for tablet c74fc09932064e6baa73263953287e2f (DEFAULT_TABLE table=default.Table_bc495c395b1e46c8ac5db474e1790b7e [id=08cd347342e644a7b53363919e5a0aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.740571 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74fc09932064e6baa73263953287e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.741703 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8152f4f3d44d2b9a4932e1d6d97970 (DEFAULT_TABLE table=default.Table_a3968544e84b4a68934e7318ddcf78ef [id=44ac9fec02de49b6bd1d822b216c5c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.740504 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 7e822e9d819b448ab83ab606ed2fd4a2 (DEFAULT_TABLE table=default.Table_de31a65edae9483083c7f278bb1d88aa [id=6e0b48c121834f16991581e87492f1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.747539 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8152f4f3d44d2b9a4932e1d6d97970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.747002 6136 tablet_service.cc:1467] Processing CreateTablet for tablet 27997b34ac484202874d09550ededfb8 (DEFAULT_TABLE table=default.Table_e163f5999dfe49f398e5a3757fd3342c [id=041622549b5d4c97b2967767c19ecce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.748584 6136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27997b34ac484202874d09550ededfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.754222 6271 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:20.754644 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e822e9d819b448ab83ab606ed2fd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.754771 6271 ts_tablet_manager.cc:1397] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.484s user 0.014s sys 0.009s
I20260928 10:44:20.757831 6271 raft_consensus.cc:348] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.758914 7557 tablet_replica.cc:330] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.759989 7557 raft_consensus.cc:2229] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.761914 6135 tablet_service.cc:1467] Processing CreateTablet for tablet c93d712f68d0481ba9d06859d3801a2d (DEFAULT_TABLE table=default.Table_e6aec6578c9040cd9f2c18255f419558 [id=876e9945a742438aaed16b0bb4dcc610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.763686 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 6f37298cccf44cb5a997813106d15e56 (DEFAULT_TABLE table=default.Table_601cf51af57b4b9d91d6e9293655f992 [id=725f29fdc5174d47babcfda845de8b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.762897 6130 tablet_service.cc:1467] Processing CreateTablet for tablet 7f7806f6a7194f649b34805233b3d981 (DEFAULT_TABLE table=default.Table_8bf674c9271c461c9453f493dddc8469 [id=941318ca56a54d0cb8fd3f9937df212e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.763774 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c93d712f68d0481ba9d06859d3801a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.764501 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3518a0da5f498c9fb946a6484716dc (DEFAULT_TABLE table=default.Table_7822dc5c44304c04b64ea25a22ac2363 [id=66d78199972b451b9ccdf44ef7a84150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.764576 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f37298cccf44cb5a997813106d15e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.771309 6121 tablet_service.cc:1467] Processing CreateTablet for tablet 495726dac8624c75aa20133c3e2757bc (DEFAULT_TABLE table=default.Table_6c2b98627d6646de9a34fba8f67cc203 [id=739511a472a24fb09e162cc7348b72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.772691 6122 tablet_service.cc:1467] Processing CreateTablet for tablet e40f3de645114c2382cdfff53c22ce3c (DEFAULT_TABLE table=default.Table_9d69f9b5487145ebbad923d0330e69bd [id=b5bfe5a976ca408ab8136c3024203478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.772115 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 948e274977cd4d96b699fe10cfbe4b1a (DEFAULT_TABLE table=default.Table_9ad6a96c2add467eaf16ec5e62390b77 [id=47b851281de64b19870b72c269eccded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.770335 6130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f7806f6a7194f649b34805233b3d981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.773655 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3518a0da5f498c9fb946a6484716dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.773824 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495726dac8624c75aa20133c3e2757bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.777419 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948e274977cd4d96b699fe10cfbe4b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.773520 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 877e2d1c734a4e2891119f308f9f3ae8 (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
W20260928 10:44:20.779590 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1fab26669af04128871528af607785f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fab26669af04128871528af607785f9 already in progress: creating tablet
I20260928 10:44:20.782599 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f3de645114c2382cdfff53c22ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.784547 5957 leader_election.cc:302] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.785074 7642 raft_consensus.cc:2781] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:20.785218 7642 raft_consensus.cc:482] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:20.785326 7642 raft_consensus.cc:3037] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:20.787755 7642 raft_consensus.cc:504] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.788642 7642 leader_election.cc:288] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:20.793097 5854 tablet_service.cc:1467] Processing CreateTablet for tablet c74fc09932064e6baa73263953287e2f (DEFAULT_TABLE table=default.Table_bc495c395b1e46c8ac5db474e1790b7e [id=08cd347342e644a7b53363919e5a0aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.764922 7557 raft_consensus.cc:2258] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.796555 7557 ts_tablet_manager.cc:1905] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.800911 6271 raft_consensus.cc:374] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.801414 6271 raft_consensus.cc:729] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.807736 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet c22cc964ceb741febfd3d1322ae05289 (table default.Table_516bd0195afa484681570b1f84d17ee4 [id=643bd72a41aa4477bc796c4a43eef8ac]). Expected version 2 got 0
I20260928 10:44:20.808063 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:20.808328 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 60f0191c7dd347058749790b4e4159c2 (table default.Table_0eaf0216af2946688678ea2816fef1d1 [id=b708ecbb24f14ccca7c3a7f05b458809]). Expected version 1 got 0
I20260928 10:44:20.808604 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet a229207ce7cc475c8f4492e62d122721 (table default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1]). Expected version 3 got 0
I20260928 10:44:20.810420 7557 ts_tablet_manager.cc:1918] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.810647 7557 log.cc:1196] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4b6db38f77f64cfe9a7802d5307aa949
I20260928 10:44:20.811015 7557 ts_tablet_manager.cc:1939] T 4b6db38f77f64cfe9a7802d5307aa949 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.811779 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1122) took 1268 ms. Trace:
I20260928 10:44:20.811933 7780 raft_consensus.cc:482] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.811869 7557 rpcz_store.cc:276] 0928 10:44:19.543188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.544279 (+ 1091us) service_pool.cc:227] Handling call
0928 10:44:20.758850 (+1214571us) ts_tablet_manager.cc:1145] Deleting tablet 4b6db38f77f64cfe9a7802d5307aa949
0928 10:44:20.758866 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.800482 (+ 41616us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.810300 (+ 9818us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.811753 (+ 1453us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214395}
I20260928 10:44:20.812085 7780 raft_consensus.cc:504] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.812712 7780 leader_election.cc:288] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.813364 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.813903 5817 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.816078 7557 tablet_replica.cc:330] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.803697 6271 consensus_queue.cc:260] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.816401 7557 raft_consensus.cc:2229] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.816962 7557 raft_consensus.cc:2258] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:20.818661 6273 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.024s sys 0.049s
W20260928 10:44:20.819010 6273 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.576s user 0.024s sys 0.049s
W20260928 10:44:20.809530 5955 consensus_peers.cc:487] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bfb47ad184148d595830276bad311dc. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:20.811204 5957 consensus_peers.cc:487] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a3443d4c6674342b4124156414dcc13. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:20.822400 7557 ts_tablet_manager.cc:1905] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.824465 6273 tablet_bootstrap.cc:492] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:20.824810 6273 ts_tablet_manager.cc:1397] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.585s user 0.026s sys 0.051s
I20260928 10:44:20.824848 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:20.828647 7557 ts_tablet_manager.cc:1918] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.826283 6273 raft_consensus.cc:348] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.830111 6273 raft_consensus.cc:374] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.832182 6273 raft_consensus.cc:729] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.836737 7557 log.cc:1196] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/8a3443d4c6674342b4124156414dcc13
I20260928 10:44:20.837404 7557 ts_tablet_manager.cc:1939] T 8a3443d4c6674342b4124156414dcc13 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.843888 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1123) took 1300 ms. Trace:
I20260928 10:44:20.831795 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8152f4f3d44d2b9a4932e1d6d97970 (DEFAULT_TABLE table=default.Table_a3968544e84b4a68934e7318ddcf78ef [id=44ac9fec02de49b6bd1d822b216c5c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:20.845124 7557 rpcz_store.cc:276] 0928 10:44:19.543271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.544477 (+ 1206us) service_pool.cc:227] Handling call
0928 10:44:20.816016 (+1271539us) ts_tablet_manager.cc:1145] Deleting tablet 8a3443d4c6674342b4124156414dcc13
0928 10:44:20.816031 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.825557 (+ 9526us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.828535 (+ 2978us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.843857 (+ 15322us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271421}
I20260928 10:44:20.845821 7557 tablet_replica.cc:330] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.846463 7557 raft_consensus.cc:2229] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.848467 7557 raft_consensus.cc:2258] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:20.849659 7557 ts_tablet_manager.cc:1905] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.846581 6273 consensus_queue.cc:260] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.854267 6273 ts_tablet_manager.cc:1428] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260928 10:44:20.854609 6273 tablet_bootstrap.cc:492] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:20.864934 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 95fd004a4f724ae5bb285af67218d8d7
I20260928 10:44:20.867329 7557 ts_tablet_manager.cc:1918] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:20.869347 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_513b29114e86449fbb9605c07529bc8a" } new_table_name: "default.Table_73c593df274f42e48a647af073da854a" modify_external_catalogs: true
I20260928 10:44:20.872496 7557 log.cc:1196] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/15f3f3bff84a416494431a19887bb88d
I20260928 10:44:20.874187 7557 ts_tablet_manager.cc:1939] T 15f3f3bff84a416494431a19887bb88d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.875180 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1124) took 1331 ms. Trace:
I20260928 10:44:20.875615 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3c2046ebde9440e8a5ce572172366877
I20260928 10:44:20.879222 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2046ebde9440e8a5ce572172366877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.879459 7557 rpcz_store.cc:276] 0928 10:44:19.543347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.544597 (+ 1250us) service_pool.cc:227] Handling call
0928 10:44:20.845766 (+1301169us) ts_tablet_manager.cc:1145] Deleting tablet 15f3f3bff84a416494431a19887bb88d
0928 10:44:20.845778 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.853374 (+ 7596us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.867214 (+ 13840us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:20.875160 (+ 7946us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1301075}
I20260928 10:44:20.880152 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c653071d01e1479ead4bc5dc60b2417b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.880362 6275 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:20.880399 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1126) took 1299 ms. Trace:
I20260928 10:44:20.880481 7557 rpcz_store.cc:276] 0928 10:44:19.581131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.581175 (+ 44us) service_pool.cc:227] Handling call
0928 10:44:20.880270 (+1299095us) ts_tablet_manager.cc:1145] Deleting tablet 581f97bde63a48f0815b61e678890438
0928 10:44:20.880283 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.880384 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298901}
W20260928 10:44:20.880726 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c653071d01e1479ead4bc5dc60b2417b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.881321 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1127) took 1299 ms. Trace:
I20260928 10:44:20.881392 7557 rpcz_store.cc:276] 0928 10:44:19.581941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.582503 (+ 562us) service_pool.cc:227] Handling call
0928 10:44:20.881229 (+1298726us) ts_tablet_manager.cc:1145] Deleting tablet a61f862ae0da4763802ca3b28d5e2756
0928 10:44:20.881238 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.881309 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298560}
I20260928 10:44:20.881660 6275 tablet_bootstrap.cc:654] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.882128 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1125) took 1301 ms. Trace:
I20260928 10:44:20.882457 7557 rpcz_store.cc:276] 0928 10:44:19.581031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.583538 (+ 2507us) service_pool.cc:227] Handling call
0928 10:44:20.882042 (+1298504us) ts_tablet_manager.cc:1145] Deleting tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b
0928 10:44:20.882051 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.882114 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298338}
I20260928 10:44:20.883121 7557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45886 (request call id 1128) took 1299 ms. Trace:
I20260928 10:44:20.883460 7557 rpcz_store.cc:276] 0928 10:44:19.584031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.585595 (+ 1564us) service_pool.cc:227] Handling call
0928 10:44:20.883030 (+1297435us) ts_tablet_manager.cc:1145] Deleting tablet f4e984fec74147a8af24c4cf9dfa3284
0928 10:44:20.883040 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.883108 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297188}
W20260928 10:44:20.888118 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9daef33708ad4eae9b45282d120c87aa consensus state has no leader
I20260928 10:44:20.888337 7557 tablet_replica.cc:330] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:20.888649 7557 raft_consensus.cc:2229] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:20.889074 7557 raft_consensus.cc:2258] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:20.890921 5818 leader_election.cc:341] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.891301 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_439f0236567640e5821b851bc1deff18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.891852 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_439f0236567640e5821b851bc1deff18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.892243 7557 ts_tablet_manager.cc:1905] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:20.893252 5955 leader_election.cc:341] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.899417 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 495726dac8624c75aa20133c3e2757bc
I20260928 10:44:20.900615 5818 leader_election.cc:302] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.901026 7780 raft_consensus.cc:2726] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.901499 5818 leader_election.cc:341] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.901811 7780 raft_consensus.cc:482] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.902438 7780 raft_consensus.cc:504] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.903086 7780 leader_election.cc:288] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.903893 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.904017 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 495726dac8624c75aa20133c3e2757bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:20.904663 5817 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.904773 5700 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7718e29c75cb41aa8192e35389ac9259" } new_table_name: "default.Table_8efd871139c84e1fadace980a7742a81" modify_external_catalogs: true
I20260928 10:44:20.904879 5818 leader_election.cc:302] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.905102 7780 raft_consensus.cc:2726] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.915522 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c5a49133468840e6b7bed0126dd2182f
I20260928 10:44:20.921168 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet c5a49133468840e6b7bed0126dd2182f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:20.922246 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_470f4fe8be5342abb2ee95bdae94c7eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.922897 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_470f4fe8be5342abb2ee95bdae94c7eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.929170 7557 ts_tablet_manager.cc:1918] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.935742 7557 log.cc:1196] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4082931c332f40fc9c6530190fb61017
W20260928 10:44:20.935770 5686 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 155607us
I20260928 10:44:20.936443 7557 ts_tablet_manager.cc:1939] T 4082931c332f40fc9c6530190fb61017 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.936472 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 3abfedf425b84f679b22d6ca9bef718a (table default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]) successfully deleted
W20260928 10:44:20.936807 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 45814bb909ed4a15a39a0819973042d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45814bb909ed4a15a39a0819973042d2 already in progress: creating tablet
W20260928 10:44:20.937099 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 already in progress: creating tablet
W20260928 10:44:20.937337 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet cee82663abf948a8a2a36c1676a57a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cee82663abf948a8a2a36c1676a57a8d already in progress: creating tablet
W20260928 10:44:20.937564 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7a3cb198fb3d481eb6bdab29d968144e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a3cb198fb3d481eb6bdab29d968144e already in progress: creating tablet
W20260928 10:44:20.938012 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4297f5d615074e28965ea88204aa007c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4297f5d615074e28965ea88204aa007c already in progress: creating tablet
W20260928 10:44:20.938544 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e94c1f9d646646d88e675d56046c5392 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e94c1f9d646646d88e675d56046c5392 already in progress: creating tablet
I20260928 10:44:20.939872 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_09ec888b149b43dfa3ba5489a26b50cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:20.940196 7557 tablet_replica.cc:330] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:20.939591 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4f5c26637f264087a6d613d63a89238c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f5c26637f264087a6d613d63a89238c already in progress: creating tablet
I20260928 10:44:20.940389 7557 raft_consensus.cc:2229] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:20.940531 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09ec888b149b43dfa3ba5489a26b50cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.940548 7557 raft_consensus.cc:2258] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:20.941169 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet b508c7a57bf04f4c9d7293a5e8a55935 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b508c7a57bf04f4c9d7293a5e8a55935 already in progress: creating tablet
I20260928 10:44:20.942974 7557 ts_tablet_manager.cc:1905] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:20.945112 7830 raft_consensus.cc:482] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.945286 7830 raft_consensus.cc:504] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.945979 7830 leader_election.cc:288] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.946791 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:20.947464 5817 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:20.948017 5818 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.948181 5818 leader_election.cc:302] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.948465 7780 raft_consensus.cc:2726] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.948829 5818 leader_election.cc:341] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:20.948997 5818 leader_election.cc:302] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.949347 7780 raft_consensus.cc:2726] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 10:44:20.949668 5818 leader_election.cc:341] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:20.949811 5818 leader_election.cc:302] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.950086 7780 raft_consensus.cc:2726] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 10:44:20.950794 5818 leader_election.cc:341] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.950959 5818 leader_election.cc:302] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.951388 7780 raft_consensus.cc:2726] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.951932 5818 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.952186 5818 leader_election.cc:302] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.952600 7780 raft_consensus.cc:2726] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:20.953152 5818 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.953402 5818 leader_election.cc:302] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:20.954088 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2d51090c170b44e3b63687c6c0a60ccc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:20.954777 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d51090c170b44e3b63687c6c0a60ccc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:20.956022 7780 raft_consensus.cc:2726] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:20.957327 6271 ts_tablet_manager.cc:1428] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.202s user 0.003s sys 0.001s
I20260928 10:44:20.957917 6271 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:20.960387 5850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e68a9aa11fe4b048f5ca6ba6e5c5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.960762 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74fc09932064e6baa73263953287e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.960959 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495726dac8624c75aa20133c3e2757bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.961129 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3518a0da5f498c9fb946a6484716dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.961292 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f7806f6a7194f649b34805233b3d981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.962586 5848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c07e1e49f0c41fab20883678afbcef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.963016 7780 raft_consensus.cc:482] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.963132 7780 raft_consensus.cc:504] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:20.963657 7780 leader_election.cc:288] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:20.964095 7557 ts_tablet_manager.cc:1918] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:20.964201 7557 log.cc:1196] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/463cf5ecb52d40069b564698433c6781
I20260928 10:44:20.964277 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:20.964421 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40f3de645114c2382cdfff53c22ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.964509 7557 ts_tablet_manager.cc:1939] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:20.964823 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab5b31555573454b99521a7848e48ffe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:20.964843 5817 leader_election.cc:341] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:20.965241 6273 tablet_bootstrap.cc:654] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:20.970016 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.970188 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2046ebde9440e8a5ce572172366877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.970304 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet 495726dac8624c75aa20133c3e2757bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.970417 5848 tablet_service.cc:1514] Processing DeleteTablet for tablet c5a49133468840e6b7bed0126dd2182f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:20.970590 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f37298cccf44cb5a997813106d15e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.973932 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b0bc94471ad4608af7a85f27b60af68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.977833 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948e274977cd4d96b699fe10cfbe4b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.982570 7844 raft_consensus.cc:482] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:20.982731 7844 raft_consensus.cc:504] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.983319 7844 leader_election.cc:288] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:20.983538 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c93d712f68d0481ba9d06859d3801a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.985504 6275 tablet_bootstrap.cc:492] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:20.985620 6275 ts_tablet_manager.cc:1397] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.105s user 0.006s sys 0.006s
I20260928 10:44:20.986061 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9fd04b3d044133adfd01bd677a60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.986214 6275 raft_consensus.cc:348] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.986398 6275 raft_consensus.cc:374] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:20.986450 6275 raft_consensus.cc:729] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:20.986691 6275 consensus_queue.cc:260] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:20.987257 6275 ts_tablet_manager.cc:1428] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 10:44:20.990492 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 735e4f4e5b38447d8f705879796c3dd8 consensus state has no leader
I20260928 10:44:20.990948 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e822e9d819b448ab83ab606ed2fd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.993461 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ab3cfb6419ef479580e7915b4fe6b5af" } new_table_name: "default.Table_796c63c1570b49e2a468d58d4db936e7" modify_external_catalogs: true
I20260928 10:44:21.000864 7845 raft_consensus.cc:482] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.001012 7845 raft_consensus.cc:504] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.001600 7845 leader_election.cc:288] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:21.002545 6090 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:21.002872 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8152f4f3d44d2b9a4932e1d6d97970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.003029 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_aed3c43316044362b92d3639149bff4b" } new_table_name: "default.Table_1b8c1d7a389a4199a6f20c6752805cb4" modify_external_catalogs: true
I20260928 10:44:21.003530 5861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de0ff28393d479dadb5e2f3e415d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.011657 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699848d9a04c40cb89df65d1b1fff0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.012414 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0b6f281d104485a7f63bf7de5ece4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.012914 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27997b34ac484202874d09550ededfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:20.983816 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b7e26971914613a2372476b348b702" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.014328 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.015555 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db9adcd0bc9a4b4e90425535a5c52a58" } modify_external_catalogs: true
I20260928 10:44:21.015808 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db9adcd0bc9a4b4e90425535a5c52a58" } modify_external_catalogs: true
I20260928 10:44:21.019546 7844 raft_consensus.cc:482] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.019731 7844 raft_consensus.cc:504] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.020358 7844 leader_election.cc:288] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.023700 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.036449 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_c0c247e880824b72955c2de0507d21c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.037030 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0c247e880824b72955c2de0507d21c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:21.046270 7854 log.cc:924] Time spent T 60f0191c7dd347058749790b4e4159c2 P 2f6ffbf4f0534383bf89d15aa37e3027: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260928 10:44:21.049230 6270 ts_tablet_manager.cc:1918] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.055667 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 49c40696fe8645de9b639d2293f41403 (table default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e]). Expected version 2 got 0
I20260928 10:44:21.055944 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3b2cabf659dc48028605b39c92e1e451 (table default.Table_7718e29c75cb41aa8192e35389ac9259 [id=3daf4c7bcf784fb0948e743ecec939ed]). Expected version 1 got 0
I20260928 10:44:21.056473 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5afe4501ea584d44b511b89983e210e3 (table default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73]). Expected version 1 got 0
I20260928 10:44:21.057181 5695 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_0eaf0216af2946688678ea2816fef1d1 [id=b708ecbb24f14ccca7c3a7f05b458809] alter complete (version 1)
I20260928 10:44:21.057525 6275 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:21.059499 6275 tablet_bootstrap.cc:654] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:21.059934 5700 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b2cabf659dc48028605b39c92e1e451 consensus state has no leader
I20260928 10:44:21.060276 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e22a551121d4d6abb7f43b4bb4d6e06 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:21.060514 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4b6db38f77f64cfe9a7802d5307aa949 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]) successfully deleted
I20260928 10:44:21.060789 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 8a3443d4c6674342b4124156414dcc13 (table default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]) successfully deleted
I20260928 10:44:21.061025 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]) successfully deleted
W20260928 10:44:21.061295 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 581f97bde63a48f0815b61e678890438 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581f97bde63a48f0815b61e678890438 already in progress: creating tablet
W20260928 10:44:21.061568 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a61f862ae0da4763802ca3b28d5e2756 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61f862ae0da4763802ca3b28d5e2756 already in progress: creating tablet
W20260928 10:44:21.061818 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b already in progress: creating tablet
W20260928 10:44:21.062881 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet f4e984fec74147a8af24c4cf9dfa3284 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e984fec74147a8af24c4cf9dfa3284 already in progress: creating tablet
W20260928 10:44:21.063145 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c44e7c9d47c24c899ec65d6e7dd9f391 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44e7c9d47c24c899ec65d6e7dd9f391 already in progress: creating tablet
W20260928 10:44:21.063374 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 18269ece430f46cba7e926b579ac33a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18269ece430f46cba7e926b579ac33a1 already in progress: creating tablet
I20260928 10:44:21.063650 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 15a54716fb13451994f3a56b98a7230b (DEFAULT_TABLE table=default.Table_ce114bd8e056414eb38914cbfbaa5c21 [id=a2d5d2a08b6e4c2180ee7ddb6cac4cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.064286 5860 tablet_service.cc:1467] Processing CreateTablet for tablet a91d1629608e4bd18d9231d13e373e04 (DEFAULT_TABLE table=default.Table_42d9ac5604184e359e5bb0ad2aa34852 [id=f34bfabee7c94ada801a5e74fc346a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.064762 5855 tablet_service.cc:1467] Processing CreateTablet for tablet def646cc507541e69ed2c7cab70c9cf3 (DEFAULT_TABLE table=default.Table_ef1d4e568ea4410aae673078c4915f63 [id=f005451fa521496583869c2d89f76daf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:21.049666 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 227024us
I20260928 10:44:21.050565 6271 tablet_bootstrap.cc:654] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:21.050732 7841 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.006s sys 0.009s
W20260928 10:44:21.065738 7841 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s user 0.006s sys 0.009s
I20260928 10:44:21.066515 6270 log.cc:1196] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4b6db38f77f64cfe9a7802d5307aa949
I20260928 10:44:21.067018 6270 ts_tablet_manager.cc:1939] T 4b6db38f77f64cfe9a7802d5307aa949 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:21.067826 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1034) took 4519 ms. Trace:
I20260928 10:44:21.067974 6270 rpcz_store.cc:276] 0928 10:44:16.548399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.548442 (+ 43us) service_pool.cc:227] Handling call
0928 10:44:20.379411 (+3830969us) ts_tablet_manager.cc:1145] Deleting tablet 4b6db38f77f64cfe9a7802d5307aa949
0928 10:44:20.379424 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.960328 (+580904us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.049110 (+ 88782us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.067805 (+ 18695us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3830808}
I20260928 10:44:21.068420 6270 tablet_replica.cc:330] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:21.068679 6270 raft_consensus.cc:2229] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:21.069063 6270 raft_consensus.cc:2258] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.071290 5857 tablet_service.cc:1467] Processing CreateTablet for tablet bb122e04165748d98570b7b042afa37d (DEFAULT_TABLE table=default.Table_7917f71e8bad497482a52f085eb60b7a [id=cd0cbc5271e14ca785d89ad90e6d865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.071847 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 0852f0e8b33f4561bdc7fa273dc25d44 (DEFAULT_TABLE table=default.Table_37ef5e4706fa4906985ebd6d4b2396c5 [id=a62652ec58984383a564d116e6b11243]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:21.072026 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 118900us
W20260928 10:44:21.072304 5818 leader_election.cc:341] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.072464 5818 leader_election.cc:302] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.072729 7780 raft_consensus.cc:2726] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:21.073179 5818 leader_election.cc:341] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.073632 5818 leader_election.cc:302] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.073750 7844 raft_consensus.cc:482] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.073915 7780 raft_consensus.cc:2726] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.073940 7844 raft_consensus.cc:504] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.074649 7844 leader_election.cc:288] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.076361 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 9d48c9d689f14ee789e6702373e88b49 (DEFAULT_TABLE table=default.Table_7aeda95dfe514ed09635b9e5db9389af [id=d4865f8d9f1e4a0f8c16252375311f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.081928 6269 ts_tablet_manager.cc:1918] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:21.082172 6269 log.cc:1196] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/75e19b8189894e91a8be5a150f54cb6b
I20260928 10:44:21.082610 6269 ts_tablet_manager.cc:1939] T 75e19b8189894e91a8be5a150f54cb6b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:21.085897 5854 tablet_service.cc:1467] Processing CreateTablet for tablet d1ec2341f8d047bf9487b7808e4f723b (DEFAULT_TABLE table=default.Table_b2c9214a568c4660b326618ee5d9b23c [id=df06bb2f00e74f51bb8a9429a2be9931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.086385 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ec2341f8d047bf9487b7808e4f723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.088873 7765 catalog_manager.cc:1259] Loaded cluster ID: d8fef7b33cab4615b13ae7bbac9dc27a
I20260928 10:44:21.090305 5847 tablet_service.cc:1467] Processing CreateTablet for tablet 8735b36bd56e41629089437b5d92c793 (DEFAULT_TABLE table=default.Table_46cd6f3ff6a044d0a67fb51c668012df [id=5f30b4ebbdda438487d5d1c6cc788cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.090758 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8735b36bd56e41629089437b5d92c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.090718 5852 tablet_service.cc:1467] Processing CreateTablet for tablet 0821f14657fe4a7bac8eec4ade19063c (DEFAULT_TABLE table=default.Table_2deeaf0a2af646009edec76f39b81a1e [id=c15d77b7a49d49b99af67d7b7ce3b613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.091202 5852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0821f14657fe4a7bac8eec4ade19063c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.091713 7765 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: loading cluster ID for follower catalog manager: success
I20260928 10:44:21.095813 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 898) took 8910 ms. Trace:
I20260928 10:44:21.109409 6269 rpcz_store.cc:276] 0928 10:44:12.184875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.197561 (+ 12686us) service_pool.cc:227] Handling call
0928 10:44:20.449048 (+8251487us) ts_tablet_manager.cc:1145] Deleting tablet 75e19b8189894e91a8be5a150f54cb6b
0928 10:44:20.449067 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:20.934736 (+485669us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.081797 (+147061us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.095790 (+ 13993us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8251080}
W20260928 10:44:21.073853 5955 consensus_peers.cc:487] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4082931c332f40fc9c6530190fb61017. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.075062 5983 tablet_service.cc:1467] Processing CreateTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 (DEFAULT_TABLE table=default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3 [id=682a79b5405c44708deedcbfe7386d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.075598 5994 tablet_service.cc:1467] Processing CreateTablet for tablet bb122e04165748d98570b7b042afa37d (DEFAULT_TABLE table=default.Table_7917f71e8bad497482a52f085eb60b7a [id=cd0cbc5271e14ca785d89ad90e6d865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.111069 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff01c1c1ed72488791827c5aa57f1de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.111282 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb122e04165748d98570b7b042afa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.076097 6002 tablet_service.cc:1467] Processing CreateTablet for tablet a91d1629608e4bd18d9231d13e373e04 (DEFAULT_TABLE table=default.Table_42d9ac5604184e359e5bb0ad2aa34852 [id=f34bfabee7c94ada801a5e74fc346a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.112042 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91d1629608e4bd18d9231d13e373e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.076422 5992 tablet_service.cc:1467] Processing CreateTablet for tablet def646cc507541e69ed2c7cab70c9cf3 (DEFAULT_TABLE table=default.Table_ef1d4e568ea4410aae673078c4915f63 [id=f005451fa521496583869c2d89f76daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.114777 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def646cc507541e69ed2c7cab70c9cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.076699 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 0852f0e8b33f4561bdc7fa273dc25d44 (DEFAULT_TABLE table=default.Table_37ef5e4706fa4906985ebd6d4b2396c5 [id=a62652ec58984383a564d116e6b11243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.118332 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0852f0e8b33f4561bdc7fa273dc25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.076890 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb5eed4318fe482789fee32e24a49bfc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.122619 6013 raft_consensus.cc:2454] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:21.122792 7844 raft_consensus.cc:482] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.122924 7844 raft_consensus.cc:504] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.123551 7844 leader_election.cc:288] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.077255 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 15a54716fb13451994f3a56b98a7230b (DEFAULT_TABLE table=default.Table_ce114bd8e056414eb38914cbfbaa5c21 [id=a2d5d2a08b6e4c2180ee7ddb6cac4cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.126154 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15a54716fb13451994f3a56b98a7230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.078217 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 9d48c9d689f14ee789e6702373e88b49 (DEFAULT_TABLE table=default.Table_7aeda95dfe514ed09635b9e5db9389af [id=d4865f8d9f1e4a0f8c16252375311f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.127908 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d48c9d689f14ee789e6702373e88b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.082192 7860 raft_consensus.cc:482] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.130594 7860 raft_consensus.cc:504] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.131237 7860 leader_election.cc:288] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:21.134313 6090 leader_election.cc:302] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:21.134626 6090 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 2ab439922c6e4ffea8d8cdb6b7d8d8d7
W20260928 10:44:21.086901 7514 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.003s sys 0.013s
W20260928 10:44:21.134841 7514 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s user 0.003s sys 0.013s
I20260928 10:44:21.134846 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75539c390965493eaa69a0d1215fa922" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.135514 7819 tablet.cc:1722] T 28efefe228f24b01914e0d43be5061ce P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:21.137228 5955 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.137672 7844 raft_consensus.cc:2781] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.137763 7844 raft_consensus.cc:482] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.137822 7844 raft_consensus.cc:3037] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.138361 7868 tablet.cc:1722] T 28efefe228f24b01914e0d43be5061ce P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:21.140281 7844 raft_consensus.cc:504] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.141822 7844 leader_election.cc:288] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.144032 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb5eed4318fe482789fee32e24a49bfc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:21.144234 6013 raft_consensus.cc:3037] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.148176 6013 raft_consensus.cc:2454] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:21.148608 6090 leader_election.cc:302] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:21.148991 7844 raft_consensus.cc:2781] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.149516 7844 raft_consensus.cc:686] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:21.149837 7844 consensus_queue.cc:237] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.153471 6271 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.153630 6271 ts_tablet_manager.cc:1397] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.196s user 0.007s sys 0.003s
I20260928 10:44:21.154420 6271 raft_consensus.cc:348] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.154743 6271 raft_consensus.cc:374] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.154798 6271 raft_consensus.cc:729] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.154982 6271 consensus_queue.cc:260] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.155544 6271 ts_tablet_manager.cc:1428] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 10:44:21.155736 5686 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 92358us
W20260928 10:44:21.156003 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1f9fc7685a7541219b7207dc38b604e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f9fc7685a7541219b7207dc38b604e0 already in progress: creating tablet
I20260928 10:44:21.077698 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4b6db38f77f64cfe9a7802d5307aa949 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]) successfully deleted
I20260928 10:44:21.116238 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8e019ec2519e45338c6a0386f8e239de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.156525 6271 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:21.156653 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e019ec2519e45338c6a0386f8e239de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.116721 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f068c7091ed046a3a26e05f97bae4713"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.158156 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f068c7091ed046a3a26e05f97bae4713 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.158284 6271 tablet_bootstrap.cc:654] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.130265 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51fa060d9bae490292fbd4d249570f9e" } modify_external_catalogs: true
I20260928 10:44:21.158607 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_51fa060d9bae490292fbd4d249570f9e" } modify_external_catalogs: true
I20260928 10:44:21.160023 6270 ts_tablet_manager.cc:1905] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.166245 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 899) took 8845 ms. Trace:
I20260928 10:44:21.166338 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 75e19b8189894e91a8be5a150f54cb6b (table default.Table_516bd0195afa484681570b1f84d17ee4 [id=643bd72a41aa4477bc796c4a43eef8ac]) successfully deleted
W20260928 10:44:21.166360 5687 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 88667.7us
I20260928 10:44:21.167598 5957 leader_election.cc:302] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.168040 5957 leader_election.cc:302] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:21.168126 6091 leader_election.cc:341] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 463cf5ecb52d40069b564698433c6781
I20260928 10:44:21.168246 6091 leader_election.cc:302] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.168344 5957 leader_election.cc:302] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:21.168383 6091 raft_consensus.cc:2670] T 463cf5ecb52d40069b564698433c6781 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:21.168620 5957 leader_election.cc:302] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:21.168967 6091 leader_election.cc:341] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 85583238d6b54f1d89ff5b53b40e73bb
I20260928 10:44:21.169070 6091 leader_election.cc:302] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.169361 7845 raft_consensus.cc:2726] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.169697 7841 raft_consensus.cc:2781] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.169782 7841 raft_consensus.cc:482] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.169848 7841 raft_consensus.cc:3037] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.169849 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.172369 7841 raft_consensus.cc:504] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.172920 7841 leader_election.cc:288] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.173067 7841 raft_consensus.cc:2781] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.173125 7841 raft_consensus.cc:482] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.173177 7841 raft_consensus.cc:3037] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.174606 7840 raft_consensus.cc:2781] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.174712 7840 raft_consensus.cc:686] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:21.174911 7840 consensus_queue.cc:237] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.175808 7782 raft_consensus.cc:2781] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.175899 7782 raft_consensus.cc:686] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:21.176093 7782 consensus_queue.cc:237] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.177242 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.177587 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.180598 6275 tablet_bootstrap.cc:492] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:21.180725 6275 ts_tablet_manager.cc:1397] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
I20260928 10:44:21.181398 6275 raft_consensus.cc:348] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.181594 6275 raft_consensus.cc:374] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.181639 6275 raft_consensus.cc:729] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.181829 6275 consensus_queue.cc:260] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.182430 6275 ts_tablet_manager.cc:1428] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:21.182700 6275 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:21.156200 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a658dce02ff740f086774aa44aef9fb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a658dce02ff740f086774aa44aef9fb8 already in progress: creating tablet
I20260928 10:44:21.183306 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]) successfully deleted
I20260928 10:44:21.183497 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 463cf5ecb52d40069b564698433c6781 (table default.Table_2e92501b07184f8d9021b31cc4f752fb [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
I20260928 10:44:21.184193 6275 tablet_bootstrap.cc:654] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.166359 6269 rpcz_store.cc:276] 0928 10:44:12.320429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.325757 (+ 5328us) service_pool.cc:227] Handling call
0928 10:44:21.166095 (+8840338us) ts_tablet_manager.cc:1145] Deleting tablet b257d722a42e44f4ac554b1ebe7d8e31
0928 10:44:21.166108 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.166222 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8840125}
I20260928 10:44:21.186919 6269 tablet_replica.cc:330] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:21.187120 6269 raft_consensus.cc:2229] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:21.187126 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b257d722a42e44f4ac554b1ebe7d8e31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b257d722a42e44f4ac554b1ebe7d8e31 already in progress: creating tablet
I20260928 10:44:21.187279 6269 raft_consensus.cc:2258] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.187829 6269 ts_tablet_manager.cc:1905] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.188059 6136 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2046ebde9440e8a5ce572172366877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.188270 6130 tablet_service.cc:1514] Processing DeleteTablet for tablet 495726dac8624c75aa20133c3e2757bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.188423 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet c5a49133468840e6b7bed0126dd2182f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.188778 6126 tablet_service.cc:1467] Processing CreateTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 (DEFAULT_TABLE table=default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3 [id=682a79b5405c44708deedcbfe7386d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.189157 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff01c1c1ed72488791827c5aa57f1de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.190743 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 15a54716fb13451994f3a56b98a7230b (DEFAULT_TABLE table=default.Table_ce114bd8e056414eb38914cbfbaa5c21 [id=a2d5d2a08b6e4c2180ee7ddb6cac4cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.191129 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15a54716fb13451994f3a56b98a7230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.194727 6121 tablet_service.cc:1467] Processing CreateTablet for tablet def646cc507541e69ed2c7cab70c9cf3 (DEFAULT_TABLE table=default.Table_ef1d4e568ea4410aae673078c4915f63 [id=f005451fa521496583869c2d89f76daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.194902 6133 tablet_service.cc:1467] Processing CreateTablet for tablet 0821f14657fe4a7bac8eec4ade19063c (DEFAULT_TABLE table=default.Table_2deeaf0a2af646009edec76f39b81a1e [id=c15d77b7a49d49b99af67d7b7ce3b613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.195091 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def646cc507541e69ed2c7cab70c9cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.195251 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0821f14657fe4a7bac8eec4ade19063c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.195533 6120 tablet_service.cc:1467] Processing CreateTablet for tablet bb122e04165748d98570b7b042afa37d (DEFAULT_TABLE table=default.Table_7917f71e8bad497482a52f085eb60b7a [id=cd0cbc5271e14ca785d89ad90e6d865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.195822 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb122e04165748d98570b7b042afa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.198800 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 0852f0e8b33f4561bdc7fa273dc25d44 (DEFAULT_TABLE table=default.Table_37ef5e4706fa4906985ebd6d4b2396c5 [id=a62652ec58984383a564d116e6b11243]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:21.199080 6091 leader_election.cc:341] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 00b7e26971914613a2372476b348b702
I20260928 10:44:21.199213 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0852f0e8b33f4561bdc7fa273dc25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.199196 6091 leader_election.cc:302] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:21.199530 6091 leader_election.cc:341] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:21.199612 6091 leader_election.cc:302] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.200657 7845 raft_consensus.cc:2726] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.200803 7845 raft_consensus.cc:2726] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.198800 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 8735b36bd56e41629089437b5d92c793 (DEFAULT_TABLE table=default.Table_46cd6f3ff6a044d0a67fb51c668012df [id=5f30b4ebbdda438487d5d1c6cc788cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.201267 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8735b36bd56e41629089437b5d92c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.202808 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 9d48c9d689f14ee789e6702373e88b49 (DEFAULT_TABLE table=default.Table_7aeda95dfe514ed09635b9e5db9389af [id=d4865f8d9f1e4a0f8c16252375311f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.203161 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d48c9d689f14ee789e6702373e88b49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:21.203506 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3c2046ebde9440e8a5ce572172366877 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2046ebde9440e8a5ce572172366877 already in progress: creating tablet
W20260928 10:44:21.203749 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 495726dac8624c75aa20133c3e2757bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495726dac8624c75aa20133c3e2757bc already in progress: creating tablet
W20260928 10:44:21.203914 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c5a49133468840e6b7bed0126dd2182f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5a49133468840e6b7bed0126dd2182f already in progress: creating tablet
I20260928 10:44:21.206820 6125 tablet_service.cc:1467] Processing CreateTablet for tablet d1ec2341f8d047bf9487b7808e4f723b (DEFAULT_TABLE table=default.Table_b2c9214a568c4660b326618ee5d9b23c [id=df06bb2f00e74f51bb8a9429a2be9931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.207192 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ec2341f8d047bf9487b7808e4f723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.210834 6124 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf072f0c3541c0bb95e1e95fd6c435 (DEFAULT_TABLE table=default.Table_343bbafe328a46faafe00161524633ef [id=a1c57de04b1747b0a5a19ba61fdb5911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.211251 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf072f0c3541c0bb95e1e95fd6c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.214597 7830 raft_consensus.cc:482] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.214758 7830 raft_consensus.cc:504] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.215394 7830 leader_election.cc:288] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:21.215533 7830 raft_consensus.cc:482] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.215633 7830 raft_consensus.cc:504] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.216125 7830 leader_election.cc:288] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:21.217967 6270 ts_tablet_manager.cc:1918] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.218171 6270 log.cc:1196] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4bfb47ad184148d595830276bad311dc
I20260928 10:44:21.218838 6270 ts_tablet_manager.cc:1939] T 4bfb47ad184148d595830276bad311dc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:21.218312 6271 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.194733 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecfed72c46c439f8092720eb3025d3f (DEFAULT_TABLE table=default.Table_8edf4e5a87cb491f959adf009c1d0d0a [id=0baf9e8221ae4ef1b2f9a53b11a13b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.219521 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecfed72c46c439f8092720eb3025d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.221376 5521 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu pid 6329
I20260928 10:44:21.220835 6271 ts_tablet_manager.cc:1397] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.005s
I20260928 10:44:21.169643 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.226699 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1035) took 4677 ms. Trace:
I20260928 10:44:21.231669 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:21.232326 5955 leader_election.cc:341] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.231658 6271 raft_consensus.cc:348] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.234678 6271 raft_consensus.cc:374] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.235491 6271 raft_consensus.cc:729] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.238389 6129 tablet_service.cc:1467] Processing CreateTablet for tablet a91d1629608e4bd18d9231d13e373e04 (DEFAULT_TABLE table=default.Table_42d9ac5604184e359e5bb0ad2aa34852 [id=f34bfabee7c94ada801a5e74fc346a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.238837 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91d1629608e4bd18d9231d13e373e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.238430 6271 consensus_queue.cc:260] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.244254 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c322d11fab43499f82e077fd8a8c02f3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:21.244992 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 45457.1us
W20260928 10:44:21.245311 6091 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:21.245905 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.246541 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.247335 5817 leader_election.cc:341] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.246613 6271 ts_tablet_manager.cc:1428] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.024s user 0.001s sys 0.003s
W20260928 10:44:21.247745 5817 leader_election.cc:341] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:21.248155 5817 consensus_peers.cc:487] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76a47129ab5444dcab0a3f92a16046db. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.250545 6271 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.226891 6270 rpcz_store.cc:276] 0928 10:44:16.548817 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.548860 (+ 43us) service_pool.cc:227] Handling call
0928 10:44:21.068373 (+4519513us) ts_tablet_manager.cc:1145] Deleting tablet 4bfb47ad184148d595830276bad311dc
0928 10:44:21.068384 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.163976 (+ 95592us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.217764 (+ 53788us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.226647 (+ 8883us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4519370}
I20260928 10:44:21.255908 6275 tablet_bootstrap.cc:492] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:21.256199 6275 ts_tablet_manager.cc:1397] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.000s
I20260928 10:44:21.257172 6275 raft_consensus.cc:348] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.257470 6275 raft_consensus.cc:374] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.257573 6275 raft_consensus.cc:729] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.257865 6275 consensus_queue.cc:260] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.258562 6275 ts_tablet_manager.cc:1428] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:21.258971 6275 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:21.259578 5687 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 92660.8us
I20260928 10:44:21.260398 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4bfb47ad184148d595830276bad311dc (table default.Table_84284909ddb043bfa220be15cff2a4ec [id=78af05f1efd24c7f9e5f514f8e8cea52]) successfully deleted
I20260928 10:44:21.260779 6275 tablet_bootstrap.cc:654] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.262145 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 8735b36bd56e41629089437b5d92c793 (DEFAULT_TABLE table=default.Table_46cd6f3ff6a044d0a67fb51c668012df [id=5f30b4ebbdda438487d5d1c6cc788cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.262574 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecfed72c46c439f8092720eb3025d3f (DEFAULT_TABLE table=default.Table_8edf4e5a87cb491f959adf009c1d0d0a [id=0baf9e8221ae4ef1b2f9a53b11a13b6f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:21.264396 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f290d195b3d04f4086650b2bb8a50cd1 consensus state has no leader
W20260928 10:44:21.264947 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bcced40ef4f4cedb8542c1189b5cd82 consensus state has no leader
I20260928 10:44:21.265439 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4ef1e7125d4e42f5b30f33bfa588511c
I20260928 10:44:21.266150 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.268282 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afe4501ea584d44b511b89983e210e3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:21.268467 5875 raft_consensus.cc:3037] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.269510 7830 raft_consensus.cc:482] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.269622 7830 raft_consensus.cc:504] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.270135 7830 leader_election.cc:288] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.270468 7830 raft_consensus.cc:482] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.270588 7830 raft_consensus.cc:504] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.270721 5882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
W20260928 10:44:21.271642 6091 leader_election.cc:341] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 2ab439922c6e4ffea8d8cdb6b7d8d8d7
I20260928 10:44:21.271749 6091 leader_election.cc:302] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.271804 5882 raft_consensus.cc:3037] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:21.272071 6091 leader_election.cc:341] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:21.272292 6091 leader_election.cc:302] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.272517 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.272820 7792 raft_consensus.cc:2726] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.272967 7792 raft_consensus.cc:2726] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.273695 5876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:21.273766 5817 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.273860 5876 raft_consensus.cc:2454] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:21.276383 6271 tablet_bootstrap.cc:654] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.282876 7841 raft_consensus.cc:504] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.283704 6128 tablet_service.cc:1514] Processing DeleteTablet for tablet 95fd004a4f724ae5bb285af67218d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:20 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.286055 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8152f4f3d44d2b9a4932e1d6d97970 (DEFAULT_TABLE table=default.Table_a3968544e84b4a68934e7318ddcf78ef [id=44ac9fec02de49b6bd1d822b216c5c0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.287950 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8152f4f3d44d2b9a4932e1d6d97970. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:21.288786 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 95fd004a4f724ae5bb285af67218d8d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95fd004a4f724ae5bb285af67218d8d7 already in progress: creating tablet
W20260928 10:44:21.289999 5817 consensus_peers.cc:487] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15f3f3bff84a416494431a19887bb88d. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.291818 7830 leader_election.cc:288] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.295429 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.292456 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.297540 5817 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.288632 6132 tablet_service.cc:1467] Processing CreateTablet for tablet c74fc09932064e6baa73263953287e2f (DEFAULT_TABLE table=default.Table_bc495c395b1e46c8ac5db474e1790b7e [id=08cd347342e644a7b53363919e5a0aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.297895 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:21.298195 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74fc09932064e6baa73263953287e2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:21.298416 5955 leader_election.cc:341] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.286698 5992 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf072f0c3541c0bb95e1e95fd6c435 (DEFAULT_TABLE table=default.Table_343bbafe328a46faafe00161524633ef [id=a1c57de04b1747b0a5a19ba61fdb5911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.287127 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 0821f14657fe4a7bac8eec4ade19063c (DEFAULT_TABLE table=default.Table_2deeaf0a2af646009edec76f39b81a1e [id=c15d77b7a49d49b99af67d7b7ce3b613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.288254 6002 tablet_service.cc:1467] Processing CreateTablet for tablet d1ec2341f8d047bf9487b7808e4f723b (DEFAULT_TABLE table=default.Table_b2c9214a568c4660b326618ee5d9b23c [id=df06bb2f00e74f51bb8a9429a2be9931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.299074 7557 tablet_replica.cc:330] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:21.299275 7557 raft_consensus.cc:2229] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.299464 7557 raft_consensus.cc:2258] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.300050 7557 ts_tablet_manager.cc:1905] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.311010 6271 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.311492 7841 leader_election.cc:288] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.311614 6271 ts_tablet_manager.cc:1397] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.005s
I20260928 10:44:21.312816 5882 raft_consensus.cc:2454] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:21.313959 7875 raft_consensus.cc:482] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.314122 7875 raft_consensus.cc:504] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.314345 7642 raft_consensus.cc:482] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.314585 7642 raft_consensus.cc:504] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.314846 7875 leader_election.cc:288] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.315107 7642 leader_election.cc:288] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.314339 6271 raft_consensus.cc:348] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.317018 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.317755 5955 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.317229 6271 raft_consensus.cc:374] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.318395 6271 raft_consensus.cc:729] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.320694 7557 ts_tablet_manager.cc:1918] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:21.321421 6271 consensus_queue.cc:260] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.325083 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:21.325546 5955 consensus_peers.cc:487] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a3443d4c6674342b4124156414dcc13. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.325501 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.325904 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.326133 6013 raft_consensus.cc:2454] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:21.324831 7875 raft_consensus.cc:482] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.329802 7875 raft_consensus.cc:504] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.330519 7875 leader_election.cc:288] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.326586 6090 leader_election.cc:302] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:21.331229 7875 raft_consensus.cc:2781] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.331314 7875 raft_consensus.cc:482] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.331374 7875 raft_consensus.cc:3037] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.331209 6271 ts_tablet_manager.cc:1428] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.019s user 0.001s sys 0.004s
I20260928 10:44:21.331565 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8735b36bd56e41629089437b5d92c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.335243 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.335593 6013 raft_consensus.cc:2454] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:21.334352 7875 raft_consensus.cc:504] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.336158 6090 leader_election.cc:302] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:21.336503 7792 raft_consensus.cc:2781] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.336571 7792 raft_consensus.cc:482] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.336629 7792 raft_consensus.cc:3037] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.337143 7875 leader_election.cc:288] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.337394 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95e1588a3d04142ab8d6bb257235dab" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:21.337577 6013 raft_consensus.cc:3037] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.339421 7792 raft_consensus.cc:504] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.340269 7792 leader_election.cc:288] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.340462 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d2c79118e44bca3540d3e3ff524a6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:21.340659 6012 raft_consensus.cc:3037] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.343353 6012 raft_consensus.cc:2454] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:21.343976 6090 leader_election.cc:302] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:21.344745 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ef1e7125d4e42f5b30f33bfa588511c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.345018 6270 tablet_replica.cc:330] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:21.345971 6270 raft_consensus.cc:2229] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.347332 6271 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.347893 6270 raft_consensus.cc:2258] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.349263 7792 raft_consensus.cc:2781] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.349442 7792 raft_consensus.cc:686] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:21.348788 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0821f14657fe4a7bac8eec4ade19063c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.349725 7792 consensus_queue.cc:237] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.350046 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecfed72c46c439f8092720eb3025d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.352445 6013 raft_consensus.cc:2454] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:21.352748 7557 log.cc:1196] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/4ef1e7125d4e42f5b30f33bfa588511c
I20260928 10:44:21.352759 6271 tablet_bootstrap.cc:654] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.353154 6090 leader_election.cc:302] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:21.353257 7557 ts_tablet_manager.cc:1939] T 4ef1e7125d4e42f5b30f33bfa588511c P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:21.353446 7875 raft_consensus.cc:2781] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.353658 7875 raft_consensus.cc:686] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:21.353915 7875 consensus_queue.cc:237] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:21.359655 5955 consensus_peers.cc:487] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 877e2d1c734a4e2891119f308f9f3ae8. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.360544 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_db9adcd0bc9a4b4e90425535a5c52a58 [id=6c4f8a03470949939c8e51847b52ce13]) successfully deleted
W20260928 10:44:21.363741 5955 consensus_peers.cc:487] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3abfedf425b84f679b22d6ca9bef718a. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.364135 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf072f0c3541c0bb95e1e95fd6c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.368582 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ec2341f8d047bf9487b7808e4f723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.385998 6270 ts_tablet_manager.cc:1905] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.389480 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 (DEFAULT_TABLE table=default.Table_569d20faf098464ba7d2f757927af5cd [id=cccabdfb56004d379e3e8c6e497f6614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.400591 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b0bc94471ad4608af7a85f27b60af68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.410800 7876 tablet.cc:1722] T 9bd09430a2c34965a590f2e0852c686b P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:21.422277 6271 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.422891 6271 ts_tablet_manager.cc:1397] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.011s
I20260928 10:44:21.425187 6271 raft_consensus.cc:348] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.427685 6271 raft_consensus.cc:374] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.428825 6271 raft_consensus.cc:729] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.431643 6271 consensus_queue.cc:260] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.119959 5859 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf072f0c3541c0bb95e1e95fd6c435 (DEFAULT_TABLE table=default.Table_343bbafe328a46faafe00161524633ef [id=a1c57de04b1747b0a5a19ba61fdb5911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.137115 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15a54716fb13451994f3a56b98a7230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.153060 6273 tablet_bootstrap.cc:492] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.270594 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:21.438728 6273 ts_tablet_manager.cc:1397] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.584s user 0.036s sys 0.013s
I20260928 10:44:21.439604 6273 raft_consensus.cc:348] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.439836 6273 raft_consensus.cc:374] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.439877 6273 raft_consensus.cc:729] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.440058 6273 consensus_queue.cc:260] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.440609 6273 ts_tablet_manager.cc:1428] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.440869 6273 tablet_bootstrap.cc:492] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.442410 6273 tablet_bootstrap.cc:654] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.271095 5875 raft_consensus.cc:2454] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:21.442793 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91d1629608e4bd18d9231d13e373e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.098874 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecfed72c46c439f8092720eb3025d3f (DEFAULT_TABLE table=default.Table_8edf4e5a87cb491f959adf009c1d0d0a [id=0baf9e8221ae4ef1b2f9a53b11a13b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.443428 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecfed72c46c439f8092720eb3025d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.101230 5845 tablet_service.cc:1467] Processing CreateTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 (DEFAULT_TABLE table=default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3 [id=682a79b5405c44708deedcbfe7386d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.444073 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff01c1c1ed72488791827c5aa57f1de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.446064 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d48c9d689f14ee789e6702373e88b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.450361 7875 raft_consensus.cc:482] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.450542 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def646cc507541e69ed2c7cab70c9cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.450560 7875 raft_consensus.cc:504] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.451236 7875 leader_election.cc:288] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.454641 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0852f0e8b33f4561bdc7fa273dc25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.459051 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb122e04165748d98570b7b042afa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.460211 7884 tablet.cc:1722] T a229207ce7cc475c8f4492e62d122721 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:21.460733 7876 tablet.cc:1722] T 60f0191c7dd347058749790b4e4159c2 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:21.463032 5818 leader_election.cc:341] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.463227 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf072f0c3541c0bb95e1e95fd6c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.463936 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6ca7a0abc0e848c0884ef93ec7363e84" } modify_external_catalogs: true
I20260928 10:44:21.464141 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6ca7a0abc0e848c0884ef93ec7363e84" } modify_external_catalogs: true
I20260928 10:44:21.465426 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1" } modify_external_catalogs: true
I20260928 10:44:21.465620 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_daba9abd70b3450e9acb9ca9c9a2c8e1" } modify_external_catalogs: true
I20260928 10:44:21.466902 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b2c9214a568c4660b326618ee5d9b23c" } new_table_name: "default.Table_5d3706c34b004e5f9e49fa0f9b9117fd" modify_external_catalogs: true
I20260928 10:44:21.472930 5695 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_083c6416ebeb4b91bfcff6a90005ec5e [id=a7daec6534ba449085e65f718a2330f6] alter complete (version 1)
W20260928 10:44:21.474231 5695 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.67:50395 (request call id 189) took 897 ms (client timeout 1000 ms). Trace:
I20260928 10:44:21.474709 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 85583238d6b54f1d89ff5b53b40e73bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.474977 7557 tablet_replica.cc:330] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
W20260928 10:44:21.474321 5695 rpcz_store.cc:269] 0928 10:44:20.577166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.600044 (+ 22878us) service_pool.cc:227] Handling call
0928 10:44:20.640929 (+ 40885us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:21.474209 (+833280us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:20.956569 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:20.958931 (+ 2362us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:20.958938 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:20.958941 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:20.959485 (+ 544us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:20.959500 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:20.959609 (+ 109us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:20.959892 (+ 283us) tablet.cc:699] Row locks acquired
0928 10:44:20.959895 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:20.960036 (+ 141us) write_op.cc:270] Start()
0928 10:44:20.960176 (+ 140us) write_op.cc:276] Timestamp: P: 1790592260960006 usec, L: 0
0928 10:44:20.960180 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:20.976815 (+ 16635us) log.cc:842] Serialized 356 byte log entry
0928 10:44:20.981172 (+ 4357us) op_driver.cc:444] REPLICATION: finished
0928 10:44:20.981317 (+ 145us) write_op.cc:301] APPLY: starting
0928 10:44:20.981335 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:20.981377 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:20.981401 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:20.981466 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:20.981500 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:20.981506 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:20.981584 (+ 78us) log.cc:842] Serialized 23 byte log entry
0928 10:44:20.981661 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:20.981682 (+ 21us) write_op.cc:454] Released schema lock
0928 10:44:20.981689 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:20.981743 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:20.981747 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 10:44:21.058775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:21.058878 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:21.058883 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:21.058885 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:21.058993 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:21.059003 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:21.059007 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:21.059069 (+ 62us) tablet.cc:699] Row locks acquired
0928 10:44:21.059072 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:21.059110 (+ 38us) write_op.cc:270] Start()
0928 10:44:21.059143 (+ 33us) write_op.cc:276] Timestamp: P: 1790592261059076 usec, L: 0
0928 10:44:21.059147 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:21.116260 (+ 57113us) log.cc:842] Serialized 356 byte log entry
0928 10:44:21.116480 (+ 220us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6d8ad6d02 00007fa6d9e097f1 00007fa6d9e08359 00007fa6d9e101bb 00007fa6d9e10038 00000000009edb7c 00007fa6cd60e344 00007fa6cd61191b 00007fa6cd611798 00000000009edb7c
0928 10:44:21.470776 (+354296us) op_driver.cc:444] REPLICATION: finished
0928 10:44:21.471421 (+ 645us) write_op.cc:301] APPLY: starting
0928 10:44:21.471432 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:21.471462 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:21.471465 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:21.471510 (+ 45us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:21.471536 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:21.471542 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:21.471594 (+ 52us) log.cc:842] Serialized 23 byte log entry
0928 10:44:21.471629 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:21.471640 (+ 11us) write_op.cc:454] Released schema lock
0928 10:44:21.471644 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:21.471682 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:21.471685 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":91841280,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":475,"apply.run_wall_time_us":474,"num_ops":1,"prepare.queue_time_us":310854,"prepare.run_cpu_time_us":1222,"prepare.run_wall_time_us":29280,"raft.queue_time_us":154,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"replication_time_us":20875}],["op",{"apply.queue_time_us":607,"apply.run_cpu_time_us":298,"apply.run_wall_time_us":296,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":1242,"prepare.run_wall_time_us":57750,"replication_time_us":411607,"spinlock_wait_cycles":130817792}]]}
I20260928 10:44:21.475193 7557 raft_consensus.cc:2229] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.475366 7557 raft_consensus.cc:2258] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.475744 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.475926 7557 ts_tablet_manager.cc:1905] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.476275 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3443d4c6674342b4124156414dcc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.476698 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.476908 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.477435 5701 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_cb4e3194b662485989b3c444b225b8fa [id=9f353ac79b55463da1daedc2523f6cd1] alter complete (version 3)
I20260928 10:44:21.477481 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 463cf5ecb52d40069b564698433c6781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.477669 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 4082931c332f40fc9c6530190fb61017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:21.478952 5701 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 165) took 851 ms (client timeout 1000 ms). Trace:
W20260928 10:44:21.479035 5701 rpcz_store.cc:269] 0928 10:44:20.627532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.838700 (+211168us) service_pool.cc:227] Handling call
0928 10:44:20.843166 (+ 4466us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:21.478925 (+635759us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:21.116583 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:21.116706 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:21.116713 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:21.116715 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:21.116867 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:21.116880 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:21.116884 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:21.116958 (+ 74us) tablet.cc:699] Row locks acquired
0928 10:44:21.116960 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:21.117018 (+ 58us) write_op.cc:270] Start()
0928 10:44:21.117056 (+ 38us) write_op.cc:276] Timestamp: P: 1790592261116976 usec, L: 0
0928 10:44:21.117061 (+ 5us) op_driver.cc:331] REPLICATION: starting
0928 10:44:21.117225 (+ 164us) log.cc:842] Serialized 356 byte log entry
0928 10:44:21.476791 (+359566us) op_driver.cc:444] REPLICATION: finished
0928 10:44:21.476875 (+ 84us) write_op.cc:301] APPLY: starting
0928 10:44:21.476890 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:21.476927 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:21.476961 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:21.477014 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:21.477046 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:21.477052 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:21.477130 (+ 78us) log.cc:842] Serialized 23 byte log entry
0928 10:44:21.477192 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:21.477208 (+ 16us) write_op.cc:454] Released schema lock
0928 10:44:21.477215 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:21.477282 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:21.477286 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":8061184,"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":455,"apply.run_wall_time_us":455,"num_ops":1,"prepare.queue_time_us":51174,"prepare.run_cpu_time_us":704,"prepare.run_wall_time_us":703,"replication_time_us":359707}]]}
I20260928 10:44:21.485416 7557 ts_tablet_manager.cc:1918] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:21.485479 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1e22a551121d4d6abb7f43b4bb4d6e06
I20260928 10:44:21.485620 7557 log.cc:1196] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/85583238d6b54f1d89ff5b53b40e73bb
I20260928 10:44:21.485901 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 1e22a551121d4d6abb7f43b4bb4d6e06 deleted and replaced by tablet 6d7fccabf8854bb780282bc1b00a9c8b
I20260928 10:44:21.485910 7557 ts_tablet_manager.cc:1939] T 85583238d6b54f1d89ff5b53b40e73bb P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:21.486948 6153 raft_consensus.cc:3037] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.487423 7557 tablet_replica.cc:330] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:21.487644 7557 raft_consensus.cc:2229] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:21.487871 7557 pending_rounds.cc:62] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:21.487936 7557 pending_rounds.cc:68] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265901673070592 op_type: NO_OP noop_request { }
I20260928 10:44:21.488186 7557 raft_consensus.cc:2866] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:21.488330 7557 raft_consensus.cc:2258] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.491607 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 85583238d6b54f1d89ff5b53b40e73bb (table default.Table_e7cdd96b23534cf9a61ec1e66e419155 [id=2ff0d03c75a046f5b76951e171ee8e38]) successfully deleted
W20260928 10:44:21.491838 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4b6db38f77f64cfe9a7802d5307aa949 because the tablet was not found. No further retry: Not found: Tablet not found: 4b6db38f77f64cfe9a7802d5307aa949
W20260928 10:44:21.492020 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8a3443d4c6674342b4124156414dcc13 because the tablet was not found. No further retry: Not found: Tablet not found: 8a3443d4c6674342b4124156414dcc13
I20260928 10:44:21.492063 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d7fccabf8854bb780282bc1b00a9c8b) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.492278 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d7fccabf8854bb780282bc1b00a9c8b) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.452108 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.453976 6270 ts_tablet_manager.cc:1918] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.483747 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.483906 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6db38f77f64cfe9a7802d5307aa949 with delete_type TABLET_DATA_DELETED (replaced by tablet adb1f2e6392b4329b5520d0e292d6f98) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.484028 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.484118 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 75539c390965493eaa69a0d1215fa922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.491858 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d7fccabf8854bb780282bc1b00a9c8b) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.499418 6271 ts_tablet_manager.cc:1428] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.076s user 0.002s sys 0.002s
I20260928 10:44:21.500341 6271 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.463239 5818 leader_election.cc:302] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.501850 6271 tablet_bootstrap.cc:654] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:21.501822 5818 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.502134 5818 leader_election.cc:302] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.502584 7880 raft_consensus.cc:2726] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.502801 7880 raft_consensus.cc:2726] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.503327 7557 ts_tablet_manager.cc:1905] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:21.510524 5818 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.510787 5818 leader_election.cc:302] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.511096 7830 raft_consensus.cc:2726] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:21.511274 5818 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.511447 5818 leader_election.cc:302] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.511708 7830 raft_consensus.cc:2726] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:21.511996 5818 leader_election.cc:341] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.512140 5818 leader_election.cc:302] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.512353 7830 raft_consensus.cc:2726] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:21.512493 5818 leader_election.cc:341] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.512638 5818 leader_election.cc:302] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.512851 7830 raft_consensus.cc:2726] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.513278 6270 log.cc:1196] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/67f29acce3604e458d1981aad87f2eb9
I20260928 10:44:21.513478 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.513839 6270 ts_tablet_manager.cc:1939] T 67f29acce3604e458d1981aad87f2eb9 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:21.514786 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1036) took 4965 ms. Trace:
I20260928 10:44:21.515038 6270 rpcz_store.cc:276] 0928 10:44:16.549229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.549270 (+ 41us) service_pool.cc:227] Handling call
0928 10:44:21.252965 (+4703695us) ts_tablet_manager.cc:1145] Deleting tablet 67f29acce3604e458d1981aad87f2eb9
0928 10:44:21.324589 (+ 71624us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.436492 (+111903us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.453863 (+ 17371us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.514764 (+ 60901us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4703515}
I20260928 10:44:21.515580 6270 tablet_replica.cc:330] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:21.515838 6270 raft_consensus.cc:2229] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:21.516258 6270 raft_consensus.cc:2258] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.517176 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_29655c7bf88a4b96b81be7070a2839ca" } new_table_name: "default.Table_7c0a69fd002a4faba685a359316788fb" modify_external_catalogs: true
I20260928 10:44:21.519235 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_196cdc39cb724e1895aca1333e88e446"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.519807 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_196cdc39cb724e1895aca1333e88e446 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.520264 6273 tablet_bootstrap.cc:492] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.520422 6273 ts_tablet_manager.cc:1397] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.008s
I20260928 10:44:21.523096 6147 raft_consensus.cc:3037] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.516911 6270 ts_tablet_manager.cc:1905] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.523433 6273 raft_consensus.cc:348] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.523644 6273 raft_consensus.cc:374] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.523687 6273 raft_consensus.cc:729] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.523878 6273 consensus_queue.cc:260] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.524403 6273 ts_tablet_manager.cc:1428] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 10:44:21.524752 6273 tablet_bootstrap.cc:492] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.525151 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet c322d11fab43499f82e077fd8a8c02f3 (table default.Table_0796215bba1f4ecc85937aef3b01bee7 [id=07eac26ccf134fb5b9bcc53ba57eb067]). Expected version 1 got 0
I20260928 10:44:21.530355 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 67f29acce3604e458d1981aad87f2eb9 (table default.Table_a766cb0490244b6794f67a154e92eb96 [id=ae18f339d30546ddad1a25f939345b78]) successfully deleted
W20260928 10:44:21.533531 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1ec2341f8d047bf9487b7808e4f723b consensus state has no leader
I20260928 10:44:21.536736 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_73d9f3b0e2544942baf33fbc7c3c71e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.537346 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d9f3b0e2544942baf33fbc7c3c71e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.538672 7874 raft_consensus.cc:482] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.538826 7874 raft_consensus.cc:504] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.539440 7868 tablet.cc:1722] T c322d11fab43499f82e077fd8a8c02f3 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:21.539825 7874 leader_election.cc:288] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.541388 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_99ae64c5eee24cc189fb1f54cbe4ad75" } modify_external_catalogs: true
I20260928 10:44:21.541887 6273 tablet_bootstrap.cc:654] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.543395 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d837b4e19de9467082a1578b292792e6
I20260928 10:44:21.544162 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_726f11c163184d5abf43e2f813f46c84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.544819 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_726f11c163184d5abf43e2f813f46c84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.544860 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet d837b4e19de9467082a1578b292792e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.544895 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet d837b4e19de9467082a1578b292792e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.545140 6271 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.545259 6271 ts_tablet_manager.cc:1397] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260928 10:44:21.545950 6271 raft_consensus.cc:348] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.546162 6271 raft_consensus.cc:374] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.546212 6271 raft_consensus.cc:729] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.546393 6271 consensus_queue.cc:260] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.546756 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7adcdfdbeb074696a1081d7eb5d96926
I20260928 10:44:21.546953 6271 ts_tablet_manager.cc:1428] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:21.547220 6271 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.547560 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.547525 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a236465efe044a9936aa3e578649364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.548130 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a236465efe044a9936aa3e578649364 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.548892 6271 tablet_bootstrap.cc:654] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.547560 7557 ts_tablet_manager.cc:1918] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.550101 7557 log.cc:1196] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:21.550665 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet c1ffbf968fc7478b99ca11e307398363 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:21.550918 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.552510 7782 raft_consensus.cc:482] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.552665 7782 raft_consensus.cc:504] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.553256 7782 leader_election.cc:288] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.553920 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.553972 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_99ae64c5eee24cc189fb1f54cbe4ad75" } modify_external_catalogs: true
I20260928 10:44:21.554279 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.554369 7557 ts_tablet_manager.cc:1939] T bb5eed4318fe482789fee32e24a49bfc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:21.554591 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d837b4e19de9467082a1578b292792e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:21.554754 5955 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.555224 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_08d92c5a2cb04347ac3210e7511a8dbd" } new_table_name: "default.Table_3f880e8e4517497eae4be566462da1d7" modify_external_catalogs: true
I20260928 10:44:21.557575 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0cb06841d4764e989f44113cb2236deb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.558341 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cb06841d4764e989f44113cb2236deb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:21.559894 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c683d17d41e243e798cf9837fa88a4c9 consensus state has no leader
I20260928 10:44:21.560812 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7a4e883bd0fb476583d3840f124558ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.561551 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a4e883bd0fb476583d3840f124558ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.562548 6271 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.562696 6271 ts_tablet_manager.cc:1397] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
W20260928 10:44:21.563076 5955 consensus_peers.cc:487] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 463cf5ecb52d40069b564698433c6781. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:21.563405 6271 raft_consensus.cc:348] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.563632 6271 raft_consensus.cc:374] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.563687 6271 raft_consensus.cc:729] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.563858 6271 consensus_queue.cc:260] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.564330 6271 ts_tablet_manager.cc:1428] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.564599 6271 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.564780 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet bb5eed4318fe482789fee32e24a49bfc (table default.Table_c08de4d3d9ce4f20bed63a830c987c35 [id=42b8d28c18164d34bbad1117d30d8289]) successfully deleted
W20260928 10:44:21.565129 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3abfedf425b84f679b22d6ca9bef718a because the tablet was not found. No further retry: Not found: Tablet not found: 3abfedf425b84f679b22d6ca9bef718a
W20260928 10:44:21.565421 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 463cf5ecb52d40069b564698433c6781 because the tablet was not found. No further retry: Not found: Tablet not found: 463cf5ecb52d40069b564698433c6781
W20260928 10:44:21.565728 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4082931c332f40fc9c6530190fb61017 because the tablet was not found. No further retry: Not found: Tablet not found: 4082931c332f40fc9c6530190fb61017
W20260928 10:44:21.565979 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e22a551121d4d6abb7f43b4bb4d6e06 already in progress: creating tablet
W20260928 10:44:21.566417 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d837b4e19de9467082a1578b292792e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d837b4e19de9467082a1578b292792e6 already in progress: creating tablet
W20260928 10:44:21.566759 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7adcdfdbeb074696a1081d7eb5d96926 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7adcdfdbeb074696a1081d7eb5d96926 already in progress: creating tablet
I20260928 10:44:21.567065 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adcdfdbeb074696a1081d7eb5d96926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.570102 6273 tablet_bootstrap.cc:492] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.570238 6273 ts_tablet_manager.cc:1397] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260928 10:44:21.570936 6273 raft_consensus.cc:348] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.571126 6273 raft_consensus.cc:374] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.571167 6273 raft_consensus.cc:729] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.571344 6273 consensus_queue.cc:260] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.571813 6273 ts_tablet_manager.cc:1428] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:21.572048 6273 tablet_bootstrap.cc:492] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.573565 6273 tablet_bootstrap.cc:654] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.582278 6271 tablet_bootstrap.cc:654] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.582399 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.582980 5955 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.584645 6275 tablet_bootstrap.cc:492] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:21.584947 6275 ts_tablet_manager.cc:1397] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.326s user 0.039s sys 0.028s
I20260928 10:44:21.585124 6271 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.585251 6271 ts_tablet_manager.cc:1397] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20260928 10:44:21.585914 6271 raft_consensus.cc:348] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:21.585932 6275 raft_consensus.cc:348] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.586133 6271 raft_consensus.cc:374] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.586189 6271 raft_consensus.cc:729] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.586387 6271 consensus_queue.cc:260] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
W20260928 10:44:21.586850 5687 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 24bf23a7d7be4a0897a3fd96941bb83b (table default.Table_307a19e51bd348fa8df26f51b7bab439 [id=466f2e8f097b455e893d7b01209db86a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 24bf23a7d7be4a0897a3fd96941bb83b consensus state has no leader
I20260928 10:44:21.586982 6271 ts_tablet_manager.cc:1428] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 10:44:21.587164 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ae733c805ee40479b168638ddc6b3cc consensus state has no leader
I20260928 10:44:21.587235 6271 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.588874 6271 tablet_bootstrap.cc:654] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.592897 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c1ffbf968fc7478b99ca11e307398363
I20260928 10:44:21.593401 5693 catalog_manager.cc:6565] ReplaceTablet: tablet c1ffbf968fc7478b99ca11e307398363 deleted and replaced by tablet fefe0eeda16949b5b4bbbb60f9f72aab
I20260928 10:44:21.593676 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffbf968fc7478b99ca11e307398363 with delete_type TABLET_DATA_DELETED (replaced by tablet fefe0eeda16949b5b4bbbb60f9f72aab) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.594193 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet e2ce585cc60d4001b12cb335929b9efb (table default.Table_bad12c6d98f54e249460a528807f8d7e [id=74ea354eea8e4e5c8ed65b1502681cfd]). Expected version 3 got 0
I20260928 10:44:21.594281 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffbf968fc7478b99ca11e307398363 with delete_type TABLET_DATA_DELETED (replaced by tablet fefe0eeda16949b5b4bbbb60f9f72aab) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.593705 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet c1ffbf968fc7478b99ca11e307398363 with delete_type TABLET_DATA_DELETED (replaced by tablet fefe0eeda16949b5b4bbbb60f9f72aab) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.601649 6275 raft_consensus.cc:374] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.602041 6275 raft_consensus.cc:729] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.602916 7880 raft_consensus.cc:482] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:21.603329 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c1ffbf968fc7478b99ca11e307398363 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1ffbf968fc7478b99ca11e307398363 already in progress: creating tablet
I20260928 10:44:21.603188 7880 raft_consensus.cc:504] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.604333 6275 consensus_queue.cc:260] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.605104 7880 leader_election.cc:288] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:21.605561 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.606106 5817 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.610692 6271 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.610729 6273 tablet_bootstrap.cc:492] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.610857 6273 ts_tablet_manager.cc:1397] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.007s
I20260928 10:44:21.611582 6273 raft_consensus.cc:348] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.611800 6273 raft_consensus.cc:374] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.611850 6273 raft_consensus.cc:729] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.612078 6271 ts_tablet_manager.cc:1397] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20260928 10:44:21.612056 6273 consensus_queue.cc:260] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.612560 6273 ts_tablet_manager.cc:1428] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:21.612825 6273 tablet_bootstrap.cc:492] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.613201 6271 raft_consensus.cc:348] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.614158 6271 raft_consensus.cc:374] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.614271 6271 raft_consensus.cc:729] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.614552 6273 tablet_bootstrap.cc:654] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.614576 6271 consensus_queue.cc:260] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.619907 6271 ts_tablet_manager.cc:1428] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 10:44:21.620374 6271 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.622820 7874 raft_consensus.cc:482] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dab87557ec9445dbe35ea05e3561a94)
I20260928 10:44:21.622964 7874 raft_consensus.cc:504] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.623556 7874 leader_election.cc:288] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.624208 6271 tablet_bootstrap.cc:654] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:21.625835 5955 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Not found: Tablet not found: a61d97ed6b7b4dcba34a7a2190316b02
W20260928 10:44:21.628801 5957 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75539c390965493eaa69a0d1215fa922
I20260928 10:44:21.628965 5957 leader_election.cc:302] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.629462 7841 raft_consensus.cc:2726] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.631201 6273 tablet_bootstrap.cc:492] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.631349 6273 ts_tablet_manager.cc:1397] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20260928 10:44:21.631316 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_42d9ac5604184e359e5bb0ad2aa34852" } new_table_name: "default.Table_c09582feef0e41aabb7d7570e92f16f8" modify_external_catalogs: true
I20260928 10:44:21.632087 6273 raft_consensus.cc:348] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.632310 6273 raft_consensus.cc:374] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.632366 6273 raft_consensus.cc:729] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.633433 6273 consensus_queue.cc:260] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.633797 6275 ts_tablet_manager.cc:1428] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
I20260928 10:44:21.633991 6273 ts_tablet_manager.cc:1428] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 10:44:21.634260 6273 tablet_bootstrap.cc:492] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.634214 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fa3b74f68d384005854e342c622e1d18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.634860 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa3b74f68d384005854e342c622e1d18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.636428 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c3411ada4f0c4fcd8aaecf0ad6da137e" } new_table_name: "default.Table_c293ab0c726347148ab1ee389c799766" modify_external_catalogs: true
I20260928 10:44:21.637385 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2da17aac467c432899b53a16ba53b3c0" } modify_external_catalogs: true
I20260928 10:44:21.639071 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2da17aac467c432899b53a16ba53b3c0" } modify_external_catalogs: true
I20260928 10:44:21.640269 6273 tablet_bootstrap.cc:654] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.646133 5957 leader_election.cc:302] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.646660 7841 raft_consensus.cc:2781] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.646749 7841 raft_consensus.cc:482] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 10:44:21.646760 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a91d1629608e4bd18d9231d13e373e04 consensus state has no leader
I20260928 10:44:21.646808 7841 raft_consensus.cc:3037] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.647778 6275 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:21.649374 7841 raft_consensus.cc:504] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.652215 7841 leader_election.cc:288] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.653285 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:21.654206 5955 leader_election.cc:341] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.654650 6269 ts_tablet_manager.cc:1918] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:21.654820 6269 log.cc:1196] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:21.655205 6269 ts_tablet_manager.cc:1939] T 9fe0dd05136840ee91d0b2a415ad49fc P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:21.656071 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 901) took 9130 ms. Trace:
I20260928 10:44:21.656243 6269 rpcz_store.cc:276] 0928 10:44:12.525988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.534780 (+ 8792us) service_pool.cc:227] Handling call
0928 10:44:21.186860 (+8652080us) ts_tablet_manager.cc:1145] Deleting tablet 9fe0dd05136840ee91d0b2a415ad49fc
0928 10:44:21.186875 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.445165 (+258290us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.654528 (+209363us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.656048 (+ 1520us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8651844}
I20260928 10:44:21.656770 6269 tablet_replica.cc:330] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:21.656934 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9fe0dd05136840ee91d0b2a415ad49fc (table default.Table_bd415a38e4344ac0a4f2bfb479d01b58 [id=01274b7dde224a98ae1da73c01701045]) successfully deleted
I20260928 10:44:21.657019 6269 raft_consensus.cc:2229] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.657341 6269 raft_consensus.cc:2258] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.657950 6269 ts_tablet_manager.cc:1905] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.660696 6275 tablet_bootstrap.cc:654] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.662303 7765 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: acquiring CA information for follower catalog manager: success
I20260928 10:44:21.669183 7880 raft_consensus.cc:482] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.669786 7880 raft_consensus.cc:504] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.670982 7880 leader_election.cc:288] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:21.671604 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.672225 5817 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.675808 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.678785 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3bbb8fde63104564b0559582885c7f61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.679464 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bbb8fde63104564b0559582885c7f61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.652364 6270 ts_tablet_manager.cc:1918] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.680907 6270 log.cc:1196] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c5c1a1c5e22e455d91de92f0aa3535c7
I20260928 10:44:21.681017 5957 leader_election.cc:302] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.681294 6270 ts_tablet_manager.cc:1939] T c5c1a1c5e22e455d91de92f0aa3535c7 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:21.681529 7841 raft_consensus.cc:2781] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.681797 7841 raft_consensus.cc:686] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:21.690326 7841 consensus_queue.cc:237] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.699113 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b84569684a4648f39fe4d8a129ea6ade"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.699877 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b84569684a4648f39fe4d8a129ea6ade in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.703557 6271 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.703715 6271 ts_tablet_manager.cc:1397] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.009s
I20260928 10:44:21.704414 6271 raft_consensus.cc:348] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.704648 6271 raft_consensus.cc:374] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.704710 6271 raft_consensus.cc:729] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.704885 6271 consensus_queue.cc:260] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.705399 6271 ts_tablet_manager.cc:1428] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.705674 6271 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:21.707059 5957 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Illegal state: Tablet not RUNNING: STOPPED
I20260928 10:44:21.707188 5957 leader_election.cc:302] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.707242 6271 tablet_bootstrap.cc:654] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.707388 7874 raft_consensus.cc:2726] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.707929 5957 leader_election.cc:302] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.708135 7874 raft_consensus.cc:2781] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.707988 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5b5af7d600e9410db290e83495c2bece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.708243 7874 raft_consensus.cc:686] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:21.708455 7874 consensus_queue.cc:237] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.713567 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 4706d214d3184f4ebcec28f609b00a53 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:21.715193 6273 tablet_bootstrap.cc:492] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.715189 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1037) took 5165 ms. Trace:
I20260928 10:44:21.715348 6273 ts_tablet_manager.cc:1397] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.081s user 0.013s sys 0.000s
I20260928 10:44:21.715291 6270 rpcz_store.cc:276] 0928 10:44:16.549641 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.549684 (+ 43us) service_pool.cc:227] Handling call
0928 10:44:21.515529 (+4965845us) ts_tablet_manager.cc:1145] Deleting tablet c5c1a1c5e22e455d91de92f0aa3535c7
0928 10:44:21.515543 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.590901 (+ 75358us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.652259 (+ 61358us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.715164 (+ 62905us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33077,"tablet-delete.queue_time_us":4965694}
I20260928 10:44:21.716123 6273 raft_consensus.cc:348] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.716346 6273 raft_consensus.cc:374] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.716399 6273 raft_consensus.cc:729] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.716602 6273 consensus_queue.cc:260] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.717231 6273 ts_tablet_manager.cc:1428] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:21.717504 6273 tablet_bootstrap.cc:492] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.719158 6273 tablet_bootstrap.cc:654] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.723474 6271 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.723641 6271 ts_tablet_manager.cc:1397] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260928 10:44:21.724360 6271 raft_consensus.cc:348] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.724597 6271 raft_consensus.cc:374] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.724650 6271 raft_consensus.cc:729] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.724835 6271 consensus_queue.cc:260] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.725389 6271 ts_tablet_manager.cc:1428] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260928 10:44:21.725725 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b5af7d600e9410db290e83495c2bece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.715729 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c5c1a1c5e22e455d91de92f0aa3535c7 (table default.Table_1393fcb0819d4e72bfa3196064b164e4 [id=aa24bdafe7284b81bc0f71cd89fd9984]) successfully deleted
I20260928 10:44:21.726308 6147 raft_consensus.cc:3037] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.726540 7880 raft_consensus.cc:482] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.726696 7880 raft_consensus.cc:504] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.727285 7880 leader_election.cc:288] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:21.728183 6270 tablet_replica.cc:330] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:21.729580 6270 raft_consensus.cc:2229] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.730234 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22cc964ceb741febfd3d1322ae05289" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.730962 5817 leader_election.cc:341] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.730760 6271 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.732201 6270 raft_consensus.cc:2258] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.733628 6271 tablet_bootstrap.cc:654] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.737403 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2e7199f3e03c48228c2fe28bc4e79433" } new_table_name: "default.Table_5ff8e5f5877f4c3b9fc4576071704f4c" modify_external_catalogs: true
I20260928 10:44:21.737753 6273 tablet_bootstrap.cc:492] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.737883 6273 ts_tablet_manager.cc:1397] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260928 10:44:21.738623 6273 raft_consensus.cc:348] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.738896 6273 raft_consensus.cc:374] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.738955 6273 raft_consensus.cc:729] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.739125 6273 consensus_queue.cc:260] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.739753 6273 ts_tablet_manager.cc:1428] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:21.747681 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1b8c1d7a389a4199a6f20c6752805cb4" } modify_external_catalogs: true
I20260928 10:44:21.747941 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1b8c1d7a389a4199a6f20c6752805cb4" } modify_external_catalogs: true
W20260928 10:44:21.750028 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad79320a73b04a18813fbf83fb738b2e consensus state has no leader
I20260928 10:44:21.751682 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c1af1980a6344ca7b54ded68d92e688f" } modify_external_catalogs: true
I20260928 10:44:21.751906 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c1af1980a6344ca7b54ded68d92e688f" } modify_external_catalogs: true
I20260928 10:44:21.759385 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_907e249ad2304307ba1c28c98b92fbe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.760076 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_907e249ad2304307ba1c28c98b92fbe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.761551 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b832cbb4b23a4540bd5dee2d14c3da1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.761950 6271 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.762094 6271 ts_tablet_manager.cc:1397] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
W20260928 10:44:21.762188 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b832cbb4b23a4540bd5dee2d14c3da1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.762938 6271 raft_consensus.cc:348] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.763141 6271 raft_consensus.cc:374] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.763193 6271 raft_consensus.cc:729] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.763384 6271 consensus_queue.cc:260] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.763883 6271 ts_tablet_manager.cc:1428] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:21.764138 6271 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.765619 6271 tablet_bootstrap.cc:654] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.766746 6273 tablet_bootstrap.cc:492] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.768224 6273 tablet_bootstrap.cc:654] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.770877 6270 ts_tablet_manager.cc:1905] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.771842 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_5f47609a7d8c45fbafeaba4deb440ae2" } new_table_name: "default.Table_f0d4929ce3af4bdcbd65b0366dbf53d3" modify_external_catalogs: true
I20260928 10:44:21.771911 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190cd281b1ad41aab2564744c282bcab" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:21.774966 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7aa301bfbb4097b386a0d23cfa91e1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:21.775141 5869 raft_consensus.cc:3037] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.777084 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ebeaf48d4e944616b2a0c2c20cb7a97a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.777890 5869 raft_consensus.cc:2454] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:21.780710 6273 tablet_bootstrap.cc:492] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.780843 6273 ts_tablet_manager.cc:1397] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260928 10:44:21.781571 6273 raft_consensus.cc:348] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.781772 6273 raft_consensus.cc:374] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.781826 6273 raft_consensus.cc:729] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.782014 6273 consensus_queue.cc:260] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.782182 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:21.782389 5884 raft_consensus.cc:2454] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:21.782662 6273 ts_tablet_manager.cc:1428] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260928 10:44:21.782912 6273 tablet_bootstrap.cc:492] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:21.777664 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebeaf48d4e944616b2a0c2c20cb7a97a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.784350 6273 tablet_bootstrap.cc:654] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:21.788367 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 355c5b2e54cb4136b27eec3d65aeab55 consensus state has no leader
I20260928 10:44:21.790220 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f58b0d9292834bc6b9a3ce6f7cc3c025"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.792771 6275 tablet_bootstrap.cc:492] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:21.792999 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:21.793205 5884 raft_consensus.cc:2454] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:21.795023 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f58b0d9292834bc6b9a3ce6f7cc3c025 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.793210 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_09a8a8ffb0ab48b380363d5411cbeab0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.799420 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a8a8ffb0ab48b380363d5411cbeab0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.800148 6271 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.800284 6271 ts_tablet_manager.cc:1397] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.002s
I20260928 10:44:21.801282 6271 raft_consensus.cc:348] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.801533 6271 raft_consensus.cc:374] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.801594 6271 raft_consensus.cc:729] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.801769 6271 consensus_queue.cc:260] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.802312 6271 ts_tablet_manager.cc:1428] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:21.802597 6271 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.804085 6271 tablet_bootstrap.cc:654] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.805830 6273 tablet_bootstrap.cc:492] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.805982 6273 ts_tablet_manager.cc:1397] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260928 10:44:21.806746 6273 raft_consensus.cc:348] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.806949 6273 raft_consensus.cc:374] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.806999 6273 raft_consensus.cc:729] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.807194 6273 consensus_queue.cc:260] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.807433 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9d7e6f17bff44442923f9cb732081e0f" } new_table_name: "default.Table_16c9a1b95ad2417892683d89a3546723" modify_external_catalogs: true
I20260928 10:44:21.807819 6273 ts_tablet_manager.cc:1428] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:21.808113 6273 tablet_bootstrap.cc:492] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.808301 6269 ts_tablet_manager.cc:1918] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:21.808410 6269 log.cc:1196] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/1d0584d6b80e43eb913c3932256cd89e
I20260928 10:44:21.808722 6269 ts_tablet_manager.cc:1939] T 1d0584d6b80e43eb913c3932256cd89e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:21.809774 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 900) took 9283 ms. Trace:
I20260928 10:44:21.815341 6273 tablet_bootstrap.cc:654] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.816452 7880 raft_consensus.cc:482] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.816608 7880 raft_consensus.cc:504] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.817189 7880 leader_election.cc:288] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:21.818804 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dba17dc11b940958cc10b9fbcb295f4 consensus state has no leader
I20260928 10:44:21.818890 6271 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.819024 6271 ts_tablet_manager.cc:1397] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260928 10:44:21.819749 6271 raft_consensus.cc:348] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.819988 6271 raft_consensus.cc:374] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.820040 6271 raft_consensus.cc:729] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.820245 6271 consensus_queue.cc:260] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.820818 6271 ts_tablet_manager.cc:1428] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.821288 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a908ac5d44a74c05b35f6853ab769d91" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:21.821604 5884 raft_consensus.cc:3037] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.825060 5884 raft_consensus.cc:2454] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:21.805459 7868 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:21.826016 6275 ts_tablet_manager.cc:1397] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.178s user 0.006s sys 0.001s
I20260928 10:44:21.826766 6271 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.828400 6271 tablet_bootstrap.cc:654] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.828766 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 10ab23279fec4478be7031ae1c79d074
I20260928 10:44:21.829679 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ab23279fec4478be7031ae1c79d074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.829723 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ab23279fec4478be7031ae1c79d074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.817962 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.831902 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 22c4cea3f8ea413493c3ac23f83d0801 (table default.Table_fd728deb26884d0ab358a6df27ce4026 [id=263ec4300c4145479b53f240aad4198a]). Expected version 1 got 0
I20260928 10:44:21.830252 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ab23279fec4478be7031ae1c79d074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:21.832654 5817 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.835419 6273 tablet_bootstrap.cc:492] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.835563 6273 ts_tablet_manager.cc:1397] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20260928 10:44:21.836259 6273 raft_consensus.cc:348] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.836501 6273 raft_consensus.cc:374] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.836558 6273 raft_consensus.cc:729] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.836779 6273 consensus_queue.cc:260] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:21.840425 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 10ab23279fec4478be7031ae1c79d074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10ab23279fec4478be7031ae1c79d074 already in progress: creating tablet
I20260928 10:44:21.843488 6273 ts_tablet_manager.cc:1428] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:44:21.843837 6273 tablet_bootstrap.cc:492] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.843995 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.845784 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2cfef184644b4fec8058759dd2e70cd2
I20260928 10:44:21.846097 6273 tablet_bootstrap.cc:654] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.846688 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.846705 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.847447 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfef184644b4fec8058759dd2e70cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.848134 7782 raft_consensus.cc:482] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.848265 7782 raft_consensus.cc:504] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:21.848352 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2cfef184644b4fec8058759dd2e70cd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cfef184644b4fec8058759dd2e70cd2 already in progress: creating tablet
I20260928 10:44:21.848810 7782 leader_election.cc:288] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.849603 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:21.850160 5955 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.851579 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3bcced40ef4f4cedb8542c1189b5cd82
I20260928 10:44:21.852437 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.852834 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:21.854053 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3bcced40ef4f4cedb8542c1189b5cd82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bcced40ef4f4cedb8542c1189b5cd82 already in progress: creating tablet
I20260928 10:44:21.857245 7841 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.857342 7924 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:21.857451 7841 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:21.857544 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2b67503f83f34747a19b8737a4983db4" } new_table_name: "default.Table_ed6843c48e0442bfb454e1a086c0e493" modify_external_catalogs: true
I20260928 10:44:21.858728 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcced40ef4f4cedb8542c1189b5cd82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.858767 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:21.858985 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_df05d5b3b68d4445977eb49fda04603a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.859565 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df05d5b3b68d4445977eb49fda04603a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.860853 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_09a8a8ffb0ab48b380363d5411cbeab0" } new_table_name: "default.Table_6f01bea3c56e4734aa31be4a99aa5589" modify_external_catalogs: true
W20260928 10:44:21.862708 5955 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.865667 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_80f82fc4183a42b6b2d405c873eb32e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.866536 7841 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:21.867364 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80f82fc4183a42b6b2d405c873eb32e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.809993 6269 rpcz_store.cc:276] 0928 10:44:12.525847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.535333 (+ 9486us) service_pool.cc:227] Handling call
0928 10:44:21.656721 (+9121388us) ts_tablet_manager.cc:1145] Deleting tablet 1d0584d6b80e43eb913c3932256cd89e
0928 10:44:21.656733 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.755370 (+ 98637us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.808191 (+ 52821us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.809749 (+ 1558us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9121170}
I20260928 10:44:21.874272 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 1d0584d6b80e43eb913c3932256cd89e (table default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]) successfully deleted
I20260928 10:44:21.874735 6269 tablet_replica.cc:330] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:21.875015 6269 raft_consensus.cc:2229] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:21.875264 6269 raft_consensus.cc:2258] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.875608 6273 tablet_bootstrap.cc:492] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:21.875737 6273 ts_tablet_manager.cc:1397] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.003s
I20260928 10:44:21.875944 6269 ts_tablet_manager.cc:1905] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.876005 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 606a9cb61e0f4f558008d09177ded9f7
I20260928 10:44:21.876718 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.877359 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.877607 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22cc964ceb741febfd3d1322ae05289" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:21.877727 6091 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f95e1588a3d04142ab8d6bb257235dab
W20260928 10:44:21.878417 6091 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1f3d2c79118e44bca3540d3e3ff524a6
W20260928 10:44:21.878901 6091 leader_election.cc:341] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:21.879652 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:21.879921 6091 leader_election.cc:341] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:21.880318 6091 leader_election.cc:302] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:21.880406 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 606a9cb61e0f4f558008d09177ded9f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 606a9cb61e0f4f558008d09177ded9f7 already in progress: creating tablet
I20260928 10:44:21.880686 7875 raft_consensus.cc:2726] T 190cd281b1ad41aab2564744c282bcab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.881753 5957 leader_election.cc:302] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.882128 7841 raft_consensus.cc:2781] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.882244 7841 raft_consensus.cc:686] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
W20260928 10:44:21.882256 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f913900914d149b48d64a0d53908482c consensus state has no leader
I20260928 10:44:21.882443 7841 consensus_queue.cc:237] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.839221 6275 raft_consensus.cc:348] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.884341 6275 raft_consensus.cc:374] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.884450 6275 raft_consensus.cc:729] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:21.884518 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8dccdfac6a84d8888992fca556fbc8b has no consensus state
I20260928 10:44:21.876751 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 606a9cb61e0f4f558008d09177ded9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.885181 6275 consensus_queue.cc:260] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.876528 6273 raft_consensus.cc:348] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.886552 6273 raft_consensus.cc:374] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.886634 6273 raft_consensus.cc:729] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.886822 6273 consensus_queue.cc:260] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.887691 6273 ts_tablet_manager.cc:1428] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260928 10:44:21.887975 6273 tablet_bootstrap.cc:492] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:21.888211 6275 ts_tablet_manager.cc:1428] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.057s user 0.002s sys 0.000s
I20260928 10:44:21.888527 6275 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:21.889483 6273 tablet_bootstrap.cc:654] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.891767 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d546939ed91b4712b1271c71fcdcc595"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.892318 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d546939ed91b4712b1271c71fcdcc595 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.892545 6271 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:21.892699 6271 ts_tablet_manager.cc:1397] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.004s
I20260928 10:44:21.893373 6271 raft_consensus.cc:348] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.893589 6271 raft_consensus.cc:374] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.893656 6271 raft_consensus.cc:729] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.893839 6271 consensus_queue.cc:260] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.894337 6271 ts_tablet_manager.cc:1428] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.894623 6271 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.896636 6271 tablet_bootstrap.cc:654] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.897637 5957 leader_election.cc:302] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.898080 7874 raft_consensus.cc:2781] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.898211 7874 raft_consensus.cc:482] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.898341 7874 raft_consensus.cc:3037] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.901140 7874 raft_consensus.cc:504] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.902366 7874 leader_election.cc:288] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:21.904634 5957 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75e19b8189894e91a8be5a150f54cb6b
I20260928 10:44:21.904771 5957 leader_election.cc:302] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.904973 7782 raft_consensus.cc:2726] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:21.905802 5957 leader_election.cc:302] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:21.906245 7874 raft_consensus.cc:2781] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:21.906392 7874 raft_consensus.cc:482] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:21.909890 7874 raft_consensus.cc:3037] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:21.912266 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb
I20260928 10:44:21.913498 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.913579 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:21.914295 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb already in progress: creating tablet
W20260928 10:44:21.915082 5818 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:21.915136 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet b254b5f8163d45cc8e1beb77d6ac4a65 (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]). Expected version 1 got 0
W20260928 10:44:21.910329 5957 leader_election.cc:341] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: a61d97ed6b7b4dcba34a7a2190316b02
I20260928 10:44:21.913286 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:21 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.915411 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet d39e1e4d18d6450580e28614ae4c2895 (table default.Table_1b3195c057364cf88c8d671a40606b49 [id=db68c7086ebf437fa18f398767d98b0a]). Expected version 2 got 0
I20260928 10:44:21.915477 5957 leader_election.cc:302] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:21.915808 7782 raft_consensus.cc:2726] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 10:44:21.916713 5957 leader_election.cc:302] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:21.916653 5696 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet b254b5f8163d45cc8e1beb77d6ac4a65 (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b254b5f8163d45cc8e1beb77d6ac4a65 consensus state has no leader
I20260928 10:44:21.917022 7782 raft_consensus.cc:2781] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:21.918130 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:21.918666 5700 catalog_manager.cc:5495] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:21.919121 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:21.919305 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:21.919579 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5ced63ab7188472e80d4ff52350be3e0 (table default.Table_8fe75b83adf34a4e9d1e40f43597c820 [id=5a4de2bdb6d54d4ea3944c41df33dc24]). Expected version 2 got 0
I20260928 10:44:21.919945 5700 catalog_manager.cc:5495] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:21.920420 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:21.921021 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 6e17257dc87a480688f5718457ab7b7f (DEFAULT_TABLE table=default.Table_c653071d01e1479ead4bc5dc60b2417b [id=b42cbc7ee7d3406b8d63812d3731180e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.921277 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_5a0b60229554493cbe4d69c2d3250a48 [id=56b10bf597f14dc39909f013f05edf7d] alter complete (version 1)
I20260928 10:44:21.921413 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e17257dc87a480688f5718457ab7b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.921342 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 6e17257dc87a480688f5718457ab7b7f (DEFAULT_TABLE table=default.Table_c653071d01e1479ead4bc5dc60b2417b [id=b42cbc7ee7d3406b8d63812d3731180e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.921732 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e17257dc87a480688f5718457ab7b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.928512 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3d2c79118e44bca3540d3e3ff524a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.928792 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet f95e1588a3d04142ab8d6bb257235dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.928928 7557 tablet_replica.cc:330] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:21.929144 7557 raft_consensus.cc:2229] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:21.929304 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b7e26971914613a2372476b348b702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.929381 7557 pending_rounds.cc:62] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:21.929423 7557 pending_rounds.cc:68] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265902491832320 op_type: NO_OP noop_request { }
I20260928 10:44:21.929545 7557 raft_consensus.cc:2866] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:21.929630 7557 raft_consensus.cc:2258] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.930339 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.930509 7557 ts_tablet_manager.cc:1905] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.930557 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet bb5eed4318fe482789fee32e24a49bfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.931383 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1072cf156cdf4c2a8c9d9764de110c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.934264 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet df846e6bb5b54ddd8ac5df678803d739 (table default.Table_9a5b7527d09b40078823a200d89c1e2d [id=59fcbd230b544a6fb3e3fc3888be0f39]). Expected version 1 got 0
I20260928 10:44:21.937569 7557 ts_tablet_manager.cc:1918] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:21.938616 7557 log.cc:1196] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:21.939280 7557 ts_tablet_manager.cc:1939] T 1f3d2c79118e44bca3540d3e3ff524a6 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:21.940825 7557 tablet_replica.cc:330] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:21.941943 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1f3d2c79118e44bca3540d3e3ff524a6 (table default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]) successfully deleted
I20260928 10:44:21.943081 5697 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:21.943974 7557 raft_consensus.cc:2229] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:21.944792 7557 pending_rounds.cc:62] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:21.944880 7557 pending_rounds.cc:68] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265902508707840 op_type: NO_OP noop_request { }
I20260928 10:44:21.945019 7557 raft_consensus.cc:2866] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:21.945252 7557 raft_consensus.cc:2258] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:21.946276 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 99d7ce3414d54815aa1798f27aee4298 (DEFAULT_TABLE table=default.Table_62ef942b3a1e4735adeb03b3f519b028 [id=e39568d18bfd4202835e2459b2c155d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.946767 7557 ts_tablet_manager.cc:1905] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:21.946821 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d7ce3414d54815aa1798f27aee4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.957472 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_c293ab0c726347148ab1ee389c799766 [id=0334f9b1aea343a2b20a0b0aa513d18e] alter complete (version 2)
I20260928 10:44:21.959532 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet cd65a860b00d4a7ba8ae92dde5818212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:21.962724 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_c61910c227dc41cba5ed9d53e9caad2d" } new_table_name: "default.Table_c50f995611b3422a94bd6571e316c70d" modify_external_catalogs: true
I20260928 10:44:21.962585 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_244799f28a6546a58cd61ae211aef842"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.963546 6271 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
W20260928 10:44:21.963618 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_244799f28a6546a58cd61ae211aef842 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.963728 6271 ts_tablet_manager.cc:1397] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.000s
I20260928 10:44:21.964381 6127 tablet_service.cc:1467] Processing CreateTablet for tablet cab8e52f4fe747eb812a3c755e89809b (DEFAULT_TABLE table=default.Table_09ec888b149b43dfa3ba5489a26b50cf [id=20586196af864fd3a26fca1810299053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.964470 6271 raft_consensus.cc:348] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.964725 6271 raft_consensus.cc:374] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:21.964782 6271 raft_consensus.cc:729] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:21.964798 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab8e52f4fe747eb812a3c755e89809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.962291 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0b26ed841860437185c8a291e4ea314a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.964955 6271 consensus_queue.cc:260] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:21.965209 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b26ed841860437185c8a291e4ea314a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.965479 6271 ts_tablet_manager.cc:1428] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:21.965749 6271 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:21.971530 7935 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:21.971869 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.971971 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 99d7ce3414d54815aa1798f27aee4298 (DEFAULT_TABLE table=default.Table_62ef942b3a1e4735adeb03b3f519b028 [id=e39568d18bfd4202835e2459b2c155d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.972236 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e19b8189894e91a8be5a150f54cb6b with delete_type TABLET_DATA_DELETED (replaced by tablet c22cc964ceb741febfd3d1322ae05289) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.972410 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d7ce3414d54815aa1798f27aee4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.972532 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c1a1c5e22e455d91de92f0aa3535c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:43:59 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:21.972826 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:21.973008 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 46055.3us
I20260928 10:44:21.974905 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19 (DEFAULT_TABLE table=default.Table_8355c773c7064c6ca162bb655c4f281b [id=ae7fe069283840afb0a91819ff31c9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.974948 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0bfa295c4b0643e19f48abfa5852f75c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.975483 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:21.975536 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bfa295c4b0643e19f48abfa5852f75c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.975733 7935 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:21.976296 7935 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.981263 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_670cc8fb329b4af2b7d545cdd07be5e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:21.981976 7874 raft_consensus.cc:504] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:21.982417 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_670cc8fb329b4af2b7d545cdd07be5e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.982600 7874 leader_election.cc:288] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:21.984205 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:21.988145 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 4bc65ca1ba01481a9efed520c2ea471c from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:21.989496 6271 tablet_bootstrap.cc:654] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:21.994038 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_667eb87198d94c5fa00a0298e6bbf859" } new_table_name: "default.Table_cb9859645bc648b08f6c8885488dc7d7" modify_external_catalogs: true
I20260928 10:44:21.996340 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3dcf323e6c7d48b887a9a5df83f6fa57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:21.996853 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dcf323e6c7d48b887a9a5df83f6fa57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:21.996773 6270 ts_tablet_manager.cc:1918] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:21.996980 6270 log.cc:1196] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/c2f078ae6d2b498d8c5af90afba887ad
I20260928 10:44:21.997324 6270 ts_tablet_manager.cc:1939] T c2f078ae6d2b498d8c5af90afba887ad P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:21.998018 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1040) took 5253 ms. Trace:
I20260928 10:44:22.000079 6275 tablet_bootstrap.cc:654] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.000733 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 10b7de79b43742e9a64776d5a289cbaf (DEFAULT_TABLE table=default.Table_95942e5acb5d44ef91113b0a1ecb10cf [id=9bdbfc5c75084a5c88c777ac4727eb78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.001142 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b7de79b43742e9a64776d5a289cbaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.922747 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 946188e312c6424f81926465667b5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.922909 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet ed443629ab604099a6fe5aff1840a553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:21.945053 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 6e17257dc87a480688f5718457ab7b7f (DEFAULT_TABLE table=default.Table_c653071d01e1479ead4bc5dc60b2417b [id=b42cbc7ee7d3406b8d63812d3731180e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.003228 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e17257dc87a480688f5718457ab7b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.003504 7765 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a1529a7b0d7479db7dabebf471795b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 10:44:21.945262 7880 raft_consensus.cc:482] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.006593 7880 raft_consensus.cc:504] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.007241 7880 leader_election.cc:288] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.007484 7557 ts_tablet_manager.cc:1918] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.007589 7557 log.cc:1196] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:22.007906 7557 ts_tablet_manager.cc:1939] T f95e1588a3d04142ab8d6bb257235dab P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:21.951773 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 99d7ce3414d54815aa1798f27aee4298 (DEFAULT_TABLE table=default.Table_62ef942b3a1e4735adeb03b3f519b028 [id=e39568d18bfd4202835e2459b2c155d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.008287 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d7ce3414d54815aa1798f27aee4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.974557 5855 tablet_service.cc:1467] Processing CreateTablet for tablet cab8e52f4fe747eb812a3c755e89809b (DEFAULT_TABLE table=default.Table_09ec888b149b43dfa3ba5489a26b50cf [id=20586196af864fd3a26fca1810299053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:21.991253 6273 tablet_bootstrap.cc:492] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.010874 6273 ts_tablet_manager.cc:1397] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.123s user 0.008s sys 0.013s
I20260928 10:44:22.010983 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab8e52f4fe747eb812a3c755e89809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:21.994719 6269 ts_tablet_manager.cc:1918] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:21.999933 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19 (DEFAULT_TABLE table=default.Table_8355c773c7064c6ca162bb655c4f281b [id=ae7fe069283840afb0a91819ff31c9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.011436 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.011682 6273 raft_consensus.cc:348] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.011802 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_62812cefd5b44da7a231a4e62521f052 [id=6677562fe2604addb84af531539cbebd]). Expected version 5 got 0
I20260928 10:44:22.011881 6273 raft_consensus.cc:374] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.011930 6273 raft_consensus.cc:729] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.012130 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:22.012128 6273 consensus_queue.cc:260] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.012337 5700 catalog_manager.cc:5495] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:22.012687 6273 ts_tablet_manager.cc:1428] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:22.012785 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 3b2cabf659dc48028605b39c92e1e451 (table default.Table_8efd871139c84e1fadace980a7742a81 [id=3daf4c7bcf784fb0948e743ecec939ed]). Expected version 2 got 0
I20260928 10:44:22.012959 6273 tablet_bootstrap.cc:492] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.013018 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:22.013298 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (table default.Table_02f5489736974455aefc7ae3da68ae7e [id=5b8a74dc9dfd4b2685d2d688454e9670]). Expected version 1 got 0
I20260928 10:44:22.013494 5700 catalog_manager.cc:5495] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:22.016989 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce585cc60d4001b12cb335929b9efb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.017372 6129 tablet_service.cc:1467] Processing CreateTablet for tablet d967c93cdaae43a8a4cd68be2c56940f (DEFAULT_TABLE table=default.Table_470f4fe8be5342abb2ee95bdae94c7eb [id=abe371f8c7cd4775b5bb91aa75067ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.017759 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d967c93cdaae43a8a4cd68be2c56940f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.017741 5817 leader_election.cc:341] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.018159 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 10b7de79b43742e9a64776d5a289cbaf (DEFAULT_TABLE table=default.Table_95942e5acb5d44ef91113b0a1ecb10cf [id=9bdbfc5c75084a5c88c777ac4727eb78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.018543 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b7de79b43742e9a64776d5a289cbaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.023049 7880 raft_consensus.cc:482] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.011353 6269 log.cc:1196] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/daf7a87b82424e25ae47d3f61c2ddb7f
I20260928 10:44:22.023211 7880 raft_consensus.cc:504] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.023501 6269 ts_tablet_manager.cc:1939] T daf7a87b82424e25ae47d3f61c2ddb7f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:22.023772 7880 leader_election.cc:288] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.025641 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946188e312c6424f81926465667b5e11" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.026232 5817 leader_election.cc:341] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.024319 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 902) took 9142 ms. Trace:
I20260928 10:44:22.026898 6269 rpcz_store.cc:276] 0928 10:44:12.882329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.882757 (+ 428us) service_pool.cc:227] Handling call
0928 10:44:21.874681 (+8991924us) ts_tablet_manager.cc:1145] Deleting tablet daf7a87b82424e25ae47d3f61c2ddb7f
0928 10:44:21.874694 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.925934 (+ 51240us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.991179 (+ 65245us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.024297 (+ 33118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8991705}
I20260928 10:44:22.027406 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet daf7a87b82424e25ae47d3f61c2ddb7f (table default.Table_22e1516105d24daaa1e7b491ce777916 [id=2ac5e881f6e94b97a08cc5e7da381a41]) successfully deleted
I20260928 10:44:22.027853 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 903) took 9134 ms. Trace:
I20260928 10:44:22.029320 6269 rpcz_store.cc:276] 0928 10:44:12.893000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.893315 (+ 315us) service_pool.cc:227] Handling call
0928 10:44:22.027728 (+9134413us) ts_tablet_manager.cc:1145] Deleting tablet a36ae00e0f664d4da444a6a4a17bcbca
0928 10:44:22.027739 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.027835 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9134201}
W20260928 10:44:22.029830 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a36ae00e0f664d4da444a6a4a17bcbca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ae00e0f664d4da444a6a4a17bcbca already in progress: creating tablet
I20260928 10:44:22.031486 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 904) took 9098 ms. Trace:
I20260928 10:44:22.032234 7880 raft_consensus.cc:482] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.033685 7880 raft_consensus.cc:504] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.034252 7880 leader_election.cc:288] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.034909 6269 rpcz_store.cc:276] 0928 10:44:12.933326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:12.933395 (+ 69us) service_pool.cc:227] Handling call
0928 10:44:22.031357 (+9097962us) ts_tablet_manager.cc:1145] Deleting tablet 8b167fd6cdbd4b829d962ebafeee0272
0928 10:44:22.031368 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.031468 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9097700}
I20260928 10:44:22.035275 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ea5480bdc0a1454a9886641ff125cd07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.035871 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea5480bdc0a1454a9886641ff125cd07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.037214 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bed64c4a55fb4edeba9c58e6a404c4b0" } new_table_name: "default.Table_f8e80ff1199b44f8a72fe45410dd73a3" modify_external_catalogs: true
I20260928 10:44:22.038656 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03fd57e996c486384f92000925aff8a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.038961 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8b167fd6cdbd4b829d962ebafeee0272 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b167fd6cdbd4b829d962ebafeee0272 already in progress: creating tablet
I20260928 10:44:22.038848 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_9e2edac220624ab4aedc351ce5014443"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.039357 5817 leader_election.cc:341] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.039405 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 920) took 8675 ms. Trace:
W20260928 10:44:22.039419 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e2edac220624ab4aedc351ce5014443 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.039470 6269 rpcz_store.cc:276] 0928 10:44:13.364259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.364745 (+ 486us) service_pool.cc:227] Handling call
0928 10:44:22.039274 (+8674529us) ts_tablet_manager.cc:1145] Deleting tablet 1c7131f9259a404382e86ad06c52b584
0928 10:44:22.039290 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.039387 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8619173}
W20260928 10:44:22.043426 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1c7131f9259a404382e86ad06c52b584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c7131f9259a404382e86ad06c52b584 already in progress: creating tablet
I20260928 10:44:22.044514 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 73fac18294ed4445bd47a93b5629f91a (DEFAULT_TABLE table=default.Table_881ad78ff327442f82d3bca9993b83f8 [id=598698cc984147e2bbe10532b0f278a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.045037 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fac18294ed4445bd47a93b5629f91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.046777 5853 tablet_service.cc:1467] Processing CreateTablet for tablet d967c93cdaae43a8a4cd68be2c56940f (DEFAULT_TABLE table=default.Table_470f4fe8be5342abb2ee95bdae94c7eb [id=abe371f8c7cd4775b5bb91aa75067ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.047761 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d967c93cdaae43a8a4cd68be2c56940f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.052546 7557 tablet_replica.cc:330] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.052873 7557 raft_consensus.cc:2229] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.054848 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet f95e1588a3d04142ab8d6bb257235dab (table default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]) successfully deleted
I20260928 10:44:22.056330 7880 raft_consensus.cc:482] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.056475 7880 raft_consensus.cc:504] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.057047 7880 leader_election.cc:288] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:22.059868 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35af342381bc4151bf8d8c4817d6be52 consensus state has no leader
I20260928 10:44:22.047761 6269 tablet_replica.cc:330] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:22.061043 6269 raft_consensus.cc:2229] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.061318 6269 raft_consensus.cc:2258] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.062006 6269 ts_tablet_manager.cc:1905] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.057657 6134 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d44e2d987494e9048ececed243670 (DEFAULT_TABLE table=default.Table_439f0236567640e5821b851bc1deff18 [id=df3bc53ccd3b4dc1a0af90629c3eae98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.062623 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d44e2d987494e9048ececed243670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.063009 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_46cd6f3ff6a044d0a67fb51c668012df" } modify_external_catalogs: true
I20260928 10:44:22.063876 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b84569684a4648f39fe4d8a129ea6ade" } modify_external_catalogs: true
I20260928 10:44:22.064085 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b84569684a4648f39fe4d8a129ea6ade" } modify_external_catalogs: true
W20260928 10:44:22.064998 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ed0451e509d4580be284739255821e2 consensus state has no leader
I20260928 10:44:22.063304 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_46cd6f3ff6a044d0a67fb51c668012df" } modify_external_catalogs: true
I20260928 10:44:22.065323 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_61f24832d418408ba2b4d047a1a17174" } modify_external_catalogs: true
I20260928 10:44:22.065516 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_61f24832d418408ba2b4d047a1a17174" } modify_external_catalogs: true
I20260928 10:44:22.057670 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.067035 7557 raft_consensus.cc:2258] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:22.067087 5817 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.067234 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 4bc65ca1ba01481a9efed520c2ea471c
I20260928 10:44:22.067664 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 4bc65ca1ba01481a9efed520c2ea471c deleted and replaced by tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a
I20260928 10:44:22.067691 5818 leader_election.cc:302] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.068048 7880 raft_consensus.cc:2726] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.068593 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 153508us
W20260928 10:44:22.068884 5818 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.069078 5818 leader_election.cc:302] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.069387 7880 raft_consensus.cc:2726] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.069775 5818 consensus_peers.cc:487] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:22.069998 5818 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.070101 5855 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d44e2d987494e9048ececed243670 (DEFAULT_TABLE table=default.Table_439f0236567640e5821b851bc1deff18 [id=df3bc53ccd3b4dc1a0af90629c3eae98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.070464 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d44e2d987494e9048ececed243670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.071715 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.072185 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf7a87b82424e25ae47d3f61c2ddb7f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.076385 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c with delete_type TABLET_DATA_DELETED (replaced by tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.077705 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e6aec6578c9040cd9f2c18255f419558" } modify_external_catalogs: true
I20260928 10:44:22.077935 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_e6aec6578c9040cd9f2c18255f419558" } modify_external_catalogs: true
I20260928 10:44:22.078310 7880 raft_consensus.cc:482] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.078433 7880 raft_consensus.cc:504] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:22.079056 7880 leader_election.cc:288] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.082701 7557 ts_tablet_manager.cc:1905] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.082990 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.083699 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_1465606aff3e41dbb04521c83e690ee3" } new_table_name: "default.Table_d96ff2222b8a414784b57a2550f521df" modify_external_catalogs: true
W20260928 10:44:22.084007 5817 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.089485 6270 rpcz_store.cc:276] 0928 10:44:16.744247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.744303 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:21.719812 (+4975509us) ts_tablet_manager.cc:1145] Deleting tablet c2f078ae6d2b498d8c5af90afba887ad
0928 10:44:21.719825 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:21.796899 (+ 77074us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.996673 (+199774us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:21.997996 (+ 1323us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4975144}
I20260928 10:44:22.090101 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1045) took 5184 ms. Trace:
I20260928 10:44:22.090399 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]) successfully deleted
I20260928 10:44:22.090533 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_75f0017090af4347873c9c9e1c58b081"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.091101 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75f0017090af4347873c9c9e1c58b081 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.004565 5955 leader_election.cc:341] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.009511 6271 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.025770 5985 tablet_service.cc:1467] Processing CreateTablet for tablet cab8e52f4fe747eb812a3c755e89809b (DEFAULT_TABLE table=default.Table_09ec888b149b43dfa3ba5489a26b50cf [id=20586196af864fd3a26fca1810299053]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.092391 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 87838.3us
I20260928 10:44:22.092480 6271 ts_tablet_manager.cc:1397] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.002s
W20260928 10:44:22.092525 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d309e810473b4854ac512473f9412105 consensus state has no leader
I20260928 10:44:22.092702 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab8e52f4fe747eb812a3c755e89809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.092832 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a28e0e7c22924ebd924df72e2eec894a" } new_table_name: "default.Table_734cb423db1c42e6bd6ff31f7c748d0e" modify_external_catalogs: true
W20260928 10:44:22.093014 5955 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.093178 5955 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.093233 6271 raft_consensus.cc:348] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.093434 6271 raft_consensus.cc:374] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.093490 6271 raft_consensus.cc:729] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.030516 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19 (DEFAULT_TABLE table=default.Table_8355c773c7064c6ca162bb655c4f281b [id=ae7fe069283840afb0a91819ff31c9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.093659 6271 consensus_queue.cc:260] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.094031 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a28db698e5a4a4dbb1e657d0e0d3c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.094163 6271 ts_tablet_manager.cc:1428] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:22.094394 6271 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.095235 6270 rpcz_store.cc:276] 0928 10:44:16.905669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.905719 (+ 50us) service_pool.cc:227] Handling call
0928 10:44:22.089950 (+5184231us) ts_tablet_manager.cc:1145] Deleting tablet 069469d23ccf446284e67d970ffd6efa
0928 10:44:22.089964 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.090079 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5183833}
W20260928 10:44:22.095630 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 069469d23ccf446284e67d970ffd6efa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069469d23ccf446284e67d970ffd6efa already in progress: creating tablet
I20260928 10:44:22.095935 6271 tablet_bootstrap.cc:654] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.096009 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c with delete_type TABLET_DATA_DELETED (replaced by tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.096385 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1048) took 5166 ms. Trace:
I20260928 10:44:22.096469 6270 rpcz_store.cc:276] 0928 10:44:16.930280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.930384 (+ 104us) service_pool.cc:227] Handling call
0928 10:44:22.096256 (+5165872us) ts_tablet_manager.cc:1145] Deleting tablet 0e149cdb22cc4c60b012c2d87868827b
0928 10:44:22.096272 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.096368 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5148417}
I20260928 10:44:22.096869 6153 raft_consensus.cc:3037] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.031147 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 10b7de79b43742e9a64776d5a289cbaf (DEFAULT_TABLE table=default.Table_95942e5acb5d44ef91113b0a1ecb10cf [id=9bdbfc5c75084a5c88c777ac4727eb78]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.096889 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0e149cdb22cc4c60b012c2d87868827b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e149cdb22cc4c60b012c2d87868827b already in progress: creating tablet
I20260928 10:44:22.097194 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b7de79b43742e9a64776d5a289cbaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.097295 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1054) took 5129 ms. Trace:
I20260928 10:44:22.097368 6270 rpcz_store.cc:276] 0928 10:44:16.968133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.968197 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:22.097187 (+5128990us) ts_tablet_manager.cc:1145] Deleting tablet 5640b425dd9945539dbdf658994c7918
0928 10:44:22.097196 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.097279 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5128768}
W20260928 10:44:22.097677 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 5640b425dd9945539dbdf658994c7918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5640b425dd9945539dbdf658994c7918 already in progress: creating tablet
I20260928 10:44:22.070150 5818 leader_election.cc:302] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.100477 7880 raft_consensus.cc:2726] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.101001 5818 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.101197 5818 leader_election.cc:302] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.101263 6275 tablet_bootstrap.cc:492] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:22.101390 6275 ts_tablet_manager.cc:1397] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.213s user 0.001s sys 0.001s
I20260928 10:44:22.101418 7880 raft_consensus.cc:2726] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.101751 5818 leader_election.cc:341] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.101846 5818 leader_election.cc:302] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.034402 5993 tablet_service.cc:1467] Processing CreateTablet for tablet d967c93cdaae43a8a4cd68be2c56940f (DEFAULT_TABLE table=default.Table_470f4fe8be5342abb2ee95bdae94c7eb [id=abe371f8c7cd4775b5bb91aa75067ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.102028 7880 raft_consensus.cc:2726] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.102264 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d967c93cdaae43a8a4cd68be2c56940f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.102221 6275 raft_consensus.cc:348] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:22.102361 5818 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.102430 6275 raft_consensus.cc:374] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.102511 6275 raft_consensus.cc:729] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.102471 5818 leader_election.cc:302] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.103153 6275 consensus_queue.cc:260] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.103703 6275 ts_tablet_manager.cc:1428] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:22.104480 6275 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:22.104028 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1067) took 4758 ms. Trace:
I20260928 10:44:22.104621 6270 rpcz_store.cc:276] 0928 10:44:17.345377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.345449 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:22.103877 (+4758428us) ts_tablet_manager.cc:1145] Deleting tablet d605cff11a05407b979c5aeea4534893
0928 10:44:22.103890 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.104004 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4758209}
W20260928 10:44:22.105100 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d605cff11a05407b979c5aeea4534893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d605cff11a05407b979c5aeea4534893 already in progress: creating tablet
I20260928 10:44:22.106796 6275 tablet_bootstrap.cc:654] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.107653 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1068) took 4672 ms. Trace:
I20260928 10:44:22.110112 7937 raft_consensus.cc:482] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.110252 7937 raft_consensus.cc:504] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.041774 6002 tablet_service.cc:1467] Processing CreateTablet for tablet 73fac18294ed4445bd47a93b5629f91a (DEFAULT_TABLE table=default.Table_881ad78ff327442f82d3bca9993b83f8 [id=598698cc984147e2bbe10532b0f278a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.110858 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fac18294ed4445bd47a93b5629f91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.111074 7937 leader_election.cc:288] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.068835 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bc65ca1ba01481a9efed520c2ea471c with delete_type TABLET_DATA_DELETED (replaced by tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.074983 5994 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d44e2d987494e9048ececed243670 (DEFAULT_TABLE table=default.Table_439f0236567640e5821b851bc1deff18 [id=df3bc53ccd3b4dc1a0af90629c3eae98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.114840 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d44e2d987494e9048ececed243670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.115387 7880 raft_consensus.cc:2726] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.115311 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_368933fff1624ef4b64b1f8a83225d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.115692 7880 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:22.115864 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_368933fff1624ef4b64b1f8a83225d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.115810 7880 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.116374 7880 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.119275 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce585cc60d4001b12cb335929b9efb" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.119323 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946188e312c6424f81926465667b5e11" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.119346 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.119910 5817 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.119913 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03fd57e996c486384f92000925aff8a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.002657 7782 raft_consensus.cc:686] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.120347 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.120774 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.120949 6013 raft_consensus.cc:2454] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:22.120249 7782 consensus_queue.cc:237] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.122296 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.122526 6013 raft_consensus.cc:2454] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:22.123032 7880 raft_consensus.cc:482] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.123191 7880 raft_consensus.cc:504] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.123881 7880 leader_election.cc:288] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.124593 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.108445 7933 consensus_queue.cc:1035] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260928 10:44:22.125015 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.125479 5817 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.125653 7880 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.125816 7880 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.108629 6270 rpcz_store.cc:276] 0928 10:44:17.435667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.435730 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:22.107507 (+4671777us) ts_tablet_manager.cc:1145] Deleting tablet b7065d8329b146b789216da84c9357b2
0928 10:44:22.107519 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.107629 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4671587}
I20260928 10:44:22.126636 7880 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.126930 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1071) took 4624 ms. Trace:
I20260928 10:44:22.127578 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.127807 5884 raft_consensus.cc:2454] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.128110 5874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.128302 5874 raft_consensus.cc:2454] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.128917 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37669fbe13614892a9b8cc2df4e10b4a" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.129101 5872 raft_consensus.cc:3037] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.129124 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.129657 5817 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.130151 5955 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.131876 5872 raft_consensus.cc:2454] T 37669fbe13614892a9b8cc2df4e10b4a P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.132176 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.132416 5870 raft_consensus.cc:2454] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.132515 7557 ts_tablet_manager.cc:1918] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.132704 7884 tablet.cc:1722] T 28efefe228f24b01914e0d43be5061ce P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 10:44:22.134976 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b7065d8329b146b789216da84c9357b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7065d8329b146b789216da84c9357b2 already in progress: creating tablet
I20260928 10:44:22.013883 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5afe4501ea584d44b511b89983e210e3 (table default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73]). Expected version 1 got 0
I20260928 10:44:22.140933 7947 tablet.cc:1722] T 943db4a7f3fe4283a67defd68e744e33 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:22.142853 6271 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.143000 6271 ts_tablet_manager.cc:1397] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.000s
I20260928 10:44:22.143981 6271 raft_consensus.cc:348] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.144187 6271 raft_consensus.cc:374] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.144229 6271 raft_consensus.cc:729] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.144411 6271 consensus_queue.cc:260] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.144915 6271 ts_tablet_manager.cc:1428] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:22.145151 6271 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.146687 6271 tablet_bootstrap.cc:654] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.148902 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.149128 5883 raft_consensus.cc:2454] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.149259 6271 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.149377 6271 ts_tablet_manager.cc:1397] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260928 10:44:22.150029 6271 raft_consensus.cc:348] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.150219 6271 raft_consensus.cc:374] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.150259 6271 raft_consensus.cc:729] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.150420 6271 consensus_queue.cc:260] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.150940 6271 ts_tablet_manager.cc:1428] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:22.151216 6271 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.036485 6273 tablet_bootstrap.cc:654] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.136154 7875 raft_consensus.cc:482] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.169392 6273 tablet_bootstrap.cc:492] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.169551 6273 ts_tablet_manager.cc:1397] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.157s user 0.016s sys 0.000s
I20260928 10:44:22.142870 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 73fac18294ed4445bd47a93b5629f91a (DEFAULT_TABLE table=default.Table_881ad78ff327442f82d3bca9993b83f8 [id=598698cc984147e2bbe10532b0f278a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.170240 6273 raft_consensus.cc:348] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.170550 6273 raft_consensus.cc:374] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.170614 6273 raft_consensus.cc:729] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.170794 6273 consensus_queue.cc:260] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.174521 6273 ts_tablet_manager.cc:1428] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 10:44:22.174839 6273 tablet_bootstrap.cc:492] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.176189 6273 tablet_bootstrap.cc:654] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.152700 6271 tablet_bootstrap.cc:654] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.162636 7934 raft_consensus.cc:482] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.180477 7934 raft_consensus.cc:504] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.181006 7934 leader_election.cc:288] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.177556 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.177578 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.181352 6012 raft_consensus.cc:2454] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:22.178740 7933 raft_consensus.cc:482] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.181543 7933 raft_consensus.cc:504] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.182317 7933 leader_election.cc:288] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.168635 7875 raft_consensus.cc:504] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.182760 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.127029 6270 rpcz_store.cc:276] 0928 10:44:17.502100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.502159 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:22.126789 (+4624630us) ts_tablet_manager.cc:1145] Deleting tablet b2c52b6b88a44a4e925dcf1c3f9232e1
0928 10:44:22.126802 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.126899 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4624410}
I20260928 10:44:22.183159 7875 leader_election.cc:288] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:22.183198 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2c52b6b88a44a4e925dcf1c3f9232e1 already in progress: creating tablet
I20260928 10:44:22.183303 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.177843 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fac18294ed4445bd47a93b5629f91a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.183770 5955 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.184115 6269 ts_tablet_manager.cc:1918] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.184351 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490f8a4f1f9245cfab168b96511e18de" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.184448 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1079) took 4681 ms. Trace:
I20260928 10:44:22.168229 7557 log.cc:1196] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/00b7e26971914613a2372476b348b702
I20260928 10:44:22.190965 7557 ts_tablet_manager.cc:1939] T 00b7e26971914613a2372476b348b702 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.191669 7557 tablet_replica.cc:330] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.191615 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 00b7e26971914613a2372476b348b702 (table default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]) successfully deleted
I20260928 10:44:22.191975 7557 raft_consensus.cc:2229] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.192129 7557 raft_consensus.cc:2258] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.192701 7557 ts_tablet_manager.cc:1905] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.202859 5695 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 66ac9b03c63b45978405477392d0905d
I20260928 10:44:22.205261 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.205791 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 8735b36bd56e41629089437b5d92c793
I20260928 10:44:22.209306 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 8735b36bd56e41629089437b5d92c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.212934 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_027e045946fe474dbafb252ca0ec9ef0" } modify_external_catalogs: true
I20260928 10:44:22.213202 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_027e045946fe474dbafb252ca0ec9ef0" } modify_external_catalogs: true
I20260928 10:44:22.217656 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0de0ff28393d479dadb5e2f3e415d1fa
W20260928 10:44:22.217686 6091 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 48853.4us
I20260928 10:44:22.218206 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet ddd0439f5f6d4323978bb5fe2d039f75 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:22.218909 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.218861 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a8f8fd63ec8243e8b89da30593662165"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.219492 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8f8fd63ec8243e8b89da30593662165 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.220708 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32258185a7144e0282c9ae8f246faeda consensus state has no leader
I20260928 10:44:22.221206 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3b99217e4aba47bfa730b2c4a56c269c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.221730 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b99217e4aba47bfa730b2c4a56c269c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.223166 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f0d0878809846aab7e039aa6e2a0f40 consensus state has no leader
I20260928 10:44:22.228999 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_76e6f3d32aff4e74a39a388e9207c0fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.229632 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76e6f3d32aff4e74a39a388e9207c0fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.230548 7557 ts_tablet_manager.cc:1918] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.230690 7557 log.cc:1196] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/2ab439922c6e4ffea8d8cdb6b7d8d8d7
I20260928 10:44:22.230814 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 76b4ceadef8b4a729ca4204259e64cbd
I20260928 10:44:22.231029 7557 ts_tablet_manager.cc:1939] T 2ab439922c6e4ffea8d8cdb6b7d8d8d7 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.232081 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 (table default.Table_9d4a7be11896409ebc4138bc454bc2bb [id=b1363dbf11ec4d228eac4323ea1ad5d9]) successfully deleted
I20260928 10:44:22.232198 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:22.233554 5686 catalog_manager.cc:4808] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet bb5eed4318fe482789fee32e24a49bfc because the tablet was not found. No further retry: Not found: Tablet not found: bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:22.233906 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c93d712f68d0481ba9d06859d3801a2d
I20260928 10:44:22.235167 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet c93d712f68d0481ba9d06859d3801a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.242806 7557 tablet_replica.cc:330] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.243952 7557 raft_consensus.cc:2229] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.249102 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5d6f388d56f04696940caef30b213ca6 (table default.Table_55bab94bf4ee420aa5635c934e28f9cf [id=3f375f4cb4f34d57a8a5d38d8655325d]). Expected version 2 got 0
I20260928 10:44:22.249738 7557 raft_consensus.cc:2258] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.250514 7557 ts_tablet_manager.cc:1905] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.257650 7557 ts_tablet_manager.cc:1918] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.261950 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f4c52cb7dec54b089da45cb49733dd44" } new_table_name: "default.Table_d01ee4d375f04f2c94a40b83aa6f2ae3" modify_external_catalogs: true
I20260928 10:44:22.265647 6570 generic_service.cc:196] Checking for leaks (request via RPC)
W20260928 10:44:22.184921 5955 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.201053 6271 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
W20260928 10:44:22.266196 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 81290.5us
I20260928 10:44:22.224624 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.228753 6002 tablet_service.cc:1514] Processing DeleteTablet for tablet f5a00b74133a406996820adcb71194df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.229408 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.207082 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 8735b36bd56e41629089437b5d92c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.230247 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 25a2f20766024978a16b6bccd366a848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.230736 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.231523 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.231891 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.234738 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet c93d712f68d0481ba9d06859d3801a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.266278 6271 ts_tablet_manager.cc:1397] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.001s
I20260928 10:44:22.267350 7933 raft_consensus.cc:482] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.267486 7933 raft_consensus.cc:504] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.267964 6271 raft_consensus.cc:348] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.268169 6271 raft_consensus.cc:374] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.268217 6271 raft_consensus.cc:729] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.268399 6271 consensus_queue.cc:260] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.268093 7933 leader_election.cc:288] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.269125 6270 rpcz_store.cc:276] 0928 10:44:17.502788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.502854 (+ 66us) service_pool.cc:227] Handling call
0928 10:44:22.184365 (+4681511us) ts_tablet_manager.cc:1145] Deleting tablet b6d5121db2d34ea99c851595c395f3be
0928 10:44:22.184375 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.184435 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4681302}
W20260928 10:44:22.269549 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b6d5121db2d34ea99c851595c395f3be because the tablet was not found. No further retry: Not found: Tablet not found: b6d5121db2d34ea99c851595c395f3be
I20260928 10:44:22.270310 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fdda0fc49458417eaecd5e00951687e9" } new_table_name: "default.Table_021deb04cd0143c3b2290405cab067af" modify_external_catalogs: true
I20260928 10:44:22.270224 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8a230d3aa7424bef90d2adb952790fe6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.270736 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b00a13cb5f4341668a185c768b9975b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.270874 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a230d3aa7424bef90d2adb952790fe6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.271171 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b00a13cb5f4341668a185c768b9975b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.271495 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1073) took 4769 ms. Trace:
I20260928 10:44:22.271571 6270 rpcz_store.cc:276] 0928 10:44:17.502299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.502926 (+ 627us) service_pool.cc:227] Handling call
0928 10:44:22.271384 (+4768458us) ts_tablet_manager.cc:1145] Deleting tablet f7d762e03b384d85b4e04be8331474a4
0928 10:44:22.271396 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.271477 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4768281}
W20260928 10:44:22.271962 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f7d762e03b384d85b4e04be8331474a4 because the tablet was not found. No further retry: Not found: Tablet not found: f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:22.272277 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1077) took 4769 ms. Trace:
I20260928 10:44:22.272344 6270 rpcz_store.cc:276] 0928 10:44:17.502645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.503015 (+ 370us) service_pool.cc:227] Handling call
0928 10:44:22.272199 (+4769184us) ts_tablet_manager.cc:1145] Deleting tablet ffa971239a2b4ac6bc309dfbacdbe12e
0928 10:44:22.272210 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.272264 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4769065}
W20260928 10:44:22.272652 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet ffa971239a2b4ac6bc309dfbacdbe12e because the tablet was not found. No further retry: Not found: Tablet not found: ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:22.272924 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1074) took 4770 ms. Trace:
W20260928 10:44:22.196521 5818 leader_election.cc:341] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.273729 5818 leader_election.cc:302] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:22.274065 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 77553.8us
W20260928 10:44:22.274290 5818 leader_election.cc:341] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.274385 5818 leader_election.cc:302] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:22.274716 5818 leader_election.cc:341] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.274801 5818 leader_election.cc:302] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.207080 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 8735b36bd56e41629089437b5d92c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.218544 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de0ff28393d479dadb5e2f3e415d1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.231628 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 76b4ceadef8b4a729ca4204259e64cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.234787 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet c93d712f68d0481ba9d06859d3801a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.257390 7880 raft_consensus.cc:482] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.275307 7880 raft_consensus.cc:504] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.275945 7880 leader_election.cc:288] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.276064 7880 raft_consensus.cc:2726] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.276176 7880 raft_consensus.cc:2726] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.275312 7954 raft_consensus.cc:2726] T e2ce585cc60d4001b12cb335929b9efb P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.279472 6270 rpcz_store.cc:276] 0928 10:44:17.502375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.503132 (+ 757us) service_pool.cc:227] Handling call
0928 10:44:22.272850 (+4769718us) ts_tablet_manager.cc:1145] Deleting tablet 44bc6831f9354ddb81212bc107efdf68
0928 10:44:22.272859 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.272908 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4769608}
W20260928 10:44:22.280021 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 44bc6831f9354ddb81212bc107efdf68 because the tablet was not found. No further retry: Not found: Tablet not found: 44bc6831f9354ddb81212bc107efdf68
I20260928 10:44:22.280467 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1080) took 4777 ms. Trace:
I20260928 10:44:22.280597 6270 rpcz_store.cc:276] 0928 10:44:17.502872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.503159 (+ 287us) service_pool.cc:227] Handling call
0928 10:44:22.280345 (+4777186us) ts_tablet_manager.cc:1145] Deleting tablet 6eeceb0dbb064221b6ff2a76c8bf8b79
0928 10:44:22.280356 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.280447 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4777080}
W20260928 10:44:22.281138 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 already in progress: creating tablet
I20260928 10:44:22.261893 5957 leader_election.cc:302] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:22.281737 5957 leader_election.cc:341] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: daf7a87b82424e25ae47d3f61c2ddb7f
I20260928 10:44:22.281898 5957 leader_election.cc:302] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.282294 5957 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.282727 7934 raft_consensus.cc:2726] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.282891 7934 raft_consensus.cc:2781] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.282966 7934 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.283028 7934 raft_consensus.cc:3037] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.285485 7934 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.286054 7934 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.286931 7880 raft_consensus.cc:482] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.287063 7880 raft_consensus.cc:504] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.287400 5957 leader_election.cc:302] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.287569 7880 leader_election.cc:288] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.287699 7934 raft_consensus.cc:2781] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.287909 7934 raft_consensus.cc:686] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.288172 7934 consensus_queue.cc:237] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.276669 7933 raft_consensus.cc:482] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.296187 7933 raft_consensus.cc:504] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.296790 7933 leader_election.cc:288] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.282444 7936 raft_consensus.cc:2781] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.298373 7936 raft_consensus.cc:482] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.298516 7936 raft_consensus.cc:3037] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.301122 7874 raft_consensus.cc:482] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.301038 7936 raft_consensus.cc:504] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.301244 7874 raft_consensus.cc:504] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.301692 7936 leader_election.cc:288] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.301764 7874 leader_election.cc:288] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.275779 6271 ts_tablet_manager.cc:1428] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:44:22.302646 6271 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.273725 6269 log.cc:1196] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/bc7aa301bfbb4097b386a0d23cfa91e1
I20260928 10:44:22.303419 6269 ts_tablet_manager.cc:1939] T bc7aa301bfbb4097b386a0d23cfa91e1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:22.304104 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 941) took 8592 ms. Trace:
I20260928 10:44:22.304147 6271 tablet_bootstrap.cc:654] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.304189 6269 rpcz_store.cc:276] 0928 10:44:13.711739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.711785 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:22.043860 (+8332075us) ts_tablet_manager.cc:1145] Deleting tablet bc7aa301bfbb4097b386a0d23cfa91e1
0928 10:44:22.043874 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.075575 (+ 31701us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.184005 (+108430us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.304084 (+120079us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8308483}
I20260928 10:44:22.304644 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 944) took 8572 ms. Trace:
I20260928 10:44:22.304677 5957 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.304730 7880 raft_consensus.cc:482] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.304894 7782 raft_consensus.cc:2781] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.304955 7782 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.304872 7880 raft_consensus.cc:504] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.305164 7782 raft_consensus.cc:3037] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.305496 7880 leader_election.cc:288] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.305707 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet bc7aa301bfbb4097b386a0d23cfa91e1 (table default.Table_6089745a618d42d496cff786eba718fa [id=2f4692f3be284f3c81ec608ace7d6d0f]) successfully deleted
I20260928 10:44:22.304745 6269 rpcz_store.cc:276] 0928 10:44:13.732390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.732514 (+ 124us) service_pool.cc:227] Handling call
0928 10:44:22.304505 (+8571991us) ts_tablet_manager.cc:1145] Deleting tablet c2af1c83c4544bc68c67f7002742b2cd
0928 10:44:22.304517 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.304627 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8568282}
I20260928 10:44:22.306674 7936 consensus_queue.cc:1035] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:22.306980 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet c2af1c83c4544bc68c67f7002742b2cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2af1c83c4544bc68c67f7002742b2cd already in progress: creating tablet
I20260928 10:44:22.307698 7782 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.308256 7782 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.310559 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:22.312314 6273 tablet_bootstrap.cc:492] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.312448 6273 ts_tablet_manager.cc:1397] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.138s user 0.002s sys 0.000s
I20260928 10:44:22.313174 5957 leader_election.cc:302] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.313110 6273 raft_consensus.cc:348] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.313319 6273 raft_consensus.cc:374] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.313373 6273 raft_consensus.cc:729] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.313652 7933 raft_consensus.cc:2781] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.313781 7933 raft_consensus.cc:482] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.314096 7933 raft_consensus.cc:3037] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.317023 7933 raft_consensus.cc:504] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.318004 7933 leader_election.cc:288] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.320114 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_87de69693e544fa080beb3fb2a8999c3" } new_table_name: "default.Table_f6940666589d4510a2814788ee78a751" modify_external_catalogs: true
W20260928 10:44:22.321261 5955 consensus_peers.cc:487] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00b7e26971914613a2372476b348b702. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:22.321597 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4baa3fa5bf1142a283ad2ebced810d54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.322129 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4baa3fa5bf1142a283ad2ebced810d54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.323429 7880 raft_consensus.cc:482] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.323665 7880 raft_consensus.cc:504] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.324302 7880 leader_election.cc:288] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.324430 7880 raft_consensus.cc:482] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.324534 7880 raft_consensus.cc:504] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.324945 7880 leader_election.cc:288] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.325598 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_45dcc69f1e6e4a5aaa7aec8166925296"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.326145 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45dcc69f1e6e4a5aaa7aec8166925296 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.328282 6273 consensus_queue.cc:260] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.329866 6273 ts_tablet_manager.cc:1428] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 10:44:22.330166 6273 tablet_bootstrap.cc:492] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.273417 6145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0584d6b80e43eb913c3932256cd89e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.276409 6147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.331099 7557 log.cc:1196] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:22.306392 6142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.294963 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b254b5f8163d45cc8e1beb77d6ac4a65" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.319904 6155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25a2f20766024978a16b6bccd366a848" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.331445 7557 ts_tablet_manager.cc:1939] T 1072cf156cdf4c2a8c9d9764de110c6d P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.320149 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.320500 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.320665 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:22.332105 5955 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.332293 5955 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.332397 5955 leader_election.cc:341] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.332509 5955 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.332634 5955 leader_election.cc:341] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.333552 7557 tablet_replica.cc:330] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.333751 7557 raft_consensus.cc:2229] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.322618 6138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.333912 7557 raft_consensus.cc:2258] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.323145 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.325985 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22c4cea3f8ea413493c3ac23f83d0801" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.327343 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df846e6bb5b54ddd8ac5df678803d739" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.334331 5955 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.334450 7557 ts_tablet_manager.cc:1905] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:22.334726 5955 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.334772 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1072cf156cdf4c2a8c9d9764de110c6d (table default.Table_8fbb02cd83954bd2ad721b776064fa23 [id=aa0fbbc798a8402e98d41714bad869b7]) successfully deleted
W20260928 10:44:22.335186 5817 leader_election.cc:341] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.335377 5817 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.335522 5817 leader_election.cc:341] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.335640 5817 leader_election.cc:341] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.335777 5817 leader_election.cc:341] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.335716 7934 consensus_queue.cc:1035] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:22.336143 6273 tablet_bootstrap.cc:654] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:22.342736 5955 consensus_peers.cc:487] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ef1e7125d4e42f5b30f33bfa588511c. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:22.345619 6270 tablet_replica.cc:330] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:22.346038 6270 raft_consensus.cc:2229] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:22.330514 7945 log.cc:924] Time spent T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260928 10:44:22.346639 6270 raft_consensus.cc:2258] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:22.346776 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cda7121a474493ea13937ffa5004bb9 consensus state has no leader
W20260928 10:44:22.347257 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57c925616df64d1eb141ea85b43c3887 consensus state has no leader
I20260928 10:44:22.347887 6270 ts_tablet_manager.cc:1905] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:22.353062 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eaebc067027e4151b8a46eac9d31b05b consensus state has no leader
I20260928 10:44:22.362180 6275 tablet_bootstrap.cc:492] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:22.362528 6275 ts_tablet_manager.cc:1397] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.258s user 0.003s sys 0.000s
I20260928 10:44:22.370293 6271 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.370581 6271 ts_tablet_manager.cc:1397] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.068s user 0.009s sys 0.000s
W20260928 10:44:22.370661 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 95934.8us
W20260928 10:44:22.371207 5818 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.371307 6271 raft_consensus.cc:348] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.371531 6271 raft_consensus.cc:374] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.371598 6271 raft_consensus.cc:729] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.371781 6271 consensus_queue.cc:260] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.372236 5818 leader_election.cc:302] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.372277 6271 ts_tablet_manager.cc:1428] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:22.372543 6271 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.372812 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e4594eae7b840ff980f67da8ed82e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.372941 5818 leader_election.cc:302] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.373205 7880 raft_consensus.cc:2726] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.373370 7880 raft_consensus.cc:2781] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.373451 7880 raft_consensus.cc:482] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.373519 7880 raft_consensus.cc:3037] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.373898 6271 tablet_bootstrap.cc:654] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.376371 7880 raft_consensus.cc:504] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:22.377002 7880 leader_election.cc:288] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.377710 5818 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.377976 7880 raft_consensus.cc:2781] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.378082 7880 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.378175 7880 raft_consensus.cc:3037] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.379518 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:22.380543 6275 raft_consensus.cc:348] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.380681 7880 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.380822 6275 raft_consensus.cc:374] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.380914 6275 raft_consensus.cc:729] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.381196 6275 consensus_queue.cc:260] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.381675 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:22.382167 5817 leader_election.cc:341] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.382393 7880 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.382615 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:22.383000 5817 leader_election.cc:341] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.384974 5818 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.385070 5818 leader_election.cc:302] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.385367 5818 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.385550 7880 raft_consensus.cc:2726] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.385738 7880 raft_consensus.cc:2781] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.385797 7880 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.385852 7880 raft_consensus.cc:3037] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.388296 7880 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.389287 7880 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.389588 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:22.390090 5817 leader_election.cc:341] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.391767 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 25a2f20766024978a16b6bccd366a848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:11 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.393782 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.394553 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b254b5f8163d45cc8e1beb77d6ac4a65" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.394866 6269 tablet_replica.cc:330] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:22.395123 6269 raft_consensus.cc:2229] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.395354 6269 raft_consensus.cc:2258] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.395350 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.395762 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df846e6bb5b54ddd8ac5df678803d739" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.396399 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22c4cea3f8ea413493c3ac23f83d0801" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.397116 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c67f960eb84426f9ebdfef33306a9d0" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:22.397282 6012 raft_consensus.cc:3037] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.396473 6269 ts_tablet_manager.cc:1905] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.397534 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:22.397727 6013 raft_consensus.cc:2379] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab770e77cb704ea38b5ca8cff97dc73b in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:22.400168 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:22.400372 6013 raft_consensus.cc:2379] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab770e77cb704ea38b5ca8cff97dc73b in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:22.401863 6012 raft_consensus.cc:2454] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:22.403365 7958 raft_consensus.cc:482] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.403604 7958 raft_consensus.cc:504] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.404755 7958 leader_election.cc:288] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.404953 7958 raft_consensus.cc:482] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.405129 7958 raft_consensus.cc:504] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.406147 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cdff9f01974354a81179dd9bd5a26e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.406791 5817 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.407001 7958 leader_election.cc:288] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.407912 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.408475 5817 leader_election.cc:341] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.410089 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_552d092ff6c04813ac3fc542db212c21" } modify_external_catalogs: true
I20260928 10:44:22.410296 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_552d092ff6c04813ac3fc542db212c21" } modify_external_catalogs: true
I20260928 10:44:22.410774 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_78b4faac9b3840ad92ad3350a8777a44" } modify_external_catalogs: true
I20260928 10:44:22.410930 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_78b4faac9b3840ad92ad3350a8777a44" } modify_external_catalogs: true
I20260928 10:44:22.412014 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_50a37b3481314f57a58cac202cec28a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.412572 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50a37b3481314f57a58cac202cec28a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.412748 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.412972 5869 raft_consensus.cc:2454] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.413429 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.413596 5869 raft_consensus.cc:2454] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:22.415925 5955 consensus_peers.cc:487] T 871fb70fea304b08bebce18c60998209 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:22.416153 7880 raft_consensus.cc:482] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.416265 7880 raft_consensus.cc:504] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.417186 7880 leader_election.cc:288] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.417395 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.417865 5817 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.418176 7934 raft_consensus.cc:482] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.418324 7934 raft_consensus.cc:504] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.418876 6275 ts_tablet_manager.cc:1428] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260928 10:44:22.419178 7934 leader_election.cc:288] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.423146 6275 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:22.424976 7880 raft_consensus.cc:482] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.425243 7880 raft_consensus.cc:504] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.426177 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.426723 5955 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.427438 6273 tablet_bootstrap.cc:492] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.427597 6273 ts_tablet_manager.cc:1397] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.001s
I20260928 10:44:22.428503 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_9bffbab1e55e478882d8115ab0e8b826" } new_table_name: "default.Table_db691292246d4d74a972b8254d349d6a" modify_external_catalogs: true
I20260928 10:44:22.428664 5701 master_service.cc:946] ReplaceTablet: received request to replace tablet a8ad986491cf44669c6a5ef3f6ea21ef from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:22.429061 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.429637 5817 leader_election.cc:341] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.429826 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_43b0d7ede61447d2af06a56ea5c886b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.430317 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43b0d7ede61447d2af06a56ea5c886b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.431424 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eb4c3825bbaa466480697ebfb8b81161" } new_table_name: "default.Table_754e5b120bc34241bc3b78aa28f0b8e4" modify_external_catalogs: true
I20260928 10:44:22.432588 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_f3c7ad9611054c3d92b93aee18e7e70b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.433058 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3c7ad9611054c3d92b93aee18e7e70b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.433750 7880 leader_election.cc:288] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.433884 7880 raft_consensus.cc:482] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.434648 5693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_45dcc69f1e6e4a5aaa7aec8166925296" } modify_external_catalogs: true
I20260928 10:44:22.434791 5693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_45dcc69f1e6e4a5aaa7aec8166925296" } modify_external_catalogs: true
I20260928 10:44:22.434585 7880 raft_consensus.cc:504] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.435449 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6ecb8e4169d14e90a7409639bc795f36" } modify_external_catalogs: true
I20260928 10:44:22.435601 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_6ecb8e4169d14e90a7409639bc795f36" } modify_external_catalogs: true
I20260928 10:44:22.436075 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed443629ab604099a6fe5aff1840a553" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.436599 5817 leader_election.cc:341] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.438364 7955 raft_consensus.cc:482] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.438529 7955 raft_consensus.cc:504] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.438786 7880 leader_election.cc:288] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.439029 7955 leader_election.cc:288] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.439654 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c780d8c23a764f769848fa04550ceff6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.440200 5817 leader_election.cc:341] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.441045 6273 raft_consensus.cc:348] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.441339 6273 raft_consensus.cc:374] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.441433 6273 raft_consensus.cc:729] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.442052 6275 tablet_bootstrap.cc:654] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.443189 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.443396 5869 raft_consensus.cc:2379] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:22.444337 6270 ts_tablet_manager.cc:1918] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.444536 6270 log.cc:1196] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a61d97ed6b7b4dcba34a7a2190316b02
W20260928 10:44:22.444612 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db842351a0942f3b4ec62a917a71234 consensus state has no leader
I20260928 10:44:22.444975 6270 ts_tablet_manager.cc:1939] T a61d97ed6b7b4dcba34a7a2190316b02 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:22.444988 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_05f78676f8474c24bb3bc74b804474c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.445554 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05f78676f8474c24bb3bc74b804474c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.447391 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2990e37a9648669eb39a865392c9e7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.447641 5869 raft_consensus.cc:3037] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:22.448724 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a87dd8e89c394e4f96c9d8c5fed17e66 consensus state has no leader
I20260928 10:44:22.449091 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_601cf51af57b4b9d91d6e9293655f992" } modify_external_catalogs: true
I20260928 10:44:22.449247 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_601cf51af57b4b9d91d6e9293655f992" } modify_external_catalogs: true
I20260928 10:44:22.450423 5693 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet e65dac9f11704728a49fc39c5dde20b1
I20260928 10:44:22.451670 6275 tablet_bootstrap.cc:492] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:22.451747 6269 ts_tablet_manager.cc:1918] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.451983 6269 log.cc:1196] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f7d762e03b384d85b4e04be8331474a4
I20260928 10:44:22.452298 5869 raft_consensus.cc:2454] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.441733 6273 consensus_queue.cc:260] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.452957 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.453174 5870 raft_consensus.cc:2379] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:22.454133 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5a00b74133a406996820adcb71194df" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.454272 5870 raft_consensus.cc:3037] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.455888 7933 raft_consensus.cc:482] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.456032 7933 raft_consensus.cc:504] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.456630 7933 leader_election.cc:288] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.456786 5870 raft_consensus.cc:2454] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.457122 7958 raft_consensus.cc:482] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.457221 7958 raft_consensus.cc:504] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.457703 7958 leader_election.cc:288] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.458945 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.459101 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.459259 5869 raft_consensus.cc:2454] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:22.459537 5955 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.461081 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7ba94f3efa4acda249ea0375547cc9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.461762 5817 leader_election.cc:341] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.462241 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_84723497434e4863be28332667fc4f66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.462878 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84723497434e4863be28332667fc4f66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.451860 6275 ts_tablet_manager.cc:1397] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260928 10:44:22.464691 6275 raft_consensus.cc:348] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.464980 6275 raft_consensus.cc:374] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.465073 6275 raft_consensus.cc:729] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.465406 7933 raft_consensus.cc:482] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.465595 7933 raft_consensus.cc:504] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.466152 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0b8767ef9ec3453bbe858244b9c284b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.466583 7933 leader_election.cc:288] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.466877 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.467355 5955 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.470994 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b8767ef9ec3453bbe858244b9c284b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.473637 7557 ts_tablet_manager.cc:1918] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.474094 7557 log.cc:1196] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/cd65a860b00d4a7ba8ae92dde5818212
I20260928 10:44:22.474874 6275 consensus_queue.cc:260] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.475364 7557 ts_tablet_manager.cc:1939] T cd65a860b00d4a7ba8ae92dde5818212 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.476001 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.476253 5872 raft_consensus.cc:2454] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.476756 7841 raft_consensus.cc:482] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.476899 7841 raft_consensus.cc:504] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.477481 7841 leader_election.cc:288] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.481180 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.481218 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.481383 5872 raft_consensus.cc:2454] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:22.481707 5955 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.482218 6275 ts_tablet_manager.cc:1428] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260928 10:44:22.483145 6275 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:22.484961 6273 ts_tablet_manager.cc:1428] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.057s user 0.000s sys 0.002s
I20260928 10:44:22.485251 6273 tablet_bootstrap.cc:492] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.485881 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.486088 5872 raft_consensus.cc:2454] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.486585 6273 tablet_bootstrap.cc:654] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:22.487401 6091 leader_election.cc:341] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 490f8a4f1f9245cfab168b96511e18de
I20260928 10:44:22.487517 6091 leader_election.cc:302] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.487634 6271 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.487754 6271 ts_tablet_manager.cc:1397] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.115s user 0.006s sys 0.000s
I20260928 10:44:22.487882 7875 raft_consensus.cc:2726] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.488336 6271 raft_consensus.cc:348] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.488551 6271 raft_consensus.cc:374] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.488600 6271 raft_consensus.cc:729] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.488744 6269 ts_tablet_manager.cc:1939] T f7d762e03b384d85b4e04be8331474a4 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:22.488775 6271 consensus_queue.cc:260] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.489353 6271 ts_tablet_manager.cc:1428] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:22.489594 6271 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.489789 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 938) took 8813 ms. Trace:
I20260928 10:44:22.489519 7557 tablet_replica.cc:330] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.489954 6269 rpcz_store.cc:276] 0928 10:44:13.675859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.711485 (+ 35626us) service_pool.cc:227] Handling call
0928 10:44:22.394814 (+8683329us) ts_tablet_manager.cc:1145] Deleting tablet f7d762e03b384d85b4e04be8331474a4
0928 10:44:22.394828 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.400332 (+ 5504us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.451641 (+ 51309us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.489767 (+ 38126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8656566}
I20260928 10:44:22.490533 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f7d762e03b384d85b4e04be8331474a4 (table default.Table_08fb425defb24a40a3203b8de718af55 [id=2776e86a15344755881dc6e2e79da7b1]) successfully deleted
I20260928 10:44:22.491140 6269 tablet_replica.cc:330] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:22.491122 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.492131 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cdff9f01974354a81179dd9bd5a26e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.492746 6269 raft_consensus.cc:2229] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.480643 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet cd65a860b00d4a7ba8ae92dde5818212 (table default.Table_5cb651a795e04fc59d29bd7535556cbf [id=cfdc4695a4d8442b88b15f1a81a95c5b]) successfully deleted
I20260928 10:44:22.493351 6269 raft_consensus.cc:2258] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.493788 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:22.493842 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 4bc65ca1ba01481a9efed520c2ea471c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bc65ca1ba01481a9efed520c2ea471c already in progress: creating tablet
I20260928 10:44:22.495640 6271 tablet_bootstrap.cc:654] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.495649 6269 ts_tablet_manager.cc:1905] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.496287 7955 raft_consensus.cc:482] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.496412 7955 raft_consensus.cc:504] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.496985 7955 leader_election.cc:288] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.497563 7557 raft_consensus.cc:2229] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.497807 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1078) took 4995 ms. Trace:
I20260928 10:44:22.500278 7557 raft_consensus.cc:2258] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.500038 5957 leader_election.cc:302] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.502732 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.502836 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.503293 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed443629ab604099a6fe5aff1840a553" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.503432 7841 raft_consensus.cc:2781] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.503511 7841 raft_consensus.cc:482] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.503589 7841 raft_consensus.cc:3037] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.503908 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db7ba94f3efa4acda249ea0375547cc9" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.504374 5957 leader_election.cc:302] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.504577 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c780d8c23a764f769848fa04550ceff6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.505185 7782 raft_consensus.cc:482] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.505304 7782 raft_consensus.cc:504] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.505823 7782 leader_election.cc:288] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.505944 7782 raft_consensus.cc:2781] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.506012 7782 raft_consensus.cc:482] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.506065 7782 raft_consensus.cc:3037] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.506220 7841 raft_consensus.cc:504] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.506987 7841 leader_election.cc:288] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.508584 7782 raft_consensus.cc:504] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.509159 7782 leader_election.cc:288] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:22.511729 5957 leader_election.cc:341] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 1d0584d6b80e43eb913c3932256cd89e
I20260928 10:44:22.512792 5957 leader_election.cc:302] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.513819 5957 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:22.514806 5957 leader_election.cc:341] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 25a2f20766024978a16b6bccd366a848
I20260928 10:44:22.515435 5957 leader_election.cc:302] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.515985 5957 leader_election.cc:302] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.515004 7933 raft_consensus.cc:2726] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.516192 7841 raft_consensus.cc:2726] T 25a2f20766024978a16b6bccd366a848 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.514076 7782 raft_consensus.cc:2726] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.517310 7937 raft_consensus.cc:2781] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.517433 7937 raft_consensus.cc:686] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.517675 7937 consensus_queue.cc:237] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.518973 6271 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.519106 6271 ts_tablet_manager.cc:1397] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260928 10:44:22.519774 6271 raft_consensus.cc:348] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.520015 6271 raft_consensus.cc:374] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.520077 6271 raft_consensus.cc:729] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.520267 6271 consensus_queue.cc:260] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.520816 6271 ts_tablet_manager.cc:1428] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:22.521087 6271 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.525147 5957 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.529440 5957 leader_election.cc:302] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.529707 7933 raft_consensus.cc:2726] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.531394 6271 tablet_bootstrap.cc:654] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.532423 7841 raft_consensus.cc:2781] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.532593 7841 raft_consensus.cc:686] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.532845 7841 consensus_queue.cc:237] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.535465 5957 leader_election.cc:302] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.535914 7933 raft_consensus.cc:2781] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.536051 7933 raft_consensus.cc:482] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.536177 7933 raft_consensus.cc:3037] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.538796 7933 raft_consensus.cc:504] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.540000 7933 leader_election.cc:288] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.541077 5957 leader_election.cc:302] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.542610 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:22.543506 5957 leader_election.cc:302] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.543727 7782 raft_consensus.cc:2781] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.543794 7782 raft_consensus.cc:482] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.543849 7782 raft_consensus.cc:3037] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.544652 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e0bac650904b8f81474ba2dac9c04f with delete_type TABLET_DATA_DELETED (replaced by tablet f0522f74d3274c04a66fb3f5b92dbf5e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.544867 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b7976063024775b9dde91b32010754 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.545045 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 383eb18f1c0c46209ff5b47e468b9950 with delete_type TABLET_DATA_DELETED (replaced by tablet 7834a54e59114a77b4e54e9190049a47) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.546893 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 049def79ba394ccd8d2a29d7d55e5e5b
I20260928 10:44:22.548025 7936 raft_consensus.cc:2781] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.548115 7936 raft_consensus.cc:482] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.548174 7936 raft_consensus.cc:3037] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.549566 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.549804 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_dc60ba66820c465dbc02cdb577f5c4f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.550458 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc60ba66820c465dbc02cdb577f5c4f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.551618 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1daf1ef2778342f097125f3469e27967
I20260928 10:44:22.551683 7936 raft_consensus.cc:504] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.552312 7936 leader_election.cc:288] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.552472 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daf1ef2778342f097125f3469e27967 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.553018 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_04da22a497e64c02ba05e303e848a626" } new_table_name: "default.Table_abb90ebf61684a258d2a86fec875a19f" modify_external_catalogs: true
I20260928 10:44:22.553753 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_494c12b4b5c84c6db72f23c50e458418"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.554214 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01a0de136e404eb4a264a0eeb4b60fd0" } new_table_name: "default.Table_3f8b976a0fc848fabe429c187af20ab7" modify_external_catalogs: true
I20260928 10:44:22.554266 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b4fca997384b4e73903d9b24f25988a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.554714 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4fca997384b4e73903d9b24f25988a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.555684 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b7108f795f52440c8f767d6dbec2d29f" } new_table_name: "default.Table_41aa05e6247a4ea2a283c5c0531b6099" modify_external_catalogs: true
I20260928 10:44:22.557009 7782 raft_consensus.cc:504] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:22.554268 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_494c12b4b5c84c6db72f23c50e458418 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.558496 7782 leader_election.cc:288] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.559664 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 29a1be37ede84ea485182044be92b8c6 (table default.Table_a98c668a7dea48138cdba63f65364fe8 [id=87c3591cdbf34ccc8c10269033b20843]). Expected version 1 got 0
I20260928 10:44:22.560326 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet d8bb524f0fc74503903f341d0e567e40 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:22.560922 5957 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1a659100a124506a411c929ddc31f10
I20260928 10:44:22.561165 5957 leader_election.cc:302] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:22.561544 5957 leader_election.cc:302] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.561821 7841 raft_consensus.cc:2726] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.562047 7841 raft_consensus.cc:2781] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.562155 7841 raft_consensus.cc:482] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.562249 7841 raft_consensus.cc:3037] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.564836 7841 raft_consensus.cc:504] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.566087 7841 leader_election.cc:288] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.566603 6270 rpcz_store.cc:276] 0928 10:44:17.502714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.503265 (+ 551us) service_pool.cc:227] Handling call
0928 10:44:22.311552 (+4808287us) ts_tablet_manager.cc:1145] Deleting tablet a61d97ed6b7b4dcba34a7a2190316b02
0928 10:44:22.343321 (+ 31769us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.353494 (+ 10173us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.444219 (+ 90725us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.497785 (+ 53566us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4808159}
I20260928 10:44:22.567374 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a61d97ed6b7b4dcba34a7a2190316b02 (table default.Table_bb8c5c03d60e4a16b7a66ec258c00e74 [id=f7cab57e7cb3481785efb9c2551504f7]) successfully deleted
I20260928 10:44:22.571846 5985 tablet_service.cc:1467] Processing CreateTablet for tablet a79bf7b219b04a4f985c275d0093ef1e (DEFAULT_TABLE table=default.Table_80f82fc4183a42b6b2d405c873eb32e0 [id=36332d9b1b1f481ebef1da054b6b2f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.572247 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a79bf7b219b04a4f985c275d0093ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.574362 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5c7540acde04667b9f8aef0bce23940 consensus state has no leader
I20260928 10:44:22.574995 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc0af65cdb048a7b712ff67d9449bfc (DEFAULT_TABLE table=default.Table_df05d5b3b68d4445977eb49fda04603a [id=ecf479758e444e939c80915d6c53fe2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.575356 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc0af65cdb048a7b712ff67d9449bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.577308 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 29a1be37ede84ea485182044be92b8c6 (table default.Table_a98c668a7dea48138cdba63f65364fe8 [id=87c3591cdbf34ccc8c10269033b20843]). Expected version 1 got 0
I20260928 10:44:22.577491 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:22.577606 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
W20260928 10:44:22.578703 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bed74e76d514654b024880f46a1525c consensus state has no leader
W20260928 10:44:22.578763 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6504434b53e84d549fce67d49a5452b9 consensus state has no leader
I20260928 10:44:22.581624 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0515d5e8afcd4c82b5b1914d2d2740a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.582149 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0515d5e8afcd4c82b5b1914d2d2740a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.498713 6275 tablet_bootstrap.cc:654] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.497998 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4594eae7b840ff980f67da8ed82e01" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.510321 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.510262 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.510581 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.540355 6138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.548578 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.553465 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.558142 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.558521 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daf1ef2778342f097125f3469e27967 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.566017 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.569293 6127 tablet_service.cc:1467] Processing CreateTablet for tablet a79bf7b219b04a4f985c275d0093ef1e (DEFAULT_TABLE table=default.Table_80f82fc4183a42b6b2d405c873eb32e0 [id=36332d9b1b1f481ebef1da054b6b2f8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.585103 5955 leader_election.cc:341] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.585285 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a79bf7b219b04a4f985c275d0093ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.585310 5955 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.585433 5955 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.585551 5955 leader_election.cc:341] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.585667 5955 leader_election.cc:341] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.585803 5955 leader_election.cc:341] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.586802 5955 leader_election.cc:341] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.570618 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc0af65cdb048a7b712ff67d9449bfc (DEFAULT_TABLE table=default.Table_df05d5b3b68d4445977eb49fda04603a [id=ecf479758e444e939c80915d6c53fe2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.589843 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc0af65cdb048a7b712ff67d9449bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.594218 6271 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.594352 6271 ts_tablet_manager.cc:1397] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.073s user 0.000s sys 0.002s
W20260928 10:44:22.594834 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3f0d0878809846aab7e039aa6e2a0f40 (table default.Table_734cb423db1c42e6bd6ff31f7c748d0e [id=573a8dc23cf741cf969af409641ded7e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3f0d0878809846aab7e039aa6e2a0f40 consensus state has no leader
I20260928 10:44:22.595053 7557 ts_tablet_manager.cc:1905] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.595595 6271 raft_consensus.cc:348] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.595810 6271 raft_consensus.cc:374] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.595868 6271 raft_consensus.cc:729] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.595871 6270 tablet_replica.cc:330] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:22.596071 6271 consensus_queue.cc:260] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.596498 6271 ts_tablet_manager.cc:1428] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:22.596736 6271 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.597211 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6f37298cccf44cb5a997813106d15e56
I20260928 10:44:22.597954 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 914ea799da554974960e7bf142a407b1
I20260928 10:44:22.598569 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d8bb524f0fc74503903f341d0e567e40
I20260928 10:44:22.598682 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet a8ad986491cf44669c6a5ef3f6ea21ef
I20260928 10:44:22.598809 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 914ea799da554974960e7bf142a407b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.598924 5702 catalog_manager.cc:6565] ReplaceTablet: tablet d8bb524f0fc74503903f341d0e567e40 deleted and replaced by tablet 8a8ac2b0aae9475c910505b38207e113
I20260928 10:44:22.598307 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f37298cccf44cb5a997813106d15e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.599009 5701 catalog_manager.cc:6565] ReplaceTablet: tablet a8ad986491cf44669c6a5ef3f6ea21ef deleted and replaced by tablet be3ba1abb7c94de6adb97f77c02121b3
I20260928 10:44:22.599684 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef with delete_type TABLET_DATA_DELETED (replaced by tablet be3ba1abb7c94de6adb97f77c02121b3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.599864 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d8bb524f0fc74503903f341d0e567e40 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a8ac2b0aae9475c910505b38207e113) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.601831 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f37298cccf44cb5a997813106d15e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.602065 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 914ea799da554974960e7bf142a407b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.602294 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet d8bb524f0fc74503903f341d0e567e40 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a8ac2b0aae9475c910505b38207e113) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.602734 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef with delete_type TABLET_DATA_DELETED (replaced by tablet be3ba1abb7c94de6adb97f77c02121b3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.548139 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 049def79ba394ccd8d2a29d7d55e5e5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.552834 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daf1ef2778342f097125f3469e27967 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.570829 5862 tablet_service.cc:1467] Processing CreateTablet for tablet a79bf7b219b04a4f985c275d0093ef1e (DEFAULT_TABLE table=default.Table_80f82fc4183a42b6b2d405c873eb32e0 [id=36332d9b1b1f481ebef1da054b6b2f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.605356 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a79bf7b219b04a4f985c275d0093ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.605618 6271 tablet_bootstrap.cc:654] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.571074 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc0af65cdb048a7b712ff67d9449bfc (DEFAULT_TABLE table=default.Table_df05d5b3b68d4445977eb49fda04603a [id=ecf479758e444e939c80915d6c53fe2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.609923 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc0af65cdb048a7b712ff67d9449bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.612092 6273 tablet_bootstrap.cc:492] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.612221 6273 ts_tablet_manager.cc:1397] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.127s user 0.000s sys 0.002s
I20260928 10:44:22.612689 7958 raft_consensus.cc:482] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.612816 7958 raft_consensus.cc:504] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.613351 7958 leader_election.cc:288] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.614007 6273 raft_consensus.cc:348] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.614326 6273 raft_consensus.cc:374] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.614388 6273 raft_consensus.cc:729] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.614600 6273 consensus_queue.cc:260] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.615370 6273 ts_tablet_manager.cc:1428] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260928 10:44:22.615639 6273 tablet_bootstrap.cc:492] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.617002 6273 tablet_bootstrap.cc:654] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.617664 6269 ts_tablet_manager.cc:1918] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 10:44:22.586515 5817 leader_election.cc:341] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.618224 6269 log.cc:1196] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/a908ac5d44a74c05b35f6853ab769d91
I20260928 10:44:22.599555 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f37298cccf44cb5a997813106d15e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.600158 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 914ea799da554974960e7bf142a407b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.600165 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet a8ad986491cf44669c6a5ef3f6ea21ef with delete_type TABLET_DATA_DELETED (replaced by tablet be3ba1abb7c94de6adb97f77c02121b3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.600209 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet d8bb524f0fc74503903f341d0e567e40 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a8ac2b0aae9475c910505b38207e113) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.622223 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02efab7a47400f8e50d41fb488983d (DEFAULT_TABLE table=default.Table_907e249ad2304307ba1c28c98b92fbe9 [id=f5b38427e96349c2a60ba420f20d91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.622679 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02efab7a47400f8e50d41fb488983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.622627 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02efab7a47400f8e50d41fb488983d (DEFAULT_TABLE table=default.Table_907e249ad2304307ba1c28c98b92fbe9 [id=f5b38427e96349c2a60ba420f20d91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.622987 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02efab7a47400f8e50d41fb488983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.625514 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_7e40eb9b813a4bbcbca8a9779e822a60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.625735 6271 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.626009 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270d4148268a47e5a6a5e71651eb0b12" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.626121 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e40eb9b813a4bbcbca8a9779e822a60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.626061 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02efab7a47400f8e50d41fb488983d (DEFAULT_TABLE table=default.Table_907e249ad2304307ba1c28c98b92fbe9 [id=f5b38427e96349c2a60ba420f20d91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.626405 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02efab7a47400f8e50d41fb488983d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.626587 5817 leader_election.cc:341] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.627247 7937 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.627367 7937 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.627918 7937 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.629406 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.630102 5955 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.519552 7880 raft_consensus.cc:482] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.630396 7880 raft_consensus.cc:504] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.631567 7880 leader_election.cc:288] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.631546 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6f388d56f04696940caef30b213ca6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.632076 5817 leader_election.cc:341] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.632395 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:22.632668 5701 catalog_manager.cc:5495] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:22.633064 5701 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:22.633215 6271 ts_tablet_manager.cc:1397] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20260928 10:44:22.633908 6271 raft_consensus.cc:348] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.634116 6271 raft_consensus.cc:374] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.634169 6271 raft_consensus.cc:729] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.634358 6271 consensus_queue.cc:260] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.634948 6271 ts_tablet_manager.cc:1428] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:22.636691 6270 raft_consensus.cc:2229] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:22.637070 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet e03f686afffc4d47b5e27fdbc8eb8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 0471473cce114d3985f9a8de2de77d39) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.637168 6270 raft_consensus.cc:2258] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.638017 7880 raft_consensus.cc:482] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.638237 7880 raft_consensus.cc:504] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.639801 7880 leader_election.cc:288] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.639845 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad (DEFAULT_TABLE table=default.Table_b832cbb4b23a4540bd5dee2d14c3da1e [id=cc5bf3149ad541f39d8824582400b242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.639830 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a1be37ede84ea485182044be92b8c6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.640286 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.640415 5817 leader_election.cc:341] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.640681 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad (DEFAULT_TABLE table=default.Table_b832cbb4b23a4540bd5dee2d14c3da1e [id=cc5bf3149ad541f39d8824582400b242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.641086 6271 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:22.502038 5818 leader_election.cc:341] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.641877 6270 ts_tablet_manager.cc:1905] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.642536 5818 leader_election.cc:302] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.643780 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 81d86e460fa6473697a88b4a8f9c932e (DEFAULT_TABLE table=default.Table_0cb06841d4764e989f44113cb2236deb [id=9cdd9b06ffd341e09e779aa7e28829dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.644091 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 81d86e460fa6473697a88b4a8f9c932e (DEFAULT_TABLE table=default.Table_0cb06841d4764e989f44113cb2236deb [id=9cdd9b06ffd341e09e779aa7e28829dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.644178 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d86e460fa6473697a88b4a8f9c932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.642627 6271 tablet_bootstrap.cc:654] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.642879 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.644465 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 81d86e460fa6473697a88b4a8f9c932e (DEFAULT_TABLE table=default.Table_0cb06841d4764e989f44113cb2236deb [id=9cdd9b06ffd341e09e779aa7e28829dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.644747 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d86e460fa6473697a88b4a8f9c932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.644668 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 25fc56d3a30e4599a7a106c7d1eda1b0 (DEFAULT_TABLE table=default.Table_73d9f3b0e2544942baf33fbc7c3c71e4 [id=55b49cc518294cb2a738f87508bf506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.644918 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d86e460fa6473697a88b4a8f9c932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.645007 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25fc56d3a30e4599a7a106c7d1eda1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.650238 5699 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f0d4929ce3af4bdcbd65b0366dbf53d3" } new_table_name: "default.Table_f307e7ee62774d46a59ef607124705d5" modify_external_catalogs: true
I20260928 10:44:22.652861 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1611ed7264404dfa82d700b42e8cb93e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.653489 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1611ed7264404dfa82d700b42e8cb93e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.653679 7880 raft_consensus.cc:2726] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.654706 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4764de124c924233a6206159bf2e65c2" } modify_external_catalogs: true
I20260928 10:44:22.654872 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_4764de124c924233a6206159bf2e65c2" } modify_external_catalogs: true
I20260928 10:44:22.652896 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_3ad92c16b49f41e1aaf622c7392f4bca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.656394 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 154348us
W20260928 10:44:22.656641 5818 leader_election.cc:341] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.656668 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ad92c16b49f41e1aaf622c7392f4bca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.656738 5818 leader_election.cc:302] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.656776 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a8807488d3d1426ea48e12acc8a1dcfc" } new_table_name: "default.Table_6164a04de5134824906a6d4795ab4503" modify_external_catalogs: true
I20260928 10:44:22.657927 6152 raft_consensus.cc:3037] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.661327 7841 consensus_queue.cc:1035] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:22.663982 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 6037e24ee6ba4399b6100ab27c4ed621 with delete_type TABLET_DATA_DELETED (replaced by tablet 45814bb909ed4a15a39a0819973042d2) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.664160 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b58d0c904a423f9801a883a2a2dfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:22.664256 5699 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 355c5b2e54cb4136b27eec3d65aeab55 consensus state has no leader
I20260928 10:44:22.664517 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f47338950743eb8a06e779a3ca5c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.665097 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 30fb3f88e66b4f8582fb348e035af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.673051 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_865a5be7cc6a4be0819fef08d263c581"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.673641 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 78295825061a4d75984e2d6e110e1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:22.673658 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_865a5be7cc6a4be0819fef08d263c581 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.674082 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 25fc56d3a30e4599a7a106c7d1eda1b0 (DEFAULT_TABLE table=default.Table_73d9f3b0e2544942baf33fbc7c3c71e4 [id=55b49cc518294cb2a738f87508bf506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.673525 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 503a4bcb9d37441aadf66b45238a3737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.674703 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 25fc56d3a30e4599a7a106c7d1eda1b0 (DEFAULT_TABLE table=default.Table_73d9f3b0e2544942baf33fbc7c3c71e4 [id=55b49cc518294cb2a738f87508bf506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.675163 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25fc56d3a30e4599a7a106c7d1eda1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.675036 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_976f971df4c24691977dc7bfec47c561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.676931 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_976f971df4c24691977dc7bfec47c561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.679214 7880 raft_consensus.cc:2726] T b254b5f8163d45cc8e1beb77d6ac4a65 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.679641 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 1aefce878fd0459c9c6502cfd226e2c7
W20260928 10:44:22.679690 5818 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.679796 5818 leader_election.cc:302] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.680006 7880 raft_consensus.cc:2726] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.680806 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.682440 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_39ff19a83ef04dbe998993361ba7e720"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.682963 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39ff19a83ef04dbe998993361ba7e720 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.684556 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcecdf79aafe497080e2a1f6256ef6fd consensus state has no leader
I20260928 10:44:22.685170 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.685642 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad (DEFAULT_TABLE table=default.Table_b832cbb4b23a4540bd5dee2d14c3da1e [id=cc5bf3149ad541f39d8824582400b242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.686035 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77fcb41880dd4a7ebc7c7f69c4df55ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.687179 6275 tablet_bootstrap.cc:492] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:22.687352 6275 ts_tablet_manager.cc:1397] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.204s user 0.007s sys 0.003s
I20260928 10:44:22.688134 6275 raft_consensus.cc:348] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.688473 6275 raft_consensus.cc:374] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.688582 6275 raft_consensus.cc:729] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.688823 6275 consensus_queue.cc:260] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.689533 6275 ts_tablet_manager.cc:1428] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:22.689640 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aefce878fd0459c9c6502cfd226e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.689817 6275 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:22.691298 6275 tablet_bootstrap.cc:654] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.693717 6269 ts_tablet_manager.cc:1939] T a908ac5d44a74c05b35f6853ab769d91 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:22.694581 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 942) took 8982 ms. Trace:
I20260928 10:44:22.694728 6269 rpcz_store.cc:276] 0928 10:44:13.711832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.711908 (+ 76us) service_pool.cc:227] Handling call
0928 10:44:22.491095 (+8779187us) ts_tablet_manager.cc:1145] Deleting tablet a908ac5d44a74c05b35f6853ab769d91
0928 10:44:22.491106 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.533676 (+ 42570us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.617571 (+ 83895us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.694560 (+ 76989us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8751457}
I20260928 10:44:22.695302 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet a908ac5d44a74c05b35f6853ab769d91 (table default.Table_2fbadc72e6434348aedb000cdb6b9579 [id=48f06cee1ca2460cad2383e5bbfb83ea]) successfully deleted
I20260928 10:44:22.698235 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5e5fb6f3864243aad757770418f993 (DEFAULT_TABLE table=default.Table_196cdc39cb724e1895aca1333e88e446 [id=2a2eaa1a94964020a35be380c6e06198]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.698539 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5e5fb6f3864243aad757770418f993 (DEFAULT_TABLE table=default.Table_196cdc39cb724e1895aca1333e88e446 [id=2a2eaa1a94964020a35be380c6e06198]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.698813 5818 leader_election.cc:341] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.698928 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5e5fb6f3864243aad757770418f993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.698939 5818 leader_election.cc:302] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.698892 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5e5fb6f3864243aad757770418f993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.699187 7880 raft_consensus.cc:2726] T df846e6bb5b54ddd8ac5df678803d739 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.699362 5983 tablet_service.cc:1467] Processing CreateTablet for tablet de17e936213a4f72a1da7d87be6562f4 (DEFAULT_TABLE table=default.Table_f068c7091ed046a3a26e05f97bae4713 [id=f21700c869e242f18cce8b7f4ce14149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.699707 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de17e936213a4f72a1da7d87be6562f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.703267 6135 tablet_service.cc:1467] Processing CreateTablet for tablet de17e936213a4f72a1da7d87be6562f4 (DEFAULT_TABLE table=default.Table_f068c7091ed046a3a26e05f97bae4713 [id=f21700c869e242f18cce8b7f4ce14149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.703684 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de17e936213a4f72a1da7d87be6562f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.703768 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25fc56d3a30e4599a7a106c7d1eda1b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.704165 5818 leader_election.cc:341] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.704365 5818 leader_election.cc:302] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.705304 7937 raft_consensus.cc:482] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.705425 7937 raft_consensus.cc:504] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.706014 7937 leader_election.cc:288] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.709354 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.710767 5955 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.714061 6271 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.714221 6271 ts_tablet_manager.cc:1397] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.007s
I20260928 10:44:22.716275 6270 ts_tablet_manager.cc:1918] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.717193 7880 raft_consensus.cc:2726] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.717765 5818 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.718286 7880 raft_consensus.cc:2726] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.719053 5818 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.719401 7880 raft_consensus.cc:2726] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.720661 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet d03fd57e996c486384f92000925aff8a from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:22.723544 5818 leader_election.cc:302] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.723827 7880 raft_consensus.cc:2781] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.724006 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 943) took 8991 ms. Trace:
I20260928 10:44:22.724018 7880 raft_consensus.cc:686] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:22.724399 7880 consensus_queue.cc:237] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:22.724165 6269 rpcz_store.cc:276] 0928 10:44:13.732268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.732528 (+ 260us) service_pool.cc:227] Handling call
0928 10:44:22.723858 (+8991330us) ts_tablet_manager.cc:1145] Deleting tablet de99da54941a4eaf9107f4b2efca5c7b
0928 10:44:22.723872 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.723987 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8984095}
I20260928 10:44:22.725332 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 945) took 8992 ms. Trace:
W20260928 10:44:22.725373 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet de99da54941a4eaf9107f4b2efca5c7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de99da54941a4eaf9107f4b2efca5c7b already in progress: creating tablet
I20260928 10:44:22.725514 6269 rpcz_store.cc:276] 0928 10:44:13.732471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.732578 (+ 107us) service_pool.cc:227] Handling call
0928 10:44:22.725213 (+8992635us) ts_tablet_manager.cc:1145] Deleting tablet bb4590c83aa24745af278fcac0a9d518
0928 10:44:22.725225 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.725313 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8985180}
W20260928 10:44:22.727212 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet bb4590c83aa24745af278fcac0a9d518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb4590c83aa24745af278fcac0a9d518 already in progress: creating tablet
I20260928 10:44:22.730769 6269 tablet_replica.cc:330] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:22.731077 6269 raft_consensus.cc:2229] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.731323 6269 raft_consensus.cc:2258] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.731949 6269 ts_tablet_manager.cc:1905] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.732892 5702 master_service.cc:946] ReplaceTablet: received request to replace tablet 380ec5581fdc4ad587185cd5bb8a35fe from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:22.735562 6275 tablet_bootstrap.cc:492] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:22.735782 6275 ts_tablet_manager.cc:1397] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.003s
I20260928 10:44:22.736270 5699 catalog_manager.cc:5495] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b reported cstate change: term changed from 0 to 1, leader changed from <none> to ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65). New cstate: current_term: 1 leader_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:22.736604 6275 raft_consensus.cc:348] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.736804 6275 raft_consensus.cc:374] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.736907 6275 raft_consensus.cc:729] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.736972 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_62812cefd5b44da7a231a4e62521f052 [id=6677562fe2604addb84af531539cbebd]). Expected version 5 got 0
I20260928 10:44:22.737164 6275 consensus_queue.cc:260] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.737711 6275 ts_tablet_manager.cc:1428] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:22.738234 6275 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:22.738916 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5e5fb6f3864243aad757770418f993 (DEFAULT_TABLE table=default.Table_196cdc39cb724e1895aca1333e88e446 [id=2a2eaa1a94964020a35be380c6e06198]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.739493 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5e5fb6f3864243aad757770418f993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.739888 6275 tablet_bootstrap.cc:654] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.743407 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 2c44974d450d46f686d247dee1049d22 (DEFAULT_TABLE table=default.Table_c0c247e880824b72955c2de0507d21c6 [id=d25a12231d27459aabe16821a1cc239d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.747591 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c44974d450d46f686d247dee1049d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.751258 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 7382da2c9a534647bbe5882a33f68fd9 (DEFAULT_TABLE table=default.Table_2d51090c170b44e3b63687c6c0a60ccc [id=27347cecf2464fcb924682402201d6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.751765 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7382da2c9a534647bbe5882a33f68fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.752401 7557 ts_tablet_manager.cc:1918] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.752532 7557 log.cc:1196] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/490f8a4f1f9245cfab168b96511e18de
I20260928 10:44:22.752813 7557 ts_tablet_manager.cc:1939] T 490f8a4f1f9245cfab168b96511e18de P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.753211 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a98c668a7dea48138cdba63f65364fe8" } modify_external_catalogs: true
I20260928 10:44:22.753340 5697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_775f9213815e44df87fd2479869dd76b" } modify_external_catalogs: true
I20260928 10:44:22.753464 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a98c668a7dea48138cdba63f65364fe8" } modify_external_catalogs: true
I20260928 10:44:22.753523 5697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_775f9213815e44df87fd2479869dd76b" } modify_external_catalogs: true
I20260928 10:44:22.754063 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d03fd57e996c486384f92000925aff8a
I20260928 10:44:22.754448 5695 catalog_manager.cc:6565] ReplaceTablet: tablet d03fd57e996c486384f92000925aff8a deleted and replaced by tablet 38326c8e94a84a97a5ecd536c68252dc
I20260928 10:44:22.757583 5701 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:22.741467 5862 tablet_service.cc:1467] Processing CreateTablet for tablet de17e936213a4f72a1da7d87be6562f4 (DEFAULT_TABLE table=default.Table_f068c7091ed046a3a26e05f97bae4713 [id=f21700c869e242f18cce8b7f4ce14149]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.741426 5818 leader_election.cc:341] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.744642 6273 tablet_bootstrap.cc:492] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.749087 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 2c44974d450d46f686d247dee1049d22 (DEFAULT_TABLE table=default.Table_c0c247e880824b72955c2de0507d21c6 [id=d25a12231d27459aabe16821a1cc239d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.758857 5818 leader_election.cc:302] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.755283 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet d03fd57e996c486384f92000925aff8a with delete_type TABLET_DATA_DELETED (replaced by tablet 38326c8e94a84a97a5ecd536c68252dc) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.757716 7880 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.758935 6273 ts_tablet_manager.cc:1397] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.143s user 0.001s sys 0.001s
I20260928 10:44:22.759207 7958 raft_consensus.cc:2726] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.759210 7880 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.750808 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 7382da2c9a534647bbe5882a33f68fd9 (DEFAULT_TABLE table=default.Table_2d51090c170b44e3b63687c6c0a60ccc [id=27347cecf2464fcb924682402201d6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.759768 6273 raft_consensus.cc:348] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.759969 6273 raft_consensus.cc:374] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.760021 6273 raft_consensus.cc:729] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.760205 6273 consensus_queue.cc:260] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.760392 7880 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.760726 6273 ts_tablet_manager.cc:1428] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:22.760979 6273 tablet_bootstrap.cc:492] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:22.762214 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 380ec5581fdc4ad587185cd5bb8a35fe
I20260928 10:44:22.763228 5702 catalog_manager.cc:6565] ReplaceTablet: tablet 380ec5581fdc4ad587185cd5bb8a35fe deleted and replaced by tablet 6788cb3dc4f4430d86171ad81c904d0a
I20260928 10:44:22.760529 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet d03fd57e996c486384f92000925aff8a with delete_type TABLET_DATA_DELETED (replaced by tablet 38326c8e94a84a97a5ecd536c68252dc) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.764614 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe with delete_type TABLET_DATA_DELETED (replaced by tablet 6788cb3dc4f4430d86171ad81c904d0a) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.762208 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.765293 5818 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.765504 5818 leader_election.cc:302] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.718706 6271 raft_consensus.cc:348] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:22.765759 5818 raft_consensus.cc:2670] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:22.765780 6271 raft_consensus.cc:374] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.765856 6271 raft_consensus.cc:729] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.766070 6271 consensus_queue.cc:260] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:22.766175 5818 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.766311 5818 leader_election.cc:302] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.766180 6270 log.cc:1196] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/00b7e26971914613a2372476b348b702
I20260928 10:44:22.748845 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 2c44974d450d46f686d247dee1049d22 (DEFAULT_TABLE table=default.Table_c0c247e880824b72955c2de0507d21c6 [id=d25a12231d27459aabe16821a1cc239d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.766808 7958 raft_consensus.cc:2726] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.766865 5818 leader_election.cc:341] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.766994 5818 leader_election.cc:302] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.767071 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c44974d450d46f686d247dee1049d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.767237 7958 raft_consensus.cc:2726] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.767460 5818 leader_election.cc:341] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.767596 5818 leader_election.cc:302] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.767696 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe with delete_type TABLET_DATA_DELETED (replaced by tablet 6788cb3dc4f4430d86171ad81c904d0a) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:22.722788 5955 consensus_peers.cc:487] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:22.755846 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet d03fd57e996c486384f92000925aff8a with delete_type TABLET_DATA_DELETED (replaced by tablet 38326c8e94a84a97a5ecd536c68252dc) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.767845 7958 raft_consensus.cc:2726] T ed443629ab604099a6fe5aff1840a553 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.767869 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 45123.4us
I20260928 10:44:22.766690 6271 ts_tablet_manager.cc:1428] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260928 10:44:22.768185 6271 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:22.768191 5818 leader_election.cc:341] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.768323 5818 leader_election.cc:302] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:22.768792 5818 leader_election.cc:341] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.768962 5818 leader_election.cc:302] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.769232 7880 raft_consensus.cc:2726] T db7ba94f3efa4acda249ea0375547cc9 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.769351 7880 raft_consensus.cc:2726] T c780d8c23a764f769848fa04550ceff6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.769790 6271 tablet_bootstrap.cc:654] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.752769 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 7382da2c9a534647bbe5882a33f68fd9 (DEFAULT_TABLE table=default.Table_2d51090c170b44e3b63687c6c0a60ccc [id=27347cecf2464fcb924682402201d6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.770730 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7382da2c9a534647bbe5882a33f68fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.771955 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.772123 5875 raft_consensus.cc:3037] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.772442 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4594eae7b840ff980f67da8ed82e01" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.772867 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6f388d56f04696940caef30b213ca6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.772923 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a1be37ede84ea485182044be92b8c6" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.773231 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.773366 6019 raft_consensus.cc:2454] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:22.773496 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.773661 5872 raft_consensus.cc:3037] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.773612 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.773793 5883 raft_consensus.cc:2454] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.774607 5875 raft_consensus.cc:2454] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.774644 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270d4148268a47e5a6a5e71651eb0b12" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:22.776021 5872 raft_consensus.cc:2454] T 96cc330167fa476a91a05be3f7e753e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.776144 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b67cd4597914a1483fe2bad4de4a8b8" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.776314 5875 raft_consensus.cc:3037] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:22.777161 5817 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.778024 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 380ec5581fdc4ad587185cd5bb8a35fe with delete_type TABLET_DATA_DELETED (replaced by tablet 6788cb3dc4f4430d86171ad81c904d0a) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.778740 5875 raft_consensus.cc:2454] T 0b67cd4597914a1483fe2bad4de4a8b8 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.780808 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de17e936213a4f72a1da7d87be6562f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.781155 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c44974d450d46f686d247dee1049d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.781792 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_ed6843c48e0442bfb454e1a086c0e493" } new_table_name: "default.Table_1adc425e9154432e8363944146e9b0ac" modify_external_catalogs: true
I20260928 10:44:22.782517 6273 tablet_bootstrap.cc:654] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.785138 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_48cb0207f1174f79af8de081c5ceea1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.785771 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48cb0207f1174f79af8de081c5ceea1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.786733 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0521bf32495649f384dc06bfe6463cb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:22.787151 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1e4ab4b6d51343429fe4445b4f4fa81c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.787297 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0521bf32495649f384dc06bfe6463cb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.787756 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db8191bd52844ecd8c92c336e8d687fa" } new_table_name: "default.Table_f0204f42acdb4f8b8a94c0f5290af377" modify_external_catalogs: true
I20260928 10:44:22.788607 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7382da2c9a534647bbe5882a33f68fd9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.788681 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e4ab4b6d51343429fe4445b4f4fa81c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.792007 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_50a37b3481314f57a58cac202cec28a8" } new_table_name: "default.Table_46d70ac8178548fabc14a33e77d1bc5c" modify_external_catalogs: true
I20260928 10:44:22.793582 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0cffc63bccf448a7a59e311640567e4a (table default.Table_1c2cd972fcc04c95a28df116512095ea [id=9d897090b86f467ba44c140e859a220e]). Expected version 1 got 0
I20260928 10:44:22.795113 6270 ts_tablet_manager.cc:1939] T 00b7e26971914613a2372476b348b702 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:22.799400 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:22.804625 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b58d0c904a423f9801a883a2a2dfc1" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.804874 5875 raft_consensus.cc:3037] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.805891 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 490f8a4f1f9245cfab168b96511e18de (table default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]) successfully deleted
I20260928 10:44:22.800706 7841 raft_consensus.cc:482] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.806315 7841 raft_consensus.cc:504] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.807106 7841 leader_election.cc:288] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.807714 5875 raft_consensus.cc:2454] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.808032 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3fd660209eb542b090b9df5d50c15db4" } modify_external_catalogs: true
I20260928 10:44:22.808462 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.809237 5996 tablet_service.cc:1467] Processing CreateTablet for tablet fefe0eeda16949b5b4bbbb60f9f72aab (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.809723 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefe0eeda16949b5b4bbbb60f9f72aab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.809360 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 8735b36bd56e41629089437b5d92c793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8735b36bd56e41629089437b5d92c793 already in progress: creating tablet
I20260928 10:44:22.810987 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3fd660209eb542b090b9df5d50c15db4" } modify_external_catalogs: true
W20260928 10:44:22.811123 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0de0ff28393d479dadb5e2f3e415d1fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0de0ff28393d479dadb5e2f3e415d1fa already in progress: creating tablet
W20260928 10:44:22.811353 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 76b4ceadef8b4a729ca4204259e64cbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76b4ceadef8b4a729ca4204259e64cbd already in progress: creating tablet
I20260928 10:44:22.811305 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 66f60c7b2e314cd19c754288d74ab93a (DEFAULT_TABLE table=default.Table_8a236465efe044a9936aa3e578649364 [id=0ee3273154ec4307980c4dbf0a2da726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.811785 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f60c7b2e314cd19c754288d74ab93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.812397 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 66f60c7b2e314cd19c754288d74ab93a (DEFAULT_TABLE table=default.Table_8a236465efe044a9936aa3e578649364 [id=0ee3273154ec4307980c4dbf0a2da726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.812853 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 4adce2a7d1f14560827c0ebbe7d16e1e (DEFAULT_TABLE table=default.Table_726f11c163184d5abf43e2f813f46c84 [id=ab2a54c3605b495ba3e08655df35a717]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.813063 5955 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.813441 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 4adce2a7d1f14560827c0ebbe7d16e1e (DEFAULT_TABLE table=default.Table_726f11c163184d5abf43e2f813f46c84 [id=ab2a54c3605b495ba3e08655df35a717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.813923 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adce2a7d1f14560827c0ebbe7d16e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.818282 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 4adce2a7d1f14560827c0ebbe7d16e1e (DEFAULT_TABLE table=default.Table_726f11c163184d5abf43e2f813f46c84 [id=ab2a54c3605b495ba3e08655df35a717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.818823 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adce2a7d1f14560827c0ebbe7d16e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.818866 5849 tablet_service.cc:1467] Processing CreateTablet for tablet fefe0eeda16949b5b4bbbb60f9f72aab (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.819283 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefe0eeda16949b5b4bbbb60f9f72aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.822903 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cd14e0039402ea51f34e8b88e2605" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.823130 5872 raft_consensus.cc:3037] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.824771 6135 tablet_service.cc:1467] Processing CreateTablet for tablet fefe0eeda16949b5b4bbbb60f9f72aab (DEFAULT_TABLE table=default.Table_b523bc2fedb7482c9c2561e4cb54bf50 [id=7dee394672a04488aae68be3e98cc9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.825697 5872 raft_consensus.cc:2454] T ed7cd14e0039402ea51f34e8b88e2605 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.827371 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.827661 5872 raft_consensus.cc:2454] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.827903 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:22.828081 5875 raft_consensus.cc:3037] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.834367 6269 ts_tablet_manager.cc:1918] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.834681 6269 log.cc:1196] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/b1cdff9f01974354a81179dd9bd5a26e
I20260928 10:44:22.836041 5697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7b876b30dca04b758f8f540bf86426ef
I20260928 10:44:22.836768 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b876b30dca04b758f8f540bf86426ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.836994 6269 ts_tablet_manager.cc:1939] T b1cdff9f01974354a81179dd9bd5a26e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:22.837899 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 939) took 9161 ms. Trace:
I20260928 10:44:22.838881 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f60c7b2e314cd19c754288d74ab93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.839210 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adce2a7d1f14560827c0ebbe7d16e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.840478 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_cebb1338808c4507a0d552d4d2e2a040"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.841334 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cebb1338808c4507a0d552d4d2e2a040 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.842859 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b876b30dca04b758f8f540bf86426ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.843101 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3cf99208c954433e88dbc4d3315576ef" } modify_external_catalogs: true
I20260928 10:44:22.843329 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3cf99208c954433e88dbc4d3315576ef" } modify_external_catalogs: true
I20260928 10:44:22.844776 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 29a1be37ede84ea485182044be92b8c6
I20260928 10:44:22.845281 5694 master_service.cc:946] ReplaceTablet: received request to replace tablet 59e74ac74d274a63b70b84d013e3f742 from {username='slave'} at 127.0.0.1:45112
W20260928 10:44:22.846127 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 51827.5us
I20260928 10:44:22.838376 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1076) took 5335 ms. Trace:
W20260928 10:44:22.846460 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f913900914d149b48d64a0d53908482c consensus state has no leader
I20260928 10:44:22.846940 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5264a9430f6445e4a30c1ac53aa65c3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.847482 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5264a9430f6445e4a30c1ac53aa65c3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:22.843112 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c93d712f68d0481ba9d06859d3801a2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c93d712f68d0481ba9d06859d3801a2d already in progress: creating tablet
I20260928 10:44:22.850868 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a1be37ede84ea485182044be92b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:22.850095 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a1be37ede84ea485182044be92b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.860679 6270 rpcz_store.cc:276] 0928 10:44:17.502567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.502960 (+ 393us) service_pool.cc:227] Handling call
0928 10:44:22.567730 (+5064770us) ts_tablet_manager.cc:1145] Deleting tablet 00b7e26971914613a2372476b348b702
0928 10:44:22.595828 (+ 28098us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.712525 (+116697us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.716173 (+ 3648us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.838344 (+122171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40402,"tablet-delete.queue_time_us":5064255}
I20260928 10:44:22.861346 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 00b7e26971914613a2372476b348b702 (table default.Table_fe170946878a4e9abe047ae72c9e95bb [id=12dd840001a84217b2b99d5d5a98c51f]) successfully deleted
I20260928 10:44:22.861970 7557 tablet_replica.cc:330] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:22.862283 7557 raft_consensus.cc:2229] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:22.862567 7557 raft_consensus.cc:2258] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.862700 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefe0eeda16949b5b4bbbb60f9f72aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.851370 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b876b30dca04b758f8f540bf86426ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:22.851986 6271 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.864662 6271 ts_tablet_manager.cc:1397] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.097s user 0.004s sys 0.007s
I20260928 10:44:22.865507 6271 raft_consensus.cc:348] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.865741 6271 raft_consensus.cc:374] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.865789 6271 raft_consensus.cc:729] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.865995 6271 consensus_queue.cc:260] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.866515 6271 ts_tablet_manager.cc:1428] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 10:44:22.868115 5955 consensus_peers.cc:487] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:22.878069 7557 ts_tablet_manager.cc:1905] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.879300 5957 leader_election.cc:302] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.879546 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 5887b929367c4506b65e6a0e17241de1 (DEFAULT_TABLE table=default.Table_670cc8fb329b4af2b7d545cdd07be5e9 [id=c9ad1ff44c7e4bbe812328a57776d8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.879650 7841 raft_consensus.cc:2781] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.879716 7841 raft_consensus.cc:482] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.879767 7841 raft_consensus.cc:3037] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.882213 7841 raft_consensus.cc:504] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.882818 7841 leader_election.cc:288] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.883891 5957 leader_election.cc:302] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.884141 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.884387 7841 raft_consensus.cc:2781] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.884497 7841 raft_consensus.cc:686] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.884704 7841 consensus_queue.cc:237] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.887610 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 5887b929367c4506b65e6a0e17241de1 (DEFAULT_TABLE table=default.Table_670cc8fb329b4af2b7d545cdd07be5e9 [id=c9ad1ff44c7e4bbe812328a57776d8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.888391 7841 consensus_queue.cc:1035] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:22.891104 5957 leader_election.cc:302] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:22.891300 5955 leader_election.cc:341] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.891558 5957 leader_election.cc:302] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.891702 7782 raft_consensus.cc:2781] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.891817 7782 raft_consensus.cc:686] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.891855 7841 raft_consensus.cc:2781] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.891952 7841 raft_consensus.cc:686] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:22.892037 7782 consensus_queue.cc:237] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.892119 7841 consensus_queue.cc:237] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.894371 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5887b929367c4506b65e6a0e17241de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.894738 6271 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.895527 6270 tablet_replica.cc:330] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:22.895717 6270 raft_consensus.cc:2229] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:22.896028 6270 raft_consensus.cc:2258] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:22.896540 6270 ts_tablet_manager.cc:1905] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:22.896741 6271 tablet_bootstrap.cc:654] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:22.901597 5990 tablet_service.cc:1467] Processing CreateTablet for tablet b8e8700ebe744af5949f439073f4845b (DEFAULT_TABLE table=default.Table_5b5af7d600e9410db290e83495c2bece [id=d6a097c54c744596878795498a0d77a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.902175 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e8700ebe744af5949f439073f4845b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.902235 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba8c9b3e7d846f1927d684423ed28d5 (DEFAULT_TABLE table=default.Table_244799f28a6546a58cd61ae211aef842 [id=a7ab63692e2c4fa881eab6dc8a8babcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.903210 5957 leader_election.cc:302] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.903570 5957 leader_election.cc:302] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.903998 5957 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.904335 7936 raft_consensus.cc:2781] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.904613 7874 raft_consensus.cc:2781] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:22.905215 7937 raft_consensus.cc:2781] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.905282 7937 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.905337 7937 raft_consensus.cc:3037] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.907876 7937 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.847806 6273 tablet_bootstrap.cc:492] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:22.849349 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a1be37ede84ea485182044be92b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:22.858887 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.910198 6269 rpcz_store.cc:276] 0928 10:44:13.675983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.720510 (+ 44527us) service_pool.cc:227] Handling call
0928 10:44:22.726951 (+9006441us) ts_tablet_manager.cc:1145] Deleting tablet b1cdff9f01974354a81179dd9bd5a26e
0928 10:44:22.727564 (+ 613us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.795605 (+ 68041us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.834234 (+ 38629us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.837876 (+ 3642us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8985447}
I20260928 10:44:22.875180 7954 raft_consensus.cc:482] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.874035 7958 raft_consensus.cc:482] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.910555 7958 raft_consensus.cc:504] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.910498 7954 raft_consensus.cc:504] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.875789 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 66f60c7b2e314cd19c754288d74ab93a (DEFAULT_TABLE table=default.Table_8a236465efe044a9936aa3e578649364 [id=0ee3273154ec4307980c4dbf0a2da726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.911108 7958 leader_election.cc:288] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:22.910444 5870 raft_consensus.cc:2454] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.911753 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.877112 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:22.912017 5878 raft_consensus.cc:2454] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:22.911119 7954 leader_election.cc:288] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.912148 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87dd8e89c394e4f96c9d8c5fed17e66" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.912632 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba8c9b3e7d846f1927d684423ed28d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.912649 5817 leader_election.cc:341] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:22.912833 5817 leader_election.cc:341] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.915216 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5887b929367c4506b65e6a0e17241de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.878949 5875 raft_consensus.cc:2454] T 59c67a02d7f84bed9c440c8c451ea4ff P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:22.899869 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 5887b929367c4506b65e6a0e17241de1 (DEFAULT_TABLE table=default.Table_670cc8fb329b4af2b7d545cdd07be5e9 [id=c9ad1ff44c7e4bbe812328a57776d8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.901903 5860 tablet_service.cc:1467] Processing CreateTablet for tablet b8e8700ebe744af5949f439073f4845b (DEFAULT_TABLE table=default.Table_5b5af7d600e9410db290e83495c2bece [id=d6a097c54c744596878795498a0d77a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.910341 6273 ts_tablet_manager.cc:1397] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.007s
I20260928 10:44:22.919281 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet b1cdff9f01974354a81179dd9bd5a26e (table default.Table_5fc5b45674dd41b5a393b263eab27d3f [id=d50909d69f7d4e8cb62569961c640822]) successfully deleted
I20260928 10:44:22.919358 6273 raft_consensus.cc:348] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.919593 6273 raft_consensus.cc:374] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.919642 6273 raft_consensus.cc:729] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.919813 6273 consensus_queue.cc:260] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.920325 6273 ts_tablet_manager.cc:1428] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:22.921620 7937 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.922653 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:22.923296 5955 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.925736 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:22.926040 7782 raft_consensus.cc:482] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.926168 7782 raft_consensus.cc:504] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.926925 7782 leader_election.cc:288] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.927642 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:22.928273 5955 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.928875 5696 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:22.929388 6135 tablet_service.cc:1467] Processing CreateTablet for tablet b8e8700ebe744af5949f439073f4845b (DEFAULT_TABLE table=default.Table_5b5af7d600e9410db290e83495c2bece [id=d6a097c54c744596878795498a0d77a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.929690 5696 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_b155950aea474e6183a91c170817945b" } new_table_name: "default.Table_b201c9694a78453d94ef321922b690cf" modify_external_catalogs: true
I20260928 10:44:22.929894 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e8700ebe744af5949f439073f4845b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.899770 5818 leader_election.cc:341] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.934084 5818 leader_election.cc:302] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.934441 7954 raft_consensus.cc:2726] T 0e4594eae7b840ff980f67da8ed82e01 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:22.935030 5818 leader_election.cc:341] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.935225 5818 leader_election.cc:302] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.935566 7954 raft_consensus.cc:2726] T 5d6f388d56f04696940caef30b213ca6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.941032 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba8c9b3e7d846f1927d684423ed28d5 (DEFAULT_TABLE table=default.Table_244799f28a6546a58cd61ae211aef842 [id=a7ab63692e2c4fa881eab6dc8a8babcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.941637 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba8c9b3e7d846f1927d684423ed28d5 (DEFAULT_TABLE table=default.Table_244799f28a6546a58cd61ae211aef842 [id=a7ab63692e2c4fa881eab6dc8a8babcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.942190 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba8c9b3e7d846f1927d684423ed28d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.942962 6271 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:22.943115 6271 ts_tablet_manager.cc:1397] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.001s
I20260928 10:44:22.943871 6271 raft_consensus.cc:348] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.944084 6271 raft_consensus.cc:374] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:22.944133 6271 raft_consensus.cc:729] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:22.944310 6271 consensus_queue.cc:260] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.944829 6271 ts_tablet_manager.cc:1428] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:22.945089 6271 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:22.947021 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a46997a4fbd848cc8ce98c4d82af4886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.947625 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a46997a4fbd848cc8ce98c4d82af4886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.950801 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 8a094b0f6429446eb2c499f2ed467306 (DEFAULT_TABLE table=default.Table_7a4e883bd0fb476583d3840f124558ae [id=60e18953da29404880dfd51fe35b24b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.951198 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a094b0f6429446eb2c499f2ed467306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.953174 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7fccabf8854bb780282bc1b00a9c8b (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.953560 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7fccabf8854bb780282bc1b00a9c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.953483 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7fccabf8854bb780282bc1b00a9c8b (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:22.961120 5818 leader_election.cc:341] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.965410 7557 ts_tablet_manager.cc:1918] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:22.965636 7557 log.cc:1196] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/25a2f20766024978a16b6bccd366a848
I20260928 10:44:22.966070 7557 ts_tablet_manager.cc:1939] T 25a2f20766024978a16b6bccd366a848 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:22.966557 5818 leader_election.cc:302] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.966622 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 8a094b0f6429446eb2c499f2ed467306 (DEFAULT_TABLE table=default.Table_7a4e883bd0fb476583d3840f124558ae [id=60e18953da29404880dfd51fe35b24b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.966837 7954 raft_consensus.cc:2726] T 29a1be37ede84ea485182044be92b8c6 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.967176 5818 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.967506 7954 raft_consensus.cc:2781] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:22.967588 7954 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:22.967654 7954 raft_consensus.cc:3037] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:22.970132 7782 raft_consensus.cc:482] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:22.970283 7782 raft_consensus.cc:504] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:22.970307 7954 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:22.971522 7954 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:22.971918 7782 leader_election.cc:288] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:22.974349 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 8a094b0f6429446eb2c499f2ed467306 (DEFAULT_TABLE table=default.Table_7a4e883bd0fb476583d3840f124558ae [id=60e18953da29404880dfd51fe35b24b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.974866 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a094b0f6429446eb2c499f2ed467306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:22.981499 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.982636 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.983048 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.983242 5818 leader_election.cc:341] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.983368 5818 leader_election.cc:302] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:22.983595 7954 raft_consensus.cc:2726] T 270d4148268a47e5a6a5e71651eb0b12 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:22.986982 8000 tablet.cc:1722] T 49c40696fe8645de9b639d2293f41403 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:22.926056 6270 ts_tablet_manager.cc:1918] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:22.990722 6270 log.cc:1196] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/877e2d1c734a4e2891119f308f9f3ae8
W20260928 10:44:22.990710 5701 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5cb4e02560241abbc6502415e9ebdac consensus state has no leader
I20260928 10:44:22.991062 6270 ts_tablet_manager.cc:1939] T 877e2d1c734a4e2891119f308f9f3ae8 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:22.991067 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_30d19d5fb4aa4c15831b572b721e1ce0" } modify_external_catalogs: true
I20260928 10:44:22.991237 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_30d19d5fb4aa4c15831b572b721e1ce0" } modify_external_catalogs: true
I20260928 10:44:22.991789 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1075) took 5489 ms. Trace:
I20260928 10:44:22.991873 6270 rpcz_store.cc:276] 0928 10:44:17.502448 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.503551 (+ 1103us) service_pool.cc:227] Handling call
0928 10:44:22.861716 (+5358165us) ts_tablet_manager.cc:1145] Deleting tablet 877e2d1c734a4e2891119f308f9f3ae8
0928 10:44:22.895484 (+ 33768us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.922987 (+ 27503us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.925948 (+ 2961us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:22.991771 (+ 65823us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5357978}
I20260928 10:44:22.992262 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1081) took 5480 ms. Trace:
I20260928 10:44:22.992328 6270 rpcz_store.cc:276] 0928 10:44:17.511995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.512070 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:22.992140 (+5480070us) ts_tablet_manager.cc:1145] Deleting tablet 4706d214d3184f4ebcec28f609b00a53
0928 10:44:22.992151 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.992249 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5479873}
I20260928 10:44:22.992586 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1082) took 5463 ms. Trace:
I20260928 10:44:22.992861 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 877e2d1c734a4e2891119f308f9f3ae8 (table default.Table_e76b9dab4c2a46e09d9ac504f02b02e0 [id=0d1b8d7eb041431aa8b642eb0480e0f9]) successfully deleted
W20260928 10:44:22.993100 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4706d214d3184f4ebcec28f609b00a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4706d214d3184f4ebcec28f609b00a53 already in progress: creating tablet
I20260928 10:44:22.971544 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:22.971562 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:22.975291 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7fccabf8854bb780282bc1b00a9c8b (DEFAULT_TABLE table=default.Table_1d94e32a417d4a5883cc717d1ba3cd95 [id=6b00042bf3b249c5a206b48bc90df23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.993685 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 25a2f20766024978a16b6bccd366a848 (table default.Table_0c283584d125415e848f4d61a2838a78 [id=2ce72178b0904798a75a6e756700bd26]) successfully deleted
I20260928 10:44:22.987484 8001 tablet.cc:1722] T 49c40696fe8645de9b639d2293f41403 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:22.994000 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7fccabf8854bb780282bc1b00a9c8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:22.994928 5817 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:22.995769 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a25a99ff9b81405db025150d99b40b96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:22.996284 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a25a99ff9b81405db025150d99b40b96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:22.999003 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a (DEFAULT_TABLE table=default.Table_45302aea8a9b42e493bf551696752984 [id=a8d70612f48d407689910170fbeba81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:22.999516 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.000478 7557 tablet_replica.cc:330] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:23.000716 7557 raft_consensus.cc:2229] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.000880 7557 raft_consensus.cc:2258] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:22.994845 5955 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.001091 6270 rpcz_store.cc:276] 0928 10:44:17.529445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.538548 (+ 9103us) service_pool.cc:227] Handling call
0928 10:44:22.992500 (+5453952us) ts_tablet_manager.cc:1145] Deleting tablet 6286ae20ffbe4e24a585f29444acfe17
0928 10:44:22.992508 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:22.992575 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5453645}
I20260928 10:44:23.001540 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1086) took 5301 ms. Trace:
W20260928 10:44:23.002004 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84dd90da33484afab6b5de01ed9950d6 has no consensus state
I20260928 10:44:23.002377 7557 ts_tablet_manager.cc:1905] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.002359 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8c0ee61434fb477f9c4326a24851b4c2" } new_table_name: "default.Table_6052891efa8d4dc7bba8bd42e419b804" modify_external_catalogs: true
I20260928 10:44:23.001631 6270 rpcz_store.cc:276] 0928 10:44:17.699695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.699759 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:23.001389 (+5301630us) ts_tablet_manager.cc:1145] Deleting tablet 969cd0bea65344c787308737da1efd46
0928 10:44:23.001402 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.001517 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5301433}
W20260928 10:44:23.004256 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6286ae20ffbe4e24a585f29444acfe17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6286ae20ffbe4e24a585f29444acfe17 already in progress: creating tablet
W20260928 10:44:23.005833 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 969cd0bea65344c787308737da1efd46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 969cd0bea65344c787308737da1efd46 already in progress: creating tablet
I20260928 10:44:23.006394 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1087) took 5306 ms. Trace:
I20260928 10:44:23.006811 6270 rpcz_store.cc:276] 0928 10:44:17.699808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.699856 (+ 48us) service_pool.cc:227] Handling call
0928 10:44:23.006234 (+5306378us) ts_tablet_manager.cc:1145] Deleting tablet 9012fa19e01f43238c895a84c6dc9815
0928 10:44:23.006250 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.006370 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5306203}
W20260928 10:44:23.011178 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 9012fa19e01f43238c895a84c6dc9815 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9012fa19e01f43238c895a84c6dc9815 already in progress: creating tablet
I20260928 10:44:23.011754 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1085) took 5313 ms. Trace:
I20260928 10:44:23.011946 6270 rpcz_store.cc:276] 0928 10:44:17.698454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.706502 (+ 8048us) service_pool.cc:227] Handling call
0928 10:44:23.011593 (+5305091us) ts_tablet_manager.cc:1145] Deleting tablet 1415cbe9fa15468a91932cdec4612cf9
0928 10:44:23.011607 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.011730 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5304860}
W20260928 10:44:23.012595 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1415cbe9fa15468a91932cdec4612cf9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1415cbe9fa15468a91932cdec4612cf9 already in progress: creating tablet
I20260928 10:44:23.013029 6270 tablet_replica.cc:330] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.013291 6270 raft_consensus.cc:2229] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.013638 6270 raft_consensus.cc:2258] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.014317 6270 ts_tablet_manager.cc:1905] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.014381 7841 raft_consensus.cc:482] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.015476 7841 raft_consensus.cc:504] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.016263 7841 leader_election.cc:288] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:23.021844 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e0bac650904b8f81474ba2dac9c04f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.022119 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5887b929367c4506b65e6a0e17241de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.022183 6273 tablet_bootstrap.cc:492] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:23.022122 5875 raft_consensus.cc:3037] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.023934 6273 tablet_bootstrap.cc:654] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.024801 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 940) took 9313 ms. Trace:
I20260928 10:44:23.025288 5875 raft_consensus.cc:2454] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.025415 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e8700ebe744af5949f439073f4845b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.025615 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd5ee0b5c3a49dfaef4ee24050fe23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.026597 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7fccabf8854bb780282bc1b00a9c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.027482 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba8c9b3e7d846f1927d684423ed28d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.027717 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f60c7b2e314cd19c754288d74ab93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.028038 7936 raft_consensus.cc:686] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.028811 6269 rpcz_store.cc:276] 0928 10:44:13.711587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.711947 (+ 360us) service_pool.cc:227] Handling call
0928 10:44:22.920175 (+9208228us) ts_tablet_manager.cc:1145] Deleting tablet d1b89a8edd5645afa41693f5bca42f8d
0928 10:44:23.024611 (+104436us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.024748 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9175098}
W20260928 10:44:23.029520 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d1b89a8edd5645afa41693f5bca42f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1b89a8edd5645afa41693f5bca42f8d already in progress: creating tablet
I20260928 10:44:23.033965 6269 tablet_replica.cc:330] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:23.034226 6269 raft_consensus.cc:2229] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.034449 6269 raft_consensus.cc:2258] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.035079 6269 ts_tablet_manager.cc:1905] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.036229 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a094b0f6429446eb2c499f2ed467306. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:23.044198 5521 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu pid 6329: Timed out: CheckLeaks RPC to 127.5.100.126:39997 timed out after 1.000s (SENT)
I20260928 10:44:23.044410 5521 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu with pid 6329
I20260928 10:44:23.045323 7875 raft_consensus.cc:482] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.045473 7875 raft_consensus.cc:504] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.046041 7875 leader_election.cc:288] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.050470 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 39a851d2728a46c4ab2ad70399153361
I20260928 10:44:23.051064 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.052017 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6a9937cebd4bf49babaf3f210adc81 (DEFAULT_TABLE table=default.Table_8e019ec2519e45338c6a0386f8e239de [id=d5bfcc3fd62e401aa669bcd6a6325c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.052395 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6a9937cebd4bf49babaf3f210adc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.053272 5863 tablet_service.cc:1467] Processing CreateTablet for tablet adadc310ccdf43259f34df0c99d9610d (DEFAULT_TABLE table=default.Table_0b26ed841860437185c8a291e4ea314a [id=d56bf9541a2543ab80af0b68fc9e346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.053588 5698 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:23.053653 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adadc310ccdf43259f34df0c99d9610d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.054152 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6a9937cebd4bf49babaf3f210adc81 (DEFAULT_TABLE table=default.Table_8e019ec2519e45338c6a0386f8e239de [id=d5bfcc3fd62e401aa669bcd6a6325c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.054388 6135 tablet_service.cc:1467] Processing CreateTablet for tablet adadc310ccdf43259f34df0c99d9610d (DEFAULT_TABLE table=default.Table_0b26ed841860437185c8a291e4ea314a [id=d56bf9541a2543ab80af0b68fc9e346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.042933 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6a9937cebd4bf49babaf3f210adc81 (DEFAULT_TABLE table=default.Table_8e019ec2519e45338c6a0386f8e239de [id=d5bfcc3fd62e401aa669bcd6a6325c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.054706 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 705ff025b9724267b87e0254f6124e1b (DEFAULT_TABLE table=default.Table_ebeaf48d4e944616b2a0c2c20cb7a97a [id=b6b2d97ab0bd43ee8a1465574258ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.055030 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6a9937cebd4bf49babaf3f210adc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.055248 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.055521 6020 raft_consensus.cc:2379] T a3a69d7cdda844c38fcd6a32604aecb6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:23.055763 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 39a851d2728a46c4ab2ad70399153361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.059120 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6a9937cebd4bf49babaf3f210adc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.060734 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 705ff025b9724267b87e0254f6124e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.061944 7936 consensus_queue.cc:237] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.062808 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adadc310ccdf43259f34df0c99d9610d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.063844 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_111ce6d205c444739a5082270fef23ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.064507 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_111ce6d205c444739a5082270fef23ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:23.064900 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 160897us
W20260928 10:44:23.065397 5957 consensus_peers.cc:487] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc7aa301bfbb4097b386a0d23cfa91e1. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.066999 5957 leader_election.cc:302] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.067348 7937 raft_consensus.cc:2781] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.067438 7937 raft_consensus.cc:482] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 10:44:23.067423 5955 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.067504 7937 raft_consensus.cc:3037] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.043454 6271 tablet_bootstrap.cc:654] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.069124 6275 tablet_bootstrap.cc:492] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.069242 6275 ts_tablet_manager.cc:1397] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.331s user 0.015s sys 0.010s
I20260928 10:44:23.070048 7937 raft_consensus.cc:504] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.072705 5864 tablet_service.cc:1514] Processing DeleteTablet for tablet b217b6d4ad9a495795fe2b923144e8d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.073670 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.074365 5955 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.074622 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 39a851d2728a46c4ab2ad70399153361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.074703 7937 leader_election.cc:288] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.078056 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 705ff025b9724267b87e0254f6124e1b (DEFAULT_TABLE table=default.Table_ebeaf48d4e944616b2a0c2c20cb7a97a [id=b6b2d97ab0bd43ee8a1465574258ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.078536 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 705ff025b9724267b87e0254f6124e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.043641 6270 ts_tablet_manager.cc:1918] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.078720 6270 log.cc:1196] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/bb5eed4318fe482789fee32e24a49bfc
I20260928 10:44:23.079080 6270 ts_tablet_manager.cc:1939] T bb5eed4318fe482789fee32e24a49bfc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.087028 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 39a851d2728a46c4ab2ad70399153361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.090395 6271 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.090564 6271 ts_tablet_manager.cc:1397] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.146s user 0.002s sys 0.001s
I20260928 10:44:23.091327 6271 raft_consensus.cc:348] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.091534 6271 raft_consensus.cc:374] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.091578 6271 raft_consensus.cc:729] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.091741 6271 consensus_queue.cc:260] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.092216 6271 ts_tablet_manager.cc:1428] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:23.092464 6271 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:23.095577 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc02320d52745c0a73978e050f301f0 (DEFAULT_TABLE table=default.Table_d546939ed91b4712b1271c71fcdcc595 [id=63292f80a2274d36898aefe8620a1dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.095988 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc02320d52745c0a73978e050f301f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.053748 7874 raft_consensus.cc:686] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.101248 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 59e74ac74d274a63b70b84d013e3f742
I20260928 10:44:23.101653 5694 catalog_manager.cc:6565] ReplaceTablet: tablet 59e74ac74d274a63b70b84d013e3f742 deleted and replaced by tablet 15811b6c980c467caeec2c2a253d4831
W20260928 10:44:23.101907 5955 consensus_peers.cc:487] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.098717 7874 consensus_queue.cc:237] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.103323 6275 raft_consensus.cc:348] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.103550 6275 raft_consensus.cc:374] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.103616 6275 raft_consensus.cc:729] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.103560 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e74ac74d274a63b70b84d013e3f742 with delete_type TABLET_DATA_DELETED (replaced by tablet 15811b6c980c467caeec2c2a253d4831) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.103806 6275 consensus_queue.cc:260] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.104328 6275 ts_tablet_manager.cc:1428] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260928 10:44:23.105130 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_72f42dac40bb4428988d48eed7c63c2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.105760 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72f42dac40bb4428988d48eed7c63c2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.111019 6275 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.111515 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc02320d52745c0a73978e050f301f0 (DEFAULT_TABLE table=default.Table_d546939ed91b4712b1271c71fcdcc595 [id=63292f80a2274d36898aefe8620a1dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.113476 6126 tablet_service.cc:1467] Processing CreateTablet for tablet cbfe79e65c244d14bf1fa5bdce979f5a (DEFAULT_TABLE table=default.Table_3bbb8fde63104564b0559582885c7f61 [id=c4c7e11dfc2d45d8bc31bf428e609866]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:23.115509 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 48521.6us
I20260928 10:44:23.115805 5957 leader_election.cc:302] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.116166 5957 leader_election.cc:302] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.116742 7937 raft_consensus.cc:2781] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.116827 7937 raft_consensus.cc:482] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.116899 7937 raft_consensus.cc:3037] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.117255 7557 ts_tablet_manager.cc:1918] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.117427 7557 log.cc:1196] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/bc7aa301bfbb4097b386a0d23cfa91e1
I20260928 10:44:23.117815 7557 ts_tablet_manager.cc:1939] T bc7aa301bfbb4097b386a0d23cfa91e1 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:23.118723 5957 leader_election.cc:302] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.118993 7934 raft_consensus.cc:2781] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.119112 7934 raft_consensus.cc:686] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.119361 7934 consensus_queue.cc:237] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.119637 7841 raft_consensus.cc:2781] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.119740 7841 raft_consensus.cc:686] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.119930 7841 consensus_queue.cc:237] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.121130 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_72aaa451c22e47a08a4af3a70faf6d93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.121742 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72aaa451c22e47a08a4af3a70faf6d93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.123502 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfe79e65c244d14bf1fa5bdce979f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.124864 5990 tablet_service.cc:1467] Processing CreateTablet for tablet cbfe79e65c244d14bf1fa5bdce979f5a (DEFAULT_TABLE table=default.Table_3bbb8fde63104564b0559582885c7f61 [id=c4c7e11dfc2d45d8bc31bf428e609866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.125339 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfe79e65c244d14bf1fa5bdce979f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.125200 7937 raft_consensus.cc:504] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.125876 7937 leader_election.cc:288] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.126350 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.127039 5955 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.129839 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc02320d52745c0a73978e050f301f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.130614 6275 tablet_bootstrap.cc:654] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.137311 5994 tablet_service.cc:1467] Processing CreateTablet for tablet adadc310ccdf43259f34df0c99d9610d (DEFAULT_TABLE table=default.Table_0b26ed841860437185c8a291e4ea314a [id=d56bf9541a2543ab80af0b68fc9e346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.139909 5985 tablet_service.cc:1467] Processing CreateTablet for tablet e3e24c7ec52b423bae715cc3e10953ac (DEFAULT_TABLE table=default.Table_0bfa295c4b0643e19f48abfa5852f75c [id=335da34f97444e5b87ab3c2ddbaa5436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.142925 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87dd8e89c394e4f96c9d8c5fed17e66" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.143605 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e24c7ec52b423bae715cc3e10953ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.144912 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e3a5246fa46e4753885784f87343c0ce
I20260928 10:44:23.145547 5699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d218864d94134c1f991aea4eda089223" } modify_external_catalogs: true
I20260928 10:44:23.145725 5699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d218864d94134c1f991aea4eda089223" } modify_external_catalogs: true
I20260928 10:44:23.145962 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet e3a5246fa46e4753885784f87343c0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.146198 6126 tablet_service.cc:1467] Processing CreateTablet for tablet e3e24c7ec52b423bae715cc3e10953ac (DEFAULT_TABLE table=default.Table_0bfa295c4b0643e19f48abfa5852f75c [id=335da34f97444e5b87ab3c2ddbaa5436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.146610 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e24c7ec52b423bae715cc3e10953ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.148630 5983 tablet_service.cc:1514] Processing DeleteTablet for tablet e3a5246fa46e4753885784f87343c0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.149209 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e74ac74d274a63b70b84d013e3f742 with delete_type TABLET_DATA_DELETED (replaced by tablet 15811b6c980c467caeec2c2a253d4831) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.149786 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet bc7aa301bfbb4097b386a0d23cfa91e1 (table default.Table_6089745a618d42d496cff786eba718fa [id=2f4692f3be284f3c81ec608ace7d6d0f]) successfully deleted
W20260928 10:44:23.150918 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 049def79ba394ccd8d2a29d7d55e5e5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 049def79ba394ccd8d2a29d7d55e5e5b already in progress: creating tablet
I20260928 10:44:23.152207 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adadc310ccdf43259f34df0c99d9610d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.142320 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.155196 5878 raft_consensus.cc:2379] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f6ffbf4f0534383bf89d15aa37e3027 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
W20260928 10:44:23.158985 5696 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b67c64d751a4118babeaac6ca19e2f7 consensus state has no leader
I20260928 10:44:23.160910 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3" } modify_external_catalogs: true
I20260928 10:44:23.161159 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fb2f2dff4e40476f81bf3bb484d9e8f3" } modify_external_catalogs: true
I20260928 10:44:23.162514 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.162788 5878 raft_consensus.cc:2454] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.151806 6134 tablet_service.cc:1467] Processing CreateTablet for tablet d8dccdfac6a84d8888992fca556fbc8b (DEFAULT_TABLE table=default.Table_6f01bea3c56e4734aa31be4a99aa5589 [id=2ec6d887f4ec41a48612e5635903e4bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:23.163805 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1daf1ef2778342f097125f3469e27967 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1daf1ef2778342f097125f3469e27967 already in progress: creating tablet
I20260928 10:44:23.164692 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8dccdfac6a84d8888992fca556fbc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.102811 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a69d7cdda844c38fcd6a32604aecb6" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.171043 5875 raft_consensus.cc:2379] T a3a69d7cdda844c38fcd6a32604aecb6 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:23.171495 5985 tablet_service.cc:1467] Processing CreateTablet for tablet d8dccdfac6a84d8888992fca556fbc8b (DEFAULT_TABLE table=default.Table_6f01bea3c56e4734aa31be4a99aa5589 [id=2ec6d887f4ec41a48612e5635903e4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.171917 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8dccdfac6a84d8888992fca556fbc8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:23.172619 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6f37298cccf44cb5a997813106d15e56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f37298cccf44cb5a997813106d15e56 already in progress: creating tablet
I20260928 10:44:23.172680 5864 tablet_service.cc:1467] Processing CreateTablet for tablet cbfe79e65c244d14bf1fa5bdce979f5a (DEFAULT_TABLE table=default.Table_3bbb8fde63104564b0559582885c7f61 [id=c4c7e11dfc2d45d8bc31bf428e609866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.173014 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbfe79e65c244d14bf1fa5bdce979f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.172724 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet e3a5246fa46e4753885784f87343c0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.173564 5855 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc02320d52745c0a73978e050f301f0 (DEFAULT_TABLE table=default.Table_d546939ed91b4712b1271c71fcdcc595 [id=63292f80a2274d36898aefe8620a1dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.173890 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc02320d52745c0a73978e050f301f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.176522 5858 tablet_service.cc:1467] Processing CreateTablet for tablet e3e24c7ec52b423bae715cc3e10953ac (DEFAULT_TABLE table=default.Table_0bfa295c4b0643e19f48abfa5852f75c [id=335da34f97444e5b87ab3c2ddbaa5436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.176821 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e24c7ec52b423bae715cc3e10953ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:23.178668 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 914ea799da554974960e7bf142a407b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 914ea799da554974960e7bf142a407b1 already in progress: creating tablet
W20260928 10:44:23.180548 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d8bb524f0fc74503903f341d0e567e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8bb524f0fc74503903f341d0e567e40 already in progress: creating tablet
I20260928 10:44:23.181295 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e74ac74d274a63b70b84d013e3f742 with delete_type TABLET_DATA_DELETED (replaced by tablet 15811b6c980c467caeec2c2a253d4831) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.181015 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.184024 5869 raft_consensus.cc:2454] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.184551 5849 tablet_service.cc:1467] Processing CreateTablet for tablet d8dccdfac6a84d8888992fca556fbc8b (DEFAULT_TABLE table=default.Table_6f01bea3c56e4734aa31be4a99aa5589 [id=2ec6d887f4ec41a48612e5635903e4bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:23.184697 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet a8ad986491cf44669c6a5ef3f6ea21ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8ad986491cf44669c6a5ef3f6ea21ef already in progress: creating tablet
I20260928 10:44:23.184963 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8dccdfac6a84d8888992fca556fbc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.185731 6273 tablet_bootstrap.cc:492] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.185886 6273 ts_tablet_manager.cc:1397] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.164s user 0.021s sys 0.017s
I20260928 10:44:23.185827 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 81a6d4535a474dff9dbb63f3fab2c0a3 (DEFAULT_TABLE table=default.Table_f58b0d9292834bc6b9a3ce6f7cc3c025 [id=0d559a91ad174194812e9151005bac55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.186043 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 81a6d4535a474dff9dbb63f3fab2c0a3 (DEFAULT_TABLE table=default.Table_f58b0d9292834bc6b9a3ce6f7cc3c025 [id=0d559a91ad174194812e9151005bac55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.186193 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a6d4535a474dff9dbb63f3fab2c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.186470 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a6d4535a474dff9dbb63f3fab2c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.186721 6269 ts_tablet_manager.cc:1918] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:23.186844 6269 log.cc:1196] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/ffa971239a2b4ac6bc309dfbacdbe12e
I20260928 10:44:23.187184 6269 ts_tablet_manager.cc:1939] T ffa971239a2b4ac6bc309dfbacdbe12e P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:23.187959 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 947) took 9204 ms. Trace:
I20260928 10:44:23.188097 6269 rpcz_store.cc:276] 0928 10:44:13.983685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:13.983738 (+ 53us) service_pool.cc:227] Handling call
0928 10:44:23.029143 (+9045405us) ts_tablet_manager.cc:1145] Deleting tablet ffa971239a2b4ac6bc309dfbacdbe12e
0928 10:44:23.029162 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.050800 (+ 21638us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.186629 (+135829us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.187941 (+ 1312us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9033230}
I20260928 10:44:23.188709 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 957) took 8936 ms. Trace:
I20260928 10:44:23.188784 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet ffa971239a2b4ac6bc309dfbacdbe12e (table default.Table_413facdd66c5442eb11b3bc647d2f82e [id=1e94990c87d944c696ef7e171c5f09bf]) successfully deleted
I20260928 10:44:23.188841 6269 rpcz_store.cc:276] 0928 10:44:14.251808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.253501 (+ 1693us) service_pool.cc:227] Handling call
0928 10:44:23.188596 (+8935095us) ts_tablet_manager.cc:1145] Deleting tablet 91337888b5864a2286b9afb7fcba8c98
0928 10:44:23.188606 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.188694 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8911934}
I20260928 10:44:23.189299 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 956) took 8937 ms. Trace:
W20260928 10:44:23.189409 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 91337888b5864a2286b9afb7fcba8c98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91337888b5864a2286b9afb7fcba8c98 already in progress: creating tablet
I20260928 10:44:23.189430 6269 rpcz_store.cc:276] 0928 10:44:14.251732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.253464 (+ 1732us) service_pool.cc:227] Handling call
0928 10:44:23.189202 (+8935738us) ts_tablet_manager.cc:1145] Deleting tablet 5eb089481e47455cb7387b0f17eda9fb
0928 10:44:23.189212 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.189286 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8911597}
I20260928 10:44:23.189834 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 958) took 8937 ms. Trace:
W20260928 10:44:23.189882 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5eb089481e47455cb7387b0f17eda9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eb089481e47455cb7387b0f17eda9fb already in progress: creating tablet
I20260928 10:44:23.189951 6269 rpcz_store.cc:276] 0928 10:44:14.251893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.253537 (+ 1644us) service_pool.cc:227] Handling call
0928 10:44:23.189745 (+8936208us) ts_tablet_manager.cc:1145] Deleting tablet cab9bc67c7474cb681566118af1bbf07
0928 10:44:23.189754 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.189821 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8911680}
I20260928 10:44:23.190508 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 954) took 8938 ms. Trace:
W20260928 10:44:23.190599 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet cab9bc67c7474cb681566118af1bbf07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab9bc67c7474cb681566118af1bbf07 already in progress: creating tablet
I20260928 10:44:23.190634 6269 rpcz_store.cc:276] 0928 10:44:14.251563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.253383 (+ 1820us) service_pool.cc:227] Handling call
0928 10:44:23.190386 (+8937003us) ts_tablet_manager.cc:1145] Deleting tablet 19e0768dea6a40889a3f50b953c0ee4d
0928 10:44:23.190395 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.190493 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8909876}
I20260928 10:44:23.190969 6269 tablet_replica.cc:330] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
W20260928 10:44:23.191042 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 1aefce878fd0459c9c6502cfd226e2c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aefce878fd0459c9c6502cfd226e2c7 already in progress: creating tablet
I20260928 10:44:23.192003 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 705ff025b9724267b87e0254f6124e1b (DEFAULT_TABLE table=default.Table_ebeaf48d4e944616b2a0c2c20cb7a97a [id=b6b2d97ab0bd43ee8a1465574258ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.192430 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 705ff025b9724267b87e0254f6124e1b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:23.194525 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d03fd57e996c486384f92000925aff8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03fd57e996c486384f92000925aff8a already in progress: creating tablet
W20260928 10:44:23.197180 5687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.100.126:39997 (error 108) [suppressed 3 similar messages]
W20260928 10:44:23.199955 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 380ec5581fdc4ad587185cd5bb8a35fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 380ec5581fdc4ad587185cd5bb8a35fe already in progress: creating tablet
I20260928 10:44:23.200922 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1089) took 5472 ms. Trace:
W20260928 10:44:23.201685 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7b876b30dca04b758f8f540bf86426ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b876b30dca04b758f8f540bf86426ef already in progress: creating tablet
I20260928 10:44:23.202912 6270 rpcz_store.cc:276] 0928 10:44:17.728110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.728201 (+ 91us) service_pool.cc:227] Handling call
0928 10:44:23.012976 (+5284775us) ts_tablet_manager.cc:1145] Deleting tablet bb5eed4318fe482789fee32e24a49bfc
0928 10:44:23.012990 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.040634 (+ 27644us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.043537 (+ 2903us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.200881 (+157344us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5283392}
I20260928 10:44:23.205858 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:23.206113 5700 catalog_manager.cc:5495] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:23.206247 6273 raft_consensus.cc:348] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.207028 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:23.206519 6273 raft_consensus.cc:374] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.207299 5700 catalog_manager.cc:5495] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:23.207743 6273 raft_consensus.cc:729] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.207827 5700 catalog_manager.cc:5495] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:23.208141 5700 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:23.193910 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.210004 5875 raft_consensus.cc:2454] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
W20260928 10:44:23.211861 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 29a1be37ede84ea485182044be92b8c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29a1be37ede84ea485182044be92b8c6 already in progress: creating tablet
W20260928 10:44:23.212633 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 39a851d2728a46c4ab2ad70399153361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39a851d2728a46c4ab2ad70399153361 already in progress: creating tablet
I20260928 10:44:23.214080 6270 tablet_replica.cc:330] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.210119 6271 tablet_bootstrap.cc:654] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.214767 6270 raft_consensus.cc:2229] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.215270 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.215498 5875 raft_consensus.cc:3037] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.215610 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 1f048fd379b9431fa3cbf0a437cbc957 (DEFAULT_TABLE table=default.Table_fa3b74f68d384005854e342c622e1d18 [id=2a832ef8f89940168a53ff424c8d140c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.216257 6273 consensus_queue.cc:260] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.216922 6273 ts_tablet_manager.cc:1428] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260928 10:44:23.217211 6273 tablet_bootstrap.cc:492] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:23.217702 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 59e74ac74d274a63b70b84d013e3f742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59e74ac74d274a63b70b84d013e3f742 already in progress: creating tablet
I20260928 10:44:23.218015 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.218190 5869 raft_consensus.cc:3037] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.220177 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1f048fd379b9431fa3cbf0a437cbc957 (DEFAULT_TABLE table=default.Table_fa3b74f68d384005854e342c622e1d18 [id=2a832ef8f89940168a53ff424c8d140c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.220602 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f048fd379b9431fa3cbf0a437cbc957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.220793 6273 tablet_bootstrap.cc:654] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.221735 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 81a6d4535a474dff9dbb63f3fab2c0a3 (DEFAULT_TABLE table=default.Table_f58b0d9292834bc6b9a3ce6f7cc3c025 [id=0d559a91ad174194812e9151005bac55]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:23.222186 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet e3a5246fa46e4753885784f87343c0ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3a5246fa46e4753885784f87343c0ce already in progress: creating tablet
I20260928 10:44:23.222169 6091 leader_election.cc:302] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:23.222610 7875 raft_consensus.cc:3037] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.225073 7875 raft_consensus.cc:2726] T a3a69d7cdda844c38fcd6a32604aecb6 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.218073 6271 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.225832 6270 raft_consensus.cc:2258] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.191283 6269 raft_consensus.cc:2229] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.216442 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f048fd379b9431fa3cbf0a437cbc957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.234583 6271 ts_tablet_manager.cc:1397] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.142s user 0.004s sys 0.000s
I20260928 10:44:23.235314 6271 raft_consensus.cc:348] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.235536 6271 raft_consensus.cc:374] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.235602 6271 raft_consensus.cc:729] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.235814 6271 consensus_queue.cc:260] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.236400 6271 ts_tablet_manager.cc:1428] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:23.236690 6271 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:23.238097 6271 tablet_bootstrap.cc:654] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.246665 6270 ts_tablet_manager.cc:1905] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.247869 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 97a2279aa4554a3dbee6f22b18205a47
I20260928 10:44:23.248970 6117 tablet_service.cc:1514] Processing DeleteTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:23.249759 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 97a2279aa4554a3dbee6f22b18205a47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97a2279aa4554a3dbee6f22b18205a47 already in progress: creating tablet
I20260928 10:44:23.251305 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_3b1f6971648540279d90e7812fddf964" } new_table_name: "default.Table_514aa835c8a64739843deef2c227d378" modify_external_catalogs: true
W20260928 10:44:23.252578 8013 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:44:23.199312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.126:39997 (local address 127.5.100.67:41889)
0928 10:44:23.252274 (+ 52962us) negotiation.cc:107] Waiting for socket to connect
0928 10:44:23.252403 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":52826,"threads_started":1}
I20260928 10:44:23.253562 6271 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.253914 5701 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5afe4501ea584d44b511b89983e210e3 (table default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73]). Expected version 1 got 0
I20260928 10:44:23.229480 7954 raft_consensus.cc:482] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.254570 6275 tablet_bootstrap.cc:492] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.254693 6275 ts_tablet_manager.cc:1397] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.144s user 0.002s sys 0.007s
I20260928 10:44:23.254529 7954 raft_consensus.cc:504] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.254523 6271 ts_tablet_manager.cc:1397] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.004s
I20260928 10:44:23.254856 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a579299b68764bf0b39b1df631599e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.255163 7954 leader_election.cc:288] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:23.255416 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a579299b68764bf0b39b1df631599e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.255439 6275 raft_consensus.cc:348] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:23.255635 6275 raft_consensus.cc:374] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.255687 6275 raft_consensus.cc:729] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.255769 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ea1325da4e460da08377f5d6d6a055" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.256284 5817 leader_election.cc:341] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.236369 5869 raft_consensus.cc:2454] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.253175 5849 tablet_service.cc:1514] Processing DeleteTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.256659 6269 raft_consensus.cc:2258] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.257201 6269 ts_tablet_manager.cc:1905] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.258868 6271 raft_consensus.cc:348] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.260185 6271 raft_consensus.cc:374] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.260687 6271 raft_consensus.cc:729] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.262027 6271 consensus_queue.cc:260] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:23.263456 8012 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 10:44:23.198230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.100.126:39997 (local address 127.5.100.66:51583)
0928 10:44:23.263191 (+ 64961us) negotiation.cc:107] Waiting for socket to connect
0928 10:44:23.263296 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":64838,"threads_started":1}
I20260928 10:44:23.266152 6271 ts_tablet_manager.cc:1428] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260928 10:44:23.272301 5875 raft_consensus.cc:2454] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.274067 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a6d4535a474dff9dbb63f3fab2c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.277606 7954 raft_consensus.cc:482] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.277736 7954 raft_consensus.cc:504] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.278316 7954 leader_election.cc:288] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.278877 6275 consensus_queue.cc:260] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } }
I20260928 10:44:23.280117 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03f686afffc4d47b5e27fdbc8eb8f75" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.280598 5817 leader_election.cc:341] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:23.280804 5818 connection.cc:535] client connection to 127.5.100.126:39997 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 10:44:23.283893 6152 raft_consensus.cc:3037] T 37669fbe13614892a9b8cc2df4e10b4a P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.286599 6275 ts_tablet_manager.cc:1428] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.032s user 0.001s sys 0.000s
I20260928 10:44:23.286876 6275 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.288174 6275 tablet_bootstrap.cc:654] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.297804 5698 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_0f93296a01d84736bc6c98435eaec057 [id=7acebc30682b4301baf9446bb5006a5e] alter complete (version 2)
I20260928 10:44:23.308981 6273 tablet_bootstrap.cc:492] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.309165 6273 ts_tablet_manager.cc:1397] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.001s
I20260928 10:44:23.309967 6273 raft_consensus.cc:348] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.310194 6273 raft_consensus.cc:374] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.310243 6273 raft_consensus.cc:729] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.310429 6273 consensus_queue.cc:260] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.267843 6271 tablet_bootstrap.cc:492] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:23.317556 6271 tablet_bootstrap.cc:654] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.298166 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.318608 6019 raft_consensus.cc:2454] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:23.298938 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.318971 6020 raft_consensus.cc:2379] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab770e77cb704ea38b5ca8cff97dc73b in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:23.299070 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03f686afffc4d47b5e27fdbc8eb8f75" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:23.320094 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05c21bf3bbd7403cbc5a74142a883000 consensus state has no leader
I20260928 10:44:23.299661 5957 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:23.323472 5957 leader_election.cc:302] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.323810 7998 raft_consensus.cc:2726] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.323971 7998 raft_consensus.cc:2781] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.324028 7998 raft_consensus.cc:482] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.324086 7998 raft_consensus.cc:3037] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.326365 6271 tablet_bootstrap.cc:492] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.326540 6271 ts_tablet_manager.cc:1397] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.000s
I20260928 10:44:23.327253 6271 raft_consensus.cc:348] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.327473 6271 raft_consensus.cc:374] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.327525 6271 raft_consensus.cc:729] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.327708 6271 consensus_queue.cc:260] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.328958 7998 raft_consensus.cc:504] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.329756 7998 leader_election.cc:288] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.299769 7934 raft_consensus.cc:482] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.330255 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.330828 5955 leader_election.cc:341] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.304697 6270 ts_tablet_manager.cc:1918] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.331280 6270 log.cc:1196] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/463cf5ecb52d40069b564698433c6781
I20260928 10:44:23.330466 7934 raft_consensus.cc:504] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.331722 6270 ts_tablet_manager.cc:1939] T 463cf5ecb52d40069b564698433c6781 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.332113 7934 leader_election.cc:288] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.300752 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ea1325da4e460da08377f5d6d6a055" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.297909 7874 consensus_queue.cc:1035] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260928 10:44:23.332695 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.333060 5695 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_62812cefd5b44da7a231a4e62521f052 [id=6677562fe2604addb84af531539cbebd]). Expected version 5 got 0
W20260928 10:44:23.333230 5955 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.334131 5695 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7fef88bbff7b455e8425afae90011244" } new_table_name: "default.Table_d5a0dd5f9b9b449c90c294aad914b8a6" modify_external_catalogs: true
I20260928 10:44:23.334805 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_a09c98a1baca4a3baf60afa1750cba65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.335421 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a09c98a1baca4a3baf60afa1750cba65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.338430 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ae94d412a89b44a484fcaa2c3eaf30f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.339066 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae94d412a89b44a484fcaa2c3eaf30f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.342730 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_582bec7fc1de458b9f8615e82e51928b" } new_table_name: "default.Table_e1798cafe0214af0b6c596b03cdf5535" modify_external_catalogs: true
I20260928 10:44:23.346123 5698 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:23.347102 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_569d20faf098464ba7d2f757927af5cd" } modify_external_catalogs: true
I20260928 10:44:23.347355 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_569d20faf098464ba7d2f757927af5cd" } modify_external_catalogs: true
I20260928 10:44:23.354743 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 6c7cce0e772e4e8aae5b56350834cee2
I20260928 10:44:23.355654 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.358349 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3c67f960eb84426f9ebdfef33306a9d0 (table default.Table_62812cefd5b44da7a231a4e62521f052 [id=6677562fe2604addb84af531539cbebd]). Expected version 5 got 0
I20260928 10:44:23.360136 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet ea90e2cbd7624baab1522b8b4afa5f32 with delete_type TABLET_DATA_DELETED (replaced by tablet 734c09c7645c4dd3a05f6508297ee48b) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.360589 6271 ts_tablet_manager.cc:1428] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20260928 10:44:23.360870 6271 tablet_bootstrap.cc:492] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:23.360982 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1088) took 5633 ms. Trace:
I20260928 10:44:23.361050 6270 rpcz_store.cc:276] 0928 10:44:17.727993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.729637 (+ 1644us) service_pool.cc:227] Handling call
0928 10:44:23.214020 (+5484383us) ts_tablet_manager.cc:1145] Deleting tablet 463cf5ecb52d40069b564698433c6781
0928 10:44:23.214034 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.268688 (+ 54654us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.304569 (+ 35881us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.360965 (+ 56396us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28419,"tablet-delete.queue_time_us":5483873}
I20260928 10:44:23.362207 6271 tablet_bootstrap.cc:654] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.362282 7874 raft_consensus.cc:482] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.362427 7874 raft_consensus.cc:504] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.360133 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_431546713d5f45f19cc93a06e85ba939"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.362936 7874 leader_election.cc:288] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:23.363029 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_431546713d5f45f19cc93a06e85ba939 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.364514 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1102) took 5448 ms. Trace:
I20260928 10:44:23.364655 6270 rpcz_store.cc:276] 0928 10:44:17.916345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.916787 (+ 442us) service_pool.cc:227] Handling call
0928 10:44:23.361291 (+5444504us) ts_tablet_manager.cc:1145] Deleting tablet 4ead8c7aa6364125bd059516cf0413e7
0928 10:44:23.361841 (+ 550us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.364498 (+ 2657us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5444323}
W20260928 10:44:23.364835 5818 leader_election.cc:341] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.365222 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1103) took 5448 ms. Trace:
I20260928 10:44:23.365343 6270 rpcz_store.cc:276] 0928 10:44:17.916414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.917001 (+ 587us) service_pool.cc:227] Handling call
0928 10:44:23.365112 (+5448111us) ts_tablet_manager.cc:1145] Deleting tablet 6520ab6acc2142a2a3b8e1f0dabedc7a
0928 10:44:23.365124 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.365208 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5393259}
I20260928 10:44:23.365834 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1104) took 5437 ms. Trace:
I20260928 10:44:23.365965 6270 rpcz_store.cc:276] 0928 10:44:17.928238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.928867 (+ 629us) service_pool.cc:227] Handling call
0928 10:44:23.365736 (+5436869us) ts_tablet_manager.cc:1145] Deleting tablet 2c3a6c8d0bf1402dbac60afd9298f4e6
0928 10:44:23.365747 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.365821 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5392465}
I20260928 10:44:23.366442 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1114) took 5230 ms. Trace:
I20260928 10:44:23.366609 6270 rpcz_store.cc:276] 0928 10:44:18.136007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.137986 (+ 1979us) service_pool.cc:227] Handling call
0928 10:44:23.366351 (+5228365us) ts_tablet_manager.cc:1145] Deleting tablet 98689ee648a84666a783aef0d4601fc2
0928 10:44:23.366362 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.366430 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5182254}
I20260928 10:44:23.367072 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1115) took 5182 ms. Trace:
I20260928 10:44:23.367664 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.358973 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet bb5eed4318fe482789fee32e24a49bfc (table default.Table_c08de4d3d9ce4f20bed63a830c987c35 [id=42b8d28c18164d34bbad1117d30d8289]) successfully deleted
I20260928 10:44:23.369009 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 463cf5ecb52d40069b564698433c6781 (table default.Table_2e92501b07184f8d9021b31cc4f752fb [id=c6c3ffb46ceb49eca78668fed12ab1cc]) successfully deleted
I20260928 10:44:23.370278 5818 leader_election.cc:302] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.372068 7955 raft_consensus.cc:2726] T a87dd8e89c394e4f96c9d8c5fed17e66 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.372534 6270 rpcz_store.cc:276] 0928 10:44:18.184698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.185110 (+ 412us) service_pool.cc:227] Handling call
0928 10:44:23.366981 (+5181871us) ts_tablet_manager.cc:1145] Deleting tablet 47cd73e527d04194a7ca8c24a7134e09
0928 10:44:23.366991 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.367060 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5181697}
W20260928 10:44:23.373353 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 46127.5us
I20260928 10:44:23.374208 6273 ts_tablet_manager.cc:1428] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.065s user 0.002s sys 0.000s
W20260928 10:44:23.374675 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4ead8c7aa6364125bd059516cf0413e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ead8c7aa6364125bd059516cf0413e7 already in progress: creating tablet
I20260928 10:44:23.374631 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.374888 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 6520ab6acc2142a2a3b8e1f0dabedc7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6520ab6acc2142a2a3b8e1f0dabedc7a already in progress: creating tablet
W20260928 10:44:23.375064 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 already in progress: creating tablet
I20260928 10:44:23.373569 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1117) took 5132 ms. Trace:
W20260928 10:44:23.375249 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 98689ee648a84666a783aef0d4601fc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98689ee648a84666a783aef0d4601fc2 already in progress: creating tablet
I20260928 10:44:23.375217 6270 rpcz_store.cc:276] 0928 10:44:18.241407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.242231 (+ 824us) service_pool.cc:227] Handling call
0928 10:44:23.373170 (+5130939us) ts_tablet_manager.cc:1145] Deleting tablet c7f4ce1792fd494687863136583be109
0928 10:44:23.373459 (+ 289us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.373552 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5130748}
I20260928 10:44:23.375633 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1119) took 4737 ms. Trace:
W20260928 10:44:23.375768 5955 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.375833 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d0584d6b80e43eb913c3932256cd89e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.376034 7557 tablet_replica.cc:330] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:23.375761 6270 rpcz_store.cc:276] 0928 10:44:18.638377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.663535 (+ 25158us) service_pool.cc:227] Handling call
0928 10:44:23.375532 (+4711997us) ts_tablet_manager.cc:1145] Deleting tablet 1fab26669af04128871528af607785f9
0928 10:44:23.375542 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.375618 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4711741}
I20260928 10:44:23.376219 7557 raft_consensus.cc:2229] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.376341 7557 raft_consensus.cc:2258] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:23.376546 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 47cd73e527d04194a7ca8c24a7134e09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47cd73e527d04194a7ca8c24a7134e09 already in progress: creating tablet
I20260928 10:44:23.376827 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1121) took 4625 ms. Trace:
I20260928 10:44:23.376895 6270 rpcz_store.cc:276] 0928 10:44:18.751682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.751738 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:23.376321 (+4624583us) ts_tablet_manager.cc:1145] Deleting tablet 45814bb909ed4a15a39a0819973042d2
0928 10:44:23.376728 (+ 407us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.376811 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4624371}
I20260928 10:44:23.377175 7557 ts_tablet_manager.cc:1905] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.378021 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1124) took 4532 ms. Trace:
I20260928 10:44:23.378090 6270 rpcz_store.cc:276] 0928 10:44:18.845470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.845857 (+ 387us) service_pool.cc:227] Handling call
0928 10:44:23.377927 (+4532070us) ts_tablet_manager.cc:1145] Deleting tablet 7fd4f439f1ac4c368f18fc3bc2dacb07
0928 10:44:23.377937 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.378006 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531839}
W20260928 10:44:23.381106 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c7f4ce1792fd494687863136583be109 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f4ce1792fd494687863136583be109 already in progress: creating tablet
W20260928 10:44:23.381311 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1fab26669af04128871528af607785f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fab26669af04128871528af607785f9 already in progress: creating tablet
W20260928 10:44:23.381454 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 45814bb909ed4a15a39a0819973042d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45814bb909ed4a15a39a0819973042d2 already in progress: creating tablet
I20260928 10:44:23.381512 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1125) took 4535 ms. Trace:
W20260928 10:44:23.381606 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd4f439f1ac4c368f18fc3bc2dacb07 already in progress: creating tablet
I20260928 10:44:23.381582 6270 rpcz_store.cc:276] 0928 10:44:18.845625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.846131 (+ 506us) service_pool.cc:227] Handling call
0928 10:44:23.381419 (+4535288us) ts_tablet_manager.cc:1145] Deleting tablet cee82663abf948a8a2a36c1676a57a8d
0928 10:44:23.381429 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.381498 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4535158}
W20260928 10:44:23.382035 5687 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997): Couldn't send request to peer a2eb817eda984ab99ec4704c47699846. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:23.382423 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet cee82663abf948a8a2a36c1676a57a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cee82663abf948a8a2a36c1676a57a8d already in progress: creating tablet
I20260928 10:44:23.382833 5984 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7cce0e772e4e8aae5b56350834cee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.382999 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 97a2279aa4554a3dbee6f22b18205a47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:22 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.383632 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 1f048fd379b9431fa3cbf0a437cbc957 (DEFAULT_TABLE table=default.Table_fa3b74f68d384005854e342c622e1d18 [id=2a832ef8f89940168a53ff424c8d140c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:23.383961 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f048fd379b9431fa3cbf0a437cbc957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:23.386652 7934 raft_consensus.cc:482] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.386761 7934 raft_consensus.cc:504] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:23.389726 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 6c7cce0e772e4e8aae5b56350834cee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7cce0e772e4e8aae5b56350834cee2 already in progress: creating tablet
I20260928 10:44:23.390429 7934 leader_election.cc:288] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.390842 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.390990 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1126) took 4545 ms. Trace:
I20260928 10:44:23.391067 6270 rpcz_store.cc:276] 0928 10:44:18.845717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:18.846289 (+ 572us) service_pool.cc:227] Handling call
0928 10:44:23.390877 (+4544588us) ts_tablet_manager.cc:1145] Deleting tablet 7a3cb198fb3d481eb6bdab29d968144e
0928 10:44:23.390888 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.390975 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4544477}
W20260928 10:44:23.391470 5955 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.391845 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1147) took 4246 ms. Trace:
I20260928 10:44:23.391918 6270 rpcz_store.cc:276] 0928 10:44:19.145520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.145575 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:23.391744 (+4246169us) ts_tablet_manager.cc:1145] Deleting tablet 4297f5d615074e28965ea88204aa007c
0928 10:44:23.391754 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.391830 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4189113}
I20260928 10:44:23.392161 7557 ts_tablet_manager.cc:1918] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.392258 7557 log.cc:1196] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/1d0584d6b80e43eb913c3932256cd89e
I20260928 10:44:23.392364 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1148) took 4244 ms. Trace:
I20260928 10:44:23.392433 6270 rpcz_store.cc:276] 0928 10:44:19.148288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.148349 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:23.392267 (+4243918us) ts_tablet_manager.cc:1145] Deleting tablet e94c1f9d646646d88e675d56046c5392
0928 10:44:23.392277 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.392349 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4189573}
I20260928 10:44:23.392541 7557 ts_tablet_manager.cc:1939] T 1d0584d6b80e43eb913c3932256cd89e P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:23.392843 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1149) took 4231 ms. Trace:
I20260928 10:44:23.392910 6270 rpcz_store.cc:276] 0928 10:44:19.161195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.186303 (+ 25108us) service_pool.cc:227] Handling call
0928 10:44:23.392753 (+4206450us) ts_tablet_manager.cc:1145] Deleting tablet 4f5c26637f264087a6d613d63a89238c
0928 10:44:23.392763 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.392829 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4114665}
I20260928 10:44:23.393368 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1150) took 4081 ms. Trace:
I20260928 10:44:23.393455 6270 rpcz_store.cc:276] 0928 10:44:19.311924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.330092 (+ 18168us) service_pool.cc:227] Handling call
0928 10:44:23.393279 (+4063187us) ts_tablet_manager.cc:1145] Deleting tablet b508c7a57bf04f4c9d7293a5e8a55935
0928 10:44:23.393288 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.393354 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3946596}
I20260928 10:44:23.394161 6270 tablet_replica.cc:330] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.394258 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 1d0584d6b80e43eb913c3932256cd89e (table default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]) successfully deleted
I20260928 10:44:23.394348 6270 raft_consensus.cc:2229] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.394569 6270 raft_consensus.cc:2258] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.395090 6270 ts_tablet_manager.cc:1905] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.400627 5957 leader_election.cc:302] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.401494 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7a3cb198fb3d481eb6bdab29d968144e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a3cb198fb3d481eb6bdab29d968144e already in progress: creating tablet
W20260928 10:44:23.401773 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4297f5d615074e28965ea88204aa007c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4297f5d615074e28965ea88204aa007c already in progress: creating tablet
W20260928 10:44:23.402010 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet e94c1f9d646646d88e675d56046c5392 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e94c1f9d646646d88e675d56046c5392 already in progress: creating tablet
W20260928 10:44:23.402187 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4f5c26637f264087a6d613d63a89238c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f5c26637f264087a6d613d63a89238c already in progress: creating tablet
W20260928 10:44:23.402424 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet b508c7a57bf04f4c9d7293a5e8a55935 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b508c7a57bf04f4c9d7293a5e8a55935 already in progress: creating tablet
I20260928 10:44:23.402617 6275 tablet_bootstrap.cc:492] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.402758 6275 ts_tablet_manager.cc:1397] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.116s user 0.006s sys 0.002s
I20260928 10:44:23.402810 7934 raft_consensus.cc:2781] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.402890 7934 raft_consensus.cc:482] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.403072 7936 consensus_queue.cc:1035] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:23.402949 7934 raft_consensus.cc:3037] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.406420 7934 raft_consensus.cc:504] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.406638 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet f799021aca384269bfcd67829f3a7db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:09 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.406939 6275 raft_consensus.cc:348] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.407151 6275 raft_consensus.cc:374] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.407204 6275 raft_consensus.cc:729] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.407397 6275 consensus_queue.cc:260] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.407683 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.407737 7934 leader_election.cc:288] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.403126 5957 leader_election.cc:302] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.408071 5955 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.409421 7936 raft_consensus.cc:2781] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.409497 7936 raft_consensus.cc:482] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.409554 7936 raft_consensus.cc:3037] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.410696 6273 tablet_bootstrap.cc:492] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:23.412137 7936 raft_consensus.cc:504] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.412542 6275 ts_tablet_manager.cc:1428] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 10:44:23.413296 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet ff01c1c1ed72488791827c5aa57f1de7
I20260928 10:44:23.415037 6275 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.415843 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 45a8098440fb4e919bc5e3f4dd3241a7 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:23.416715 6275 tablet_bootstrap.cc:654] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.419066 7936 leader_election.cc:288] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:23.419828 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:23.420647 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet ff01c1c1ed72488791827c5aa57f1de7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff01c1c1ed72488791827c5aa57f1de7 already in progress: creating tablet
I20260928 10:44:23.420653 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.421535 5955 leader_election.cc:341] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.422374 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.429956 6273 tablet_bootstrap.cc:654] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.431522 6271 tablet_bootstrap.cc:492] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.431690 6271 ts_tablet_manager.cc:1397] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.071s user 0.009s sys 0.003s
W20260928 10:44:23.432294 5695 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 148a0e6334424831abbb6c19d6b39baa consensus state has no leader
I20260928 10:44:23.433175 7875 raft_consensus.cc:482] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.433310 7875 raft_consensus.cc:504] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.433866 7875 leader_election.cc:288] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:23.435225 5694 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12fb38b8f81c4a269d775a1efa360ccd consensus state has no leader
I20260928 10:44:23.436496 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5b0bc94471ad4608af7a85f27b60af68
I20260928 10:44:23.436993 5698 master_service.cc:946] ReplaceTablet: received request to replace tablet 3ae85d945b0242c289e2e930d1485758 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:23.437407 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:23.437599 6091 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1a659100a124506a411c929ddc31f10
W20260928 10:44:23.438251 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5b0bc94471ad4608af7a85f27b60af68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b0bc94471ad4608af7a85f27b60af68 already in progress: creating tablet
I20260928 10:44:23.440863 6269 ts_tablet_manager.cc:1918] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.440992 6269 log.cc:1196] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/cc2990e37a9648669eb39a865392c9e7
I20260928 10:44:23.441304 6269 ts_tablet_manager.cc:1939] T cc2990e37a9648669eb39a865392c9e7 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:23.432386 6271 raft_consensus.cc:348] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.441896 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b3197981b769443e845cda268a219ac6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.442070 6271 raft_consensus.cc:374] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.442139 6271 raft_consensus.cc:729] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
W20260928 10:44:23.442437 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3197981b769443e845cda268a219ac6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.442586 6271 consensus_queue.cc:260] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.443423 6271 ts_tablet_manager.cc:1428] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260928 10:44:23.443519 6273 tablet_bootstrap.cc:492] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.443637 6273 ts_tablet_manager.cc:1397] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260928 10:44:23.443672 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2deeaf0a2af646009edec76f39b81a1e" } modify_external_catalogs: true
I20260928 10:44:23.443856 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_2deeaf0a2af646009edec76f39b81a1e" } modify_external_catalogs: true
I20260928 10:44:23.444347 6273 raft_consensus.cc:348] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.444540 6273 raft_consensus.cc:374] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.444586 6273 raft_consensus.cc:729] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.444572 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a9bd4910ac124e6b935806ea96522396" } new_table_name: "default.Table_1d74515d96c4497c8b5766c83f92fa06" modify_external_catalogs: true
I20260928 10:44:23.444641 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d02af101f64d46a8ae074ddfb8d45afa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.444768 6273 consensus_queue.cc:260] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.445149 6271 tablet_bootstrap.cc:492] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
W20260928 10:44:23.445132 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d02af101f64d46a8ae074ddfb8d45afa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.446339 5696 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:23.446568 6271 tablet_bootstrap.cc:654] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.450435 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_e51c54bdc7ea467491d09018c4ea3e3c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]). Expected version 3 got 0
I20260928 10:44:23.451632 5697 catalog_manager.cc:5495] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:23.452064 5697 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:23.453545 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_86c20c02744a4c969787c39d93471ee7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.454090 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86c20c02744a4c969787c39d93471ee7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.453552 5701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_87665cb7b0024a158f2d2ae70a096c5e" } modify_external_catalogs: true
I20260928 10:44:23.455294 5701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_87665cb7b0024a158f2d2ae70a096c5e" } modify_external_catalogs: true
I20260928 10:44:23.401044 6270 ts_tablet_manager.cc:1918] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:23.456928 6270 log.cc:1196] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/15f3f3bff84a416494431a19887bb88d
I20260928 10:44:23.457345 6270 ts_tablet_manager.cc:1939] T 15f3f3bff84a416494431a19887bb88d P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.458988 7937 raft_consensus.cc:482] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.459132 7937 raft_consensus.cc:504] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.459343 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 975) took 8662 ms. Trace:
I20260928 10:44:23.459439 6269 rpcz_store.cc:276] 0928 10:44:14.797219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.797278 (+ 59us) service_pool.cc:227] Handling call
0928 10:44:23.190933 (+8393655us) ts_tablet_manager.cc:1145] Deleting tablet cc2990e37a9648669eb39a865392c9e7
0928 10:44:23.190942 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.411500 (+220558us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.440744 (+ 29244us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.459319 (+ 18575us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8393452}
I20260928 10:44:23.459735 7937 leader_election.cc:288] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.459836 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 976) took 8624 ms. Trace:
I20260928 10:44:23.459903 6269 rpcz_store.cc:276] 0928 10:44:14.835643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:14.835705 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:23.459718 (+8624013us) ts_tablet_manager.cc:1145] Deleting tablet 35345a76883045afadd5922c11de910d
0928 10:44:23.459729 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.459822 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8623776}
I20260928 10:44:23.460201 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 977) took 8282 ms. Trace:
I20260928 10:44:23.460275 6269 rpcz_store.cc:276] 0928 10:44:15.178041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.178538 (+ 497us) service_pool.cc:227] Handling call
0928 10:44:23.460104 (+8281566us) ts_tablet_manager.cc:1145] Deleting tablet 791e310f4af14569aca647cca4cf9dc3
0928 10:44:23.460112 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.460187 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8281389}
I20260928 10:44:23.460559 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 978) took 8256 ms. Trace:
I20260928 10:44:23.460631 6269 rpcz_store.cc:276] 0928 10:44:15.204428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.204490 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:23.460465 (+8255975us) ts_tablet_manager.cc:1145] Deleting tablet 850693fd00274d98ab347eb40ae76b85
0928 10:44:23.460472 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.460546 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8255785}
I20260928 10:44:23.460866 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 980) took 8224 ms. Trace:
I20260928 10:44:23.460914 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.460922 6269 rpcz_store.cc:276] 0928 10:44:15.236283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.236339 (+ 56us) service_pool.cc:227] Handling call
0928 10:44:23.460792 (+8224453us) ts_tablet_manager.cc:1145] Deleting tablet cada7237dcb649188254449bd5fc3136
0928 10:44:23.460801 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.460856 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8224251}
I20260928 10:44:23.461167 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 979) took 8225 ms. Trace:
I20260928 10:44:23.461222 6269 rpcz_store.cc:276] 0928 10:44:15.236126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.236598 (+ 472us) service_pool.cc:227] Handling call
0928 10:44:23.461080 (+8224482us) ts_tablet_manager.cc:1145] Deleting tablet e8e3d92709bb4893973e5d24736bafcf
0928 10:44:23.461088 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.461155 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8224346}
I20260928 10:44:23.461409 6269 tablet_replica.cc:330] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:23.461601 6269 raft_consensus.cc:2229] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.461753 6269 raft_consensus.cc:2258] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.461707 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.462163 5955 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.462270 6269 ts_tablet_manager.cc:1905] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:23.463637 5957 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 54331.6us
I20260928 10:44:23.464293 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet cc2990e37a9648669eb39a865392c9e7 (table default.Table_63fc7a3742ea42e28b3a0bb25584c00f [id=64216505cc384325a82a0907c922af93]) successfully deleted
I20260928 10:44:23.464418 5957 leader_election.cc:302] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.464551 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 35345a76883045afadd5922c11de910d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35345a76883045afadd5922c11de910d already in progress: creating tablet
I20260928 10:44:23.464629 7998 raft_consensus.cc:2781] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.464715 7998 raft_consensus.cc:686] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
W20260928 10:44:23.464716 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 791e310f4af14569aca647cca4cf9dc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 791e310f4af14569aca647cca4cf9dc3 already in progress: creating tablet
W20260928 10:44:23.464861 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 850693fd00274d98ab347eb40ae76b85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 850693fd00274d98ab347eb40ae76b85 already in progress: creating tablet
W20260928 10:44:23.465003 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet cada7237dcb649188254449bd5fc3136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cada7237dcb649188254449bd5fc3136 already in progress: creating tablet
I20260928 10:44:23.464906 7998 consensus_queue.cc:237] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:23.465175 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet e8e3d92709bb4893973e5d24736bafcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8e3d92709bb4893973e5d24736bafcf already in progress: creating tablet
I20260928 10:44:23.470384 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b0bc94471ad4608af7a85f27b60af68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.470834 6273 ts_tablet_manager.cc:1428] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260928 10:44:23.471309 6273 tablet_bootstrap.cc:492] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:23.471596 5957 leader_election.cc:302] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.472666 7934 raft_consensus.cc:2781] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.472781 7934 raft_consensus.cc:686] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.472982 7934 consensus_queue.cc:237] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.475541 6269 ts_tablet_manager.cc:1918] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.480959 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.481153 6015 raft_consensus.cc:2454] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:23.481599 6090 leader_election.cc:302] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:23.481889 7875 raft_consensus.cc:2781] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.481959 7875 raft_consensus.cc:482] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.482017 7875 raft_consensus.cc:3037] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.480455 5818 leader_election.cc:302] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.483508 5818 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.483625 5818 raft_consensus.cc:2670] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 10:44:23.483793 5818 leader_election.cc:341] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.483868 5818 leader_election.cc:302] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.484099 5818 leader_election.cc:341] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.484165 5818 leader_election.cc:302] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.484442 7875 raft_consensus.cc:504] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.484900 7955 raft_consensus.cc:2781] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.484998 7955 raft_consensus.cc:482] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.485055 7955 raft_consensus.cc:3037] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.485239 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.485438 5883 raft_consensus.cc:2454] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.485616 7875 leader_election.cc:288] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.485805 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet c1a659100a124506a411c929ddc31f10 with delete_type TABLET_DATA_DELETED (replaced by tablet b4bea8f5535c4833bdbb841d42706b78) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.486004 7557 tablet_replica.cc:330] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:23.486192 7557 raft_consensus.cc:2229] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.486315 7557 raft_consensus.cc:2258] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.487394 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a659100a124506a411c929ddc31f10" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.487557 6015 raft_consensus.cc:3037] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.487620 7955 raft_consensus.cc:504] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.488106 7955 leader_election.cc:288] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.488221 7955 raft_consensus.cc:2726] T e03f686afffc4d47b5e27fdbc8eb8f75 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.488337 7955 raft_consensus.cc:2726] T 20ea1325da4e460da08377f5d6d6a055 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.488534 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.488682 5875 raft_consensus.cc:2454] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.489326 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f47338950743eb8a06e779a3ca5c69" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.489462 5870 raft_consensus.cc:3037] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.489997 6015 raft_consensus.cc:2454] T c1a659100a124506a411c929ddc31f10 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:23.491055 6090 leader_election.cc:302] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
W20260928 10:44:23.491232 6090 raft_consensus.cc:2670] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 10:44:23.491830 5870 raft_consensus.cc:2454] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.491861 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1155) took 3945 ms. Trace:
I20260928 10:44:23.491941 6270 rpcz_store.cc:276] 0928 10:44:19.546820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.546948 (+ 128us) service_pool.cc:227] Handling call
0928 10:44:23.393736 (+3846788us) ts_tablet_manager.cc:1145] Deleting tablet 15f3f3bff84a416494431a19887bb88d
0928 10:44:23.394130 (+ 394us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.398054 (+ 3924us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.400939 (+ 2885us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.491842 (+ 90903us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3846598}
I20260928 10:44:23.492355 6270 tablet_replica.cc:330] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.492534 6270 raft_consensus.cc:2229] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.492501 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.492826 6270 raft_consensus.cc:2258] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:23.493012 5817 leader_election.cc:341] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.493431 6270 ts_tablet_manager.cc:1905] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.494124 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.494192 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb1f2e6392b4329b5520d0e292d6f98" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.494277 5878 raft_consensus.cc:3037] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.494340 5872 raft_consensus.cc:3037] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.496788 5878 raft_consensus.cc:2454] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.496877 5872 raft_consensus.cc:2454] T adb1f2e6392b4329b5520d0e292d6f98 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.498615 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 15f3f3bff84a416494431a19887bb88d (table default.Table_da453b1c08bf4157826d53f8fc65d2e5 [id=2f40e27c6a0243a1837cd6c3c657d8a8]) successfully deleted
I20260928 10:44:23.501071 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.501278 5870 raft_consensus.cc:2454] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.501891 7557 ts_tablet_manager.cc:1905] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.502140 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.502328 5869 raft_consensus.cc:2454] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.502782 6275 tablet_bootstrap.cc:492] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.502909 6275 ts_tablet_manager.cc:1397] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.088s user 0.006s sys 0.005s
W20260928 10:44:23.503233 6091 leader_election.cc:341] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: c1a659100a124506a411c929ddc31f10
I20260928 10:44:23.503675 6275 raft_consensus.cc:348] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.503873 6275 raft_consensus.cc:374] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.503926 6275 raft_consensus.cc:729] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
W20260928 10:44:23.506512 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66a627fbfd6e430683680ab6e4f1a5ba consensus state has no leader
I20260928 10:44:23.506402 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.506635 6015 raft_consensus.cc:3037] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.509231 6015 raft_consensus.cc:2454] T 58c0af95fa58451490947176ec9301e3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:23.510054 6275 consensus_queue.cc:260] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.515573 6275 ts_tablet_manager.cc:1428] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20260928 10:44:23.516352 5957 consensus_peers.cc:487] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a908ac5d44a74c05b35f6853ab769d91. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.516541 5957 leader_election.cc:302] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.517210 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet daf7a87b82424e25ae47d3f61c2ddb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:12 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:23.518322 5818 consensus_peers.cc:487] T 15f3f3bff84a416494431a19887bb88d P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Couldn't send request to peer 2f6ffbf4f0534383bf89d15aa37e3027. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15f3f3bff84a416494431a19887bb88d. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.520560 6275 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.521093 7934 raft_consensus.cc:2781] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.522547 5702 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_907e249ad2304307ba1c28c98b92fbe9" } new_table_name: "default.Table_59a9be87b5784259aaf6ad3f87ccd75c" modify_external_catalogs: true
I20260928 10:44:23.522665 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d4d5233b49dc4cc7b595c2303f40426d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.522899 7934 raft_consensus.cc:482] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.523011 7934 raft_consensus.cc:3037] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:23.523247 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4d5233b49dc4cc7b595c2303f40426d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.525388 5818 leader_election.cc:302] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.525733 7954 raft_consensus.cc:2781] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.525830 7954 raft_consensus.cc:686] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:23.525941 7934 raft_consensus.cc:504] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.526033 7954 consensus_queue.cc:237] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.527129 5957 leader_election.cc:302] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.527156 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.527946 5955 leader_election.cc:341] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.528705 7934 leader_election.cc:288] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:23.529304 7998 raft_consensus.cc:2781] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.529385 7998 raft_consensus.cc:482] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.529443 7998 raft_consensus.cc:3037] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.532487 7998 raft_consensus.cc:504] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.533169 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e149cdb22cc4c60b012c2d87868827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.533325 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c0af95fa58451490947176ec9301e3 with delete_type TABLET_DATA_DELETED (replaced by tablet b5be4edbfc11495b972a8ca68be46d38) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.533792 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a8098440fb4e919bc5e3f4dd3241a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.533864 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a9fb31988e4447f9c4a694056d6e54f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.534642 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2d7b55c1a9bd4f21948bffc6f81d9213"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.535132 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d7b55c1a9bd4f21948bffc6f81d9213 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.536303 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_2c99db41386445eea2e6eb8acda300ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.536784 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c99db41386445eea2e6eb8acda300ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.538730 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.539959 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
W20260928 10:44:23.540380 5955 leader_election.cc:341] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.534328 5957 leader_election.cc:302] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.541934 6270 ts_tablet_manager.cc:1918] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.543785 6275 tablet_bootstrap.cc:654] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:23.542258 5957 consensus_peers.cc:487] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc2990e37a9648669eb39a865392c9e7. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.533804 7998 leader_election.cc:288] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.542601 7934 raft_consensus.cc:2781] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.545709 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 9319d4d4102e43b19c0caa0b0a4b4740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.550400 5957 leader_election.cc:302] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.550788 7937 raft_consensus.cc:2781] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.550915 7937 raft_consensus.cc:686] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.550963 5957 leader_election.cc:302] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.551144 7937 consensus_queue.cc:237] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.551318 7936 raft_consensus.cc:2781] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.551426 7936 raft_consensus.cc:686] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.551649 7936 consensus_queue.cc:237] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.557176 5696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bd415a38e4344ac0a4f2bfb479d01b58" } modify_external_catalogs: true
I20260928 10:44:23.557440 5696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_bd415a38e4344ac0a4f2bfb479d01b58" } modify_external_catalogs: true
I20260928 10:44:23.558295 7934 raft_consensus.cc:686] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.558634 7934 consensus_queue.cc:237] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.480778 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet ff01c1c1ed72488791827c5aa57f1de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.483153 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 493b1d0e0b884fdfbaa3eb6d55874f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.563279 5701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 5a78458ef1bd44c5acb9ae98f123089f
I20260928 10:44:23.564363 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:23.564339 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:23.564597 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a78458ef1bd44c5acb9ae98f123089f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.565290 6269 log.cc:1196] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/6037e24ee6ba4399b6100ab27c4ed621
I20260928 10:44:23.565712 6269 ts_tablet_manager.cc:1939] T 6037e24ee6ba4399b6100ab27c4ed621 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:23.560528 5957 leader_election.cc:302] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.560691 7998 consensus_queue.cc:1035] T 37669fbe13614892a9b8cc2df4e10b4a P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:23.566458 7998 raft_consensus.cc:2781] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.566630 7998 raft_consensus.cc:482] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.566617 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 981) took 8128 ms. Trace:
I20260928 10:44:23.566764 7998 raft_consensus.cc:3037] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.566692 6269 rpcz_store.cc:276] 0928 10:44:15.438052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.438231 (+ 179us) service_pool.cc:227] Handling call
0928 10:44:23.461377 (+8023146us) ts_tablet_manager.cc:1145] Deleting tablet 6037e24ee6ba4399b6100ab27c4ed621
0928 10:44:23.461384 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.468807 (+ 7423us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.475436 (+ 6629us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.566594 (+ 91158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8022944}
I20260928 10:44:23.567445 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 991) took 7591 ms. Trace:
I20260928 10:44:23.567582 6269 rpcz_store.cc:276] 0928 10:44:15.975572 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:15.975629 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:23.567321 (+7591692us) ts_tablet_manager.cc:1145] Deleting tablet 50d66d697f2740a98138a08fc6ef9b60
0928 10:44:23.567332 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.567429 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7591382}
W20260928 10:44:23.568029 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 50d66d697f2740a98138a08fc6ef9b60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50d66d697f2740a98138a08fc6ef9b60 already in progress: creating tablet
I20260928 10:44:23.568413 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 994) took 7560 ms. Trace:
I20260928 10:44:23.568565 6269 rpcz_store.cc:276] 0928 10:44:16.008395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.024134 (+ 15739us) service_pool.cc:227] Handling call
0928 10:44:23.568307 (+7544173us) ts_tablet_manager.cc:1145] Deleting tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19
0928 10:44:23.568318 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.568396 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7541622}
W20260928 10:44:23.568962 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e4a9dfa9e7a4201bb7c86b540a9aa19 already in progress: creating tablet
I20260928 10:44:23.569367 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 995) took 7534 ms. Trace:
I20260928 10:44:23.569489 6269 rpcz_store.cc:276] 0928 10:44:16.035406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.037981 (+ 2575us) service_pool.cc:227] Handling call
0928 10:44:23.569224 (+7531243us) ts_tablet_manager.cc:1145] Deleting tablet 6026e5e88aba49ef8dbe476f7a0bb0f9
0928 10:44:23.569234 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.569351 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7530973}
I20260928 10:44:23.569551 7998 raft_consensus.cc:504] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:23.569913 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6026e5e88aba49ef8dbe476f7a0bb0f9 already in progress: creating tablet
I20260928 10:44:23.570469 6269 tablet_replica.cc:330] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:23.571134 6269 raft_consensus.cc:2229] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.574115 6275 tablet_bootstrap.cc:492] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.574303 6275 ts_tablet_manager.cc:1397] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.003s
I20260928 10:44:23.575034 6275 raft_consensus.cc:348] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.575281 6275 raft_consensus.cc:374] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.575367 6275 raft_consensus.cc:729] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.575628 6275 consensus_queue.cc:260] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.576012 7557 ts_tablet_manager.cc:1918] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.576164 7557 log.cc:1196] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/c1a659100a124506a411c929ddc31f10
I20260928 10:44:23.576550 7557 ts_tablet_manager.cc:1939] T c1a659100a124506a411c929ddc31f10 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:23.578584 7557 tablet_replica.cc:330] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:23.578806 7557 raft_consensus.cc:2229] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.578994 7557 raft_consensus.cc:2258] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.581279 7557 ts_tablet_manager.cc:1905] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.582240 6269 raft_consensus.cc:2258] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.582650 6275 ts_tablet_manager.cc:1428] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260928 10:44:23.583228 6269 ts_tablet_manager.cc:1905] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.585371 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet c1a659100a124506a411c929ddc31f10 (table default.Table_1acc77c2d6914c87a340fe67568a2d53 [id=1ab19896272247a6a5b8ba9d9ee8b463]) successfully deleted
I20260928 10:44:23.587011 6275 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.571942 6273 tablet_bootstrap.cc:654] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.572311 8038 tablet.cc:1722] T 49c40696fe8645de9b639d2293f41403 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:23.594259 5700 master_service.cc:946] ReplaceTablet: received request to replace tablet 741ca8fa10bb47efbd5d6a95d30f1987 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:23.594396 5694 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3b2cabf659dc48028605b39c92e1e451 (table default.Table_8efd871139c84e1fadace980a7742a81 [id=3daf4c7bcf784fb0948e743ecec939ed]). Expected version 2 got 0
I20260928 10:44:23.595858 6275 tablet_bootstrap.cc:654] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.596091 6273 tablet_bootstrap.cc:492] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.596138 7998 leader_election.cc:288] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.596233 6273 ts_tablet_manager.cc:1397] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.125s user 0.003s sys 0.000s
I20260928 10:44:23.566422 5957 leader_election.cc:302] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:23.570650 5955 consensus_peers.cc:487] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.570849 7937 raft_consensus.cc:482] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.596590 7937 raft_consensus.cc:504] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.597285 7937 leader_election.cc:288] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.597254 6273 raft_consensus.cc:348] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.597468 6273 raft_consensus.cc:374] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.597549 6273 raft_consensus.cc:729] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.598222 7937 raft_consensus.cc:2781] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.598348 7937 raft_consensus.cc:482] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.598462 7937 raft_consensus.cc:3037] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.598068 6273 consensus_queue.cc:260] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.601532 7937 raft_consensus.cc:504] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.602002 5694 catalog_manager.cc:5495] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:23.602996 7937 leader_election.cc:288] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.602463 5694 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:23.603969 6273 ts_tablet_manager.cc:1428] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 10:44:23.597828 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.602970 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.605172 7954 raft_consensus.cc:482] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.605333 7954 raft_consensus.cc:504] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:23.605573 5955 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:23.605923 5955 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.605955 7954 leader_election.cc:288] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.606762 8049 tablet.cc:1722] T 2f714f8d6e0d49ab885760bf4f2aa37a P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:23.609232 7894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2eb817eda984ab99ec4704c47699846" member_type: VOTER last_known_addr { host: "127.5.100.126" port: 39997 } } peers { permanent_uuid: "7a1529a7b0d7479db7dabebf471795b5" member_type: VOTER last_known_addr { host: "127.5.100.125" port: 37939 } } peers { permanent_uuid: "0ef695111ecc46a1bc1439b0b1a282bf" member_type: VOTER last_known_addr { host: "127.5.100.124" port: 42487 } } }
I20260928 10:44:23.609522 7894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf [sys.catalog]: This master's current role is: LEADER
I20260928 10:44:23.610198 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.610781 5702 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d02efab7a47400f8e50d41fb488983d consensus state has no leader
W20260928 10:44:23.610899 5955 leader_election.cc:341] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.612106 7954 raft_consensus.cc:482] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.612262 7954 raft_consensus.cc:504] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.612843 7954 leader_election.cc:288] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:23.613272 5688 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a87dd8e89c394e4f96c9d8c5fed17e66 (table default.Table_754e5b120bc34241bc3b78aa28f0b8e4 [id=48d4915dc56c4952ac72c64671c05943], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a87dd8e89c394e4f96c9d8c5fed17e66 consensus state has no leader
I20260928 10:44:23.614554 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493b1d0e0b884fdfbaa3eb6d55874f2e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.614634 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cffc63bccf448a7a59e311640567e4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.615762 7954 raft_consensus.cc:482] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:23.615986 5955 consensus_peers.cc:487] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc7aa301bfbb4097b386a0d23cfa91e1. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.615903 7954 raft_consensus.cc:504] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.616533 7954 leader_election.cc:288] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:23.617225 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.618060 6275 tablet_bootstrap.cc:492] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
W20260928 10:44:23.618312 5817 leader_election.cc:341] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.618649 5702 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 5afe4501ea584d44b511b89983e210e3 (table default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73]). Expected version 1 got 0
I20260928 10:44:23.619740 5702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60ab33f1717f464f874105a5289f8a41" } modify_external_catalogs: true
I20260928 10:44:23.620008 5702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_60ab33f1717f464f874105a5289f8a41" } modify_external_catalogs: true
I20260928 10:44:23.620435 6275 ts_tablet_manager.cc:1397] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.004s
I20260928 10:44:23.623188 6275 raft_consensus.cc:348] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.624282 6275 raft_consensus.cc:374] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.550176 6270 log.cc:1196] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/8a3443d4c6674342b4124156414dcc13
I20260928 10:44:23.624425 6275 raft_consensus.cc:729] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.620136 7557 ts_tablet_manager.cc:1918] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.624925 7557 log.cc:1196] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/daf7a87b82424e25ae47d3f61c2ddb7f
I20260928 10:44:23.625100 6270 ts_tablet_manager.cc:1939] T 8a3443d4c6674342b4124156414dcc13 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.625334 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78295825061a4d75984e2d6e110e1c55" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.625538 5883 raft_consensus.cc:3037] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.626025 8047 tablet.cc:1722] T 3b2cabf659dc48028605b39c92e1e451 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:23.626293 5874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.626515 5874 raft_consensus.cc:2454] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.627070 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.627220 5872 raft_consensus.cc:3037] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.628688 5883 raft_consensus.cc:2454] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.629710 5872 raft_consensus.cc:2454] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.630311 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a8098440fb4e919bc5e3f4dd3241a7" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.630571 5869 raft_consensus.cc:3037] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.630767 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1156) took 4083 ms. Trace:
I20260928 10:44:23.631534 7557 ts_tablet_manager.cc:1939] T daf7a87b82424e25ae47d3f61c2ddb7f P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:23.633109 5869 raft_consensus.cc:2454] T 45a8098440fb4e919bc5e3f4dd3241a7 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.634733 6270 rpcz_store.cc:276] 0928 10:44:19.546904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.547187 (+ 283us) service_pool.cc:227] Handling call
0928 10:44:23.492309 (+3945122us) ts_tablet_manager.cc:1145] Deleting tablet 8a3443d4c6674342b4124156414dcc13
0928 10:44:23.492321 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.496356 (+ 4035us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.541828 (+ 45472us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.630739 (+ 88911us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3944988}
I20260928 10:44:23.624676 6275 consensus_queue.cc:260] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.635305 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 8a3443d4c6674342b4124156414dcc13 (table default.Table_a303983e2e7f444886ff5e22fc9b1abf [id=dd1db321d8a94e5ba4816dd0eb0af5a4]) successfully deleted
I20260928 10:44:23.634202 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493b1d0e0b884fdfbaa3eb6d55874f2e" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.635305 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet daf7a87b82424e25ae47d3f61c2ddb7f (table default.Table_22e1516105d24daaa1e7b491ce777916 [id=2ac5e881f6e94b97a08cc5e7da381a41]) successfully deleted
I20260928 10:44:23.637234 6275 ts_tablet_manager.cc:1428] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 10:44:23.638342 6275 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:23.639009 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 5a78458ef1bd44c5acb9ae98f123089f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a78458ef1bd44c5acb9ae98f123089f already in progress: creating tablet
I20260928 10:44:23.641034 6275 tablet_bootstrap.cc:654] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.633399 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
W20260928 10:44:23.635921 5817 leader_election.cc:341] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.643874 5875 raft_consensus.cc:3037] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.638144 7954 raft_consensus.cc:482] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.644212 7954 raft_consensus.cc:504] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.645361 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.645958 5817 leader_election.cc:341] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.646456 7954 leader_election.cc:288] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.646699 5875 raft_consensus.cc:2454] T 30fb3f88e66b4f8582fb348e035af290 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:23.646894 5818 leader_election.cc:341] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.647089 5818 leader_election.cc:302] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.640197 6273 tablet_bootstrap.cc:492] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:23.648535 5955 consensus_peers.cc:487] T cc2990e37a9648669eb39a865392c9e7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.648906 7954 raft_consensus.cc:2726] T 493b1d0e0b884fdfbaa3eb6d55874f2e P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:23.649331 5818 leader_election.cc:341] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.652104 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cffc63bccf448a7a59e311640567e4a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.652544 8038 tablet.cc:1722] T 3b2cabf659dc48028605b39c92e1e451 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:23.652827 6273 tablet_bootstrap.cc:654] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:23.655099 5817 leader_election.cc:341] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.655212 5817 leader_election.cc:302] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.655606 7954 raft_consensus.cc:2726] T 0cffc63bccf448a7a59e311640567e4a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.656324 5957 leader_election.cc:302] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.658838 6275 tablet_bootstrap.cc:492] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.659170 7874 raft_consensus.cc:2781] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.659253 7874 raft_consensus.cc:482] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.659313 7874 raft_consensus.cc:3037] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.659629 5957 leader_election.cc:302] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.661831 7874 raft_consensus.cc:504] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.663295 7874 leader_election.cc:288] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.659060 6275 ts_tablet_manager.cc:1397] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.004s
I20260928 10:44:23.664243 6275 raft_consensus.cc:348] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.664537 6275 raft_consensus.cc:374] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.664635 6275 raft_consensus.cc:729] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.667923 7996 raft_consensus.cc:2781] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.669066 6273 tablet_bootstrap.cc:492] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.669234 7998 consensus_queue.cc:1035] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:23.669509 7996 raft_consensus.cc:686] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.669735 7996 consensus_queue.cc:237] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.664921 6275 consensus_queue.cc:260] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.672158 6275 ts_tablet_manager.cc:1428] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260928 10:44:23.673174 6275 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.674998 6275 tablet_bootstrap.cc:654] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.676067 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.676615 5955 leader_election.cc:341] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.676831 5957 leader_election.cc:302] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.677211 7998 raft_consensus.cc:2781] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.677317 7998 raft_consensus.cc:686] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.677526 7998 consensus_queue.cc:237] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.684176 6273 ts_tablet_manager.cc:1397] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.000s
I20260928 10:44:23.685299 5957 leader_election.cc:302] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.685544 7998 raft_consensus.cc:2781] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.685650 7998 raft_consensus.cc:686] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.685925 7998 consensus_queue.cc:237] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:23.603540 8048 tablet.cc:1722] T 2f714f8d6e0d49ab885760bf4f2aa37a P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:23.688136 5957 leader_election.cc:302] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.688705 6273 raft_consensus.cc:348] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.688915 6273 raft_consensus.cc:374] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.688967 6273 raft_consensus.cc:729] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.689173 7996 raft_consensus.cc:2781] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.689288 7996 raft_consensus.cc:686] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.689502 7996 consensus_queue.cc:237] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.691542 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 3b2cabf659dc48028605b39c92e1e451 (table default.Table_8efd871139c84e1fadace980a7742a81 [id=3daf4c7bcf784fb0948e743ecec939ed]). Expected version 2 got 0
I20260928 10:44:23.691745 5699 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:23.693027 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 527e00f713214484bfc19ab96044a1be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:23.693331 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d9c155961e06410eae6973422e546180"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.693908 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9c155961e06410eae6973422e546180 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.696532 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a2df4c84bb2e4b3095ad3099ac5093bf" } new_table_name: "default.Table_6baa4ad3b72c4c5d8ee6676b5f2e81e7" modify_external_catalogs: true
I20260928 10:44:23.697023 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.697233 6021 raft_consensus.cc:2454] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:23.699898 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.700187 6021 raft_consensus.cc:2454] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 0.
I20260928 10:44:23.696583 6273 consensus_queue.cc:260] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.702250 5870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:23.702462 5870 raft_consensus.cc:3037] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.702608 6275 tablet_bootstrap.cc:492] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.702840 6275 ts_tablet_manager.cc:1397] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260928 10:44:23.703617 6275 raft_consensus.cc:348] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.704360 6275 raft_consensus.cc:374] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.704466 6275 raft_consensus.cc:729] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.704737 6275 consensus_queue.cc:260] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.705278 5870 raft_consensus.cc:2454] T ee0b7f3bd78a49368abc13ab9e171880 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:23.706619 6275 ts_tablet_manager.cc:1428] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 10:44:23.707538 5818 leader_election.cc:302] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.707777 7954 raft_consensus.cc:2781] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.707837 7954 raft_consensus.cc:482] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.707887 7954 raft_consensus.cc:3037] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.707968 6275 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.710726 7954 raft_consensus.cc:504] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.711666 7954 leader_election.cc:288] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:23.711968 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.712049 5818 leader_election.cc:302] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.712255 7954 raft_consensus.cc:2781] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.712358 7954 raft_consensus.cc:482] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.712394 6275 tablet_bootstrap.cc:654] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.712517 7954 raft_consensus.cc:3037] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:23.712555 5817 leader_election.cc:341] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.715319 7954 raft_consensus.cc:504] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.716370 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:23.716884 5817 leader_election.cc:341] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.717221 7954 leader_election.cc:288] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.719050 6275 tablet_bootstrap.cc:492] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.719287 6275 ts_tablet_manager.cc:1397] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 10:44:23.719633 6270 tablet_replica.cc:330] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.719897 6270 raft_consensus.cc:2229] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.720016 6275 raft_consensus.cc:348] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.720305 6275 raft_consensus.cc:374] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.720360 6275 raft_consensus.cc:729] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.720573 6275 consensus_queue.cc:260] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.719934 6271 tablet_bootstrap.cc:492] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.721509 6271 ts_tablet_manager.cc:1397] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.276s user 0.000s sys 0.017s
I20260928 10:44:23.722605 6275 ts_tablet_manager.cc:1428] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:23.723177 6273 ts_tablet_manager.cc:1428] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260928 10:44:23.723276 5521 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
/tmp/dist-test-taskDDK3xd/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.100.126:39997
--webserver_interface=127.5.100.126
--webserver_port=38451
--builtin_ntp_servers=127.5.100.84:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.100.126:39997,127.5.100.125:37939,127.5.100.124:42487
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 10:44:23.723484 6273 tablet_bootstrap.cc:492] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:23.725024 6273 tablet_bootstrap.cc:654] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.726765 8038 tablet.cc:1722] T 2f714f8d6e0d49ab885760bf4f2aa37a P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:23.728196 6270 pending_rounds.cc:62] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:23.728317 6270 pending_rounds.cc:68] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265889015189504 op_type: NO_OP noop_request { }
I20260928 10:44:23.728513 6270 raft_consensus.cc:2866] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:23.728659 6270 raft_consensus.cc:2258] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.729269 6270 ts_tablet_manager.cc:1905] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.730515 6271 raft_consensus.cc:348] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.730743 6275 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.731252 6271 raft_consensus.cc:374] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.731464 6271 raft_consensus.cc:729] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.732363 6275 tablet_bootstrap.cc:654] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.732735 6271 consensus_queue.cc:260] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.741780 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9319d4d4102e43b19c0caa0b0a4b4740" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.750509 6021 raft_consensus.cc:3037] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.751112 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:23.753209 6021 raft_consensus.cc:2454] T 9319d4d4102e43b19c0caa0b0a4b4740 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:23.754040 6271 ts_tablet_manager.cc:1428] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260928 10:44:23.754416 6271 tablet_bootstrap.cc:492] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:23.756139 6271 tablet_bootstrap.cc:654] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.759598 7954 raft_consensus.cc:482] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.759822 7954 raft_consensus.cc:504] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.760900 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f13643dbb64dcf97c4d6d94c22d8b1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.761559 5817 leader_election.cc:341] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.761893 7954 leader_election.cc:288] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.765906 7954 raft_consensus.cc:482] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.766122 7954 raft_consensus.cc:504] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.767190 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "527e00f713214484bfc19ab96044a1be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.767863 5817 leader_election.cc:341] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.768141 7954 leader_election.cc:288] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.768898 6269 ts_tablet_manager.cc:1918] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.769445 6269 log.cc:1196] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/76a47129ab5444dcab0a3f92a16046db
I20260928 10:44:23.771920 6269 ts_tablet_manager.cc:1939] T 76a47129ab5444dcab0a3f92a16046db P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:23.770455 6273 tablet_bootstrap.cc:492] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:23.772696 6273 ts_tablet_manager.cc:1397] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260928 10:44:23.772934 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_145c1731edea4384886c28efb4d427b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.773685 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_145c1731edea4384886c28efb4d427b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.773885 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1001) took 7703 ms. Trace:
I20260928 10:44:23.774015 6269 rpcz_store.cc:276] 0928 10:44:16.070274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.070544 (+ 270us) service_pool.cc:227] Handling call
0928 10:44:23.570433 (+7499889us) ts_tablet_manager.cc:1145] Deleting tablet 76a47129ab5444dcab0a3f92a16046db
0928 10:44:23.570441 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.588606 (+ 18165us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.768781 (+180175us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.773865 (+ 5084us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7499575}
I20260928 10:44:23.757534 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.774336 6015 raft_consensus.cc:3037] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.757637 5957 leader_election.cc:302] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.774890 7996 raft_consensus.cc:2781] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.774996 7996 raft_consensus.cc:686] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:23.775194 7996 consensus_queue.cc:237] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.777927 6152 raft_consensus.cc:3037] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.779088 6015 raft_consensus.cc:2454] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab770e77cb704ea38b5ca8cff97dc73b in term 1.
I20260928 10:44:23.783452 6270 ts_tablet_manager.cc:1918] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.783568 6270 log.cc:1196] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/490f8a4f1f9245cfab168b96511e18de
I20260928 10:44:23.783910 6270 ts_tablet_manager.cc:1939] T 490f8a4f1f9245cfab168b96511e18de P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.784631 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1157) took 4235 ms. Trace:
I20260928 10:44:23.784708 6270 rpcz_store.cc:276] 0928 10:44:19.549447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.549563 (+ 116us) service_pool.cc:227] Handling call
0928 10:44:23.719580 (+4170017us) ts_tablet_manager.cc:1145] Deleting tablet 490f8a4f1f9245cfab168b96511e18de
0928 10:44:23.719592 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.748003 (+ 28411us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.783342 (+ 35339us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.784613 (+ 1271us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7840,"tablet-delete.queue_time_us":4169817}
I20260928 10:44:23.785017 6270 tablet_replica.cc:330] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.785151 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 490f8a4f1f9245cfab168b96511e18de (table default.Table_61d563e1c8cb41f08ec6e49b87e45b1f [id=66815ece5f8e48179b5dd19b46885eba]) successfully deleted
I20260928 10:44:23.785221 6270 raft_consensus.cc:2229] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.785509 6270 raft_consensus.cc:2258] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.786036 6270 ts_tablet_manager.cc:1905] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:23.791682 5955 consensus_peers.cc:487] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.792589 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f13643dbb64dcf97c4d6d94c22d8b1" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.793305 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "527e00f713214484bfc19ab96044a1be" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.795924 6271 tablet_bootstrap.cc:492] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:23.781214 7955 consensus_queue.cc:1035] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:23.799256 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 775974ff84e2417fb9ed089f5aa4ca87 consensus state has no leader
I20260928 10:44:23.789847 5818 leader_election.cc:302] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.800711 7955 raft_consensus.cc:2781] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.800853 7955 raft_consensus.cc:686] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:23.801084 7955 consensus_queue.cc:237] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.808844 5818 leader_election.cc:302] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.811282 7958 raft_consensus.cc:2781] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:23.814632 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_da36fa7394844e8ea5977ef66e6879b2" } new_table_name: "default.Table_1088486fed864a11816007fdc573a176" modify_external_catalogs: true
I20260928 10:44:23.815346 7954 consensus_queue.cc:1035] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:23.822997 6153 raft_consensus.cc:3037] T 871fb70fea304b08bebce18c60998209 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:23.837182 5818 leader_election.cc:341] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.837463 5818 leader_election.cc:302] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.838610 7954 raft_consensus.cc:2726] T 66f13643dbb64dcf97c4d6d94c22d8b1 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.842180 6150 raft_consensus.cc:3037] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.850598 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 76a47129ab5444dcab0a3f92a16046db (table default.Table_5fad44d7253f493788268121109a5671 [id=dbafd5dfdf5a48d08dfce3d1f9ec79ee]) successfully deleted
I20260928 10:44:23.851385 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1000) took 7781 ms. Trace:
I20260928 10:44:23.851591 6269 rpcz_store.cc:276] 0928 10:44:16.070093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.070902 (+ 809us) service_pool.cc:227] Handling call
0928 10:44:23.851191 (+7780289us) ts_tablet_manager.cc:1145] Deleting tablet b40b1b2d2377425d8e0a78da3f1c43a8
0928 10:44:23.851208 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.851358 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7780056}
W20260928 10:44:23.852195 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b40b1b2d2377425d8e0a78da3f1c43a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40b1b2d2377425d8e0a78da3f1c43a8 already in progress: creating tablet
I20260928 10:44:23.852643 6269 tablet_replica.cc:330] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:23.852988 6269 raft_consensus.cc:2229] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.853370 6269 raft_consensus.cc:2258] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.854142 7875 raft_consensus.cc:482] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.854296 7875 raft_consensus.cc:504] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.854954 7875 leader_election.cc:288] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.857055 6143 raft_consensus.cc:3037] T a908ac5d44a74c05b35f6853ab769d91 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.862515 6275 tablet_bootstrap.cc:492] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:23.862660 6275 ts_tablet_manager.cc:1397] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.132s user 0.040s sys 0.030s
I20260928 10:44:23.863372 6275 raft_consensus.cc:348] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.863576 6275 raft_consensus.cc:374] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.863627 6275 raft_consensus.cc:729] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.863811 6275 consensus_queue.cc:260] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.773489 6273 raft_consensus.cc:348] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.805538 6270 ts_tablet_manager.cc:1918] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.856141 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.883783 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_86a12dcfc994445c92fa44e3eb8bfa0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:23.884030 6270 log.cc:1196] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/3abfedf425b84f679b22d6ca9bef718a
I20260928 10:44:23.884405 6270 ts_tablet_manager.cc:1939] T 3abfedf425b84f679b22d6ca9bef718a P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
W20260928 10:44:23.884389 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86a12dcfc994445c92fa44e3eb8bfa0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.884760 6271 ts_tablet_manager.cc:1397] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.130s user 0.002s sys 0.001s
I20260928 10:44:23.885113 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1158) took 4335 ms. Trace:
I20260928 10:44:23.885201 6270 rpcz_store.cc:276] 0928 10:44:19.549524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.549784 (+ 260us) service_pool.cc:227] Handling call
0928 10:44:23.784962 (+4235178us) ts_tablet_manager.cc:1145] Deleting tablet 3abfedf425b84f679b22d6ca9bef718a
0928 10:44:23.784985 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.801902 (+ 16917us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.805433 (+ 3531us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.885097 (+ 79664us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4235052}
I20260928 10:44:23.885566 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1161) took 4298 ms. Trace:
I20260928 10:44:23.885669 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 3abfedf425b84f679b22d6ca9bef718a (table default.Table_b6d141d94e74477ba22579aa9c058b06 [id=f4819cd0b1c64d98b6e26db508c4d4fd]) successfully deleted
I20260928 10:44:23.885645 6270 rpcz_store.cc:276] 0928 10:44:19.586957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.587019 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:23.885449 (+4298430us) ts_tablet_manager.cc:1145] Deleting tablet a61f862ae0da4763802ca3b28d5e2756
0928 10:44:23.885460 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.885551 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4298241}
I20260928 10:44:23.885942 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1162) took 4298 ms. Trace:
W20260928 10:44:23.886032 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a61f862ae0da4763802ca3b28d5e2756 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61f862ae0da4763802ca3b28d5e2756 already in progress: creating tablet
I20260928 10:44:23.886019 6270 rpcz_store.cc:276] 0928 10:44:19.587089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.587191 (+ 102us) service_pool.cc:227] Handling call
0928 10:44:23.885847 (+4298656us) ts_tablet_manager.cc:1145] Deleting tablet f4e984fec74147a8af24c4cf9dfa3284
0928 10:44:23.885857 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.885929 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4298456}
I20260928 10:44:23.886293 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1159) took 4299 ms. Trace:
W20260928 10:44:23.886353 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet f4e984fec74147a8af24c4cf9dfa3284 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e984fec74147a8af24c4cf9dfa3284 already in progress: creating tablet
I20260928 10:44:23.886358 6270 rpcz_store.cc:276] 0928 10:44:19.586653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.588324 (+ 1671us) service_pool.cc:227] Handling call
0928 10:44:23.886205 (+4297881us) ts_tablet_manager.cc:1145] Deleting tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b
0928 10:44:23.886214 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.886280 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4297619}
I20260928 10:44:23.886647 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1160) took 4299 ms. Trace:
I20260928 10:44:23.886713 6270 rpcz_store.cc:276] 0928 10:44:19.586763 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:19.588638 (+ 1875us) service_pool.cc:227] Handling call
0928 10:44:23.886565 (+4297927us) ts_tablet_manager.cc:1145] Deleting tablet 581f97bde63a48f0815b61e678890438
0928 10:44:23.886575 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.886635 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4297755}
W20260928 10:44:23.886888 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d8a8d1826b645d1a8fcdfbc26d36c0b already in progress: creating tablet
I20260928 10:44:23.886992 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1191) took 3829 ms. Trace:
I20260928 10:44:23.887053 6270 rpcz_store.cc:276] 0928 10:44:20.057495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.058059 (+ 564us) service_pool.cc:227] Handling call
0928 10:44:23.886889 (+3828830us) ts_tablet_manager.cc:1145] Deleting tablet 18269ece430f46cba7e926b579ac33a1
0928 10:44:23.886897 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.886978 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3828618}
W20260928 10:44:23.887202 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 581f97bde63a48f0815b61e678890438 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581f97bde63a48f0815b61e678890438 already in progress: creating tablet
I20260928 10:44:23.887317 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1190) took 3829 ms. Trace:
I20260928 10:44:23.887378 6270 rpcz_store.cc:276] 0928 10:44:20.057390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.059369 (+ 1979us) service_pool.cc:227] Handling call
0928 10:44:23.887233 (+3827864us) ts_tablet_manager.cc:1145] Deleting tablet c44e7c9d47c24c899ec65d6e7dd9f391
0928 10:44:23.887243 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.887304 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3827678}
I20260928 10:44:23.887588 6270 tablet_replica.cc:330] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.890259 6270 raft_consensus.cc:2229] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
W20260928 10:44:23.890247 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 18269ece430f46cba7e926b579ac33a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18269ece430f46cba7e926b579ac33a1 already in progress: creating tablet
I20260928 10:44:23.890499 6270 pending_rounds.cc:62] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Trying to abort 1 pending ops.
I20260928 10:44:23.890544 6270 pending_rounds.cc:68] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265912025337856 op_type: NO_OP noop_request { }
I20260928 10:44:23.890663 6270 raft_consensus.cc:2866] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:23.890734 6270 raft_consensus.cc:2258] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:23.890921 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c44e7c9d47c24c899ec65d6e7dd9f391 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44e7c9d47c24c899ec65d6e7dd9f391 already in progress: creating tablet
I20260928 10:44:23.891294 6271 raft_consensus.cc:348] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.891552 6270 ts_tablet_manager.cc:1905] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.881564 6273 raft_consensus.cc:374] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.892261 6273 raft_consensus.cc:729] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.892583 6273 consensus_queue.cc:260] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.893424 6273 ts_tablet_manager.cc:1428] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.121s user 0.000s sys 0.001s
I20260928 10:44:23.894172 6273 tablet_bootstrap.cc:492] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:23.896275 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52811a69061f40f9b2bf7b148362c78d consensus state has no leader
I20260928 10:44:23.898716 6270 ts_tablet_manager.cc:1918] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.898833 6270 log.cc:1196] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1f9fc7685a7541219b7207dc38b604e0
I20260928 10:44:23.899190 6270 ts_tablet_manager.cc:1939] T 1f9fc7685a7541219b7207dc38b604e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.899976 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1189) took 3842 ms. Trace:
I20260928 10:44:23.900072 6270 rpcz_store.cc:276] 0928 10:44:20.057275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.063523 (+ 6248us) service_pool.cc:227] Handling call
0928 10:44:23.887552 (+3824029us) ts_tablet_manager.cc:1145] Deleting tablet 1f9fc7685a7541219b7207dc38b604e0
0928 10:44:23.887561 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.895381 (+ 7820us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.898610 (+ 3229us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.899941 (+ 1331us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2486,"tablet-delete.queue_time_us":3823825}
I20260928 10:44:23.900501 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1192) took 3644 ms. Trace:
I20260928 10:44:23.900588 6270 rpcz_store.cc:276] 0928 10:44:20.256326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.256383 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:23.900363 (+3643980us) ts_tablet_manager.cc:1145] Deleting tablet a658dce02ff740f086774aa44aef9fb8
0928 10:44:23.900376 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.900484 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3643763}
I20260928 10:44:23.900864 6270 tablet_replica.cc:330] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.901052 6270 raft_consensus.cc:2229] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:23.901357 6270 raft_consensus.cc:2258] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.901930 6270 ts_tablet_manager.cc:1905] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.905887 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eca95ad570e74db0860997757b1e15df" } new_table_name: "default.Table_78002f7a410d4c3d820d2ac6cc41114a" modify_external_catalogs: true
I20260928 10:44:23.908432 7998 raft_consensus.cc:482] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.908739 7998 raft_consensus.cc:504] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.910425 7998 leader_election.cc:288] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.891957 6271 raft_consensus.cc:374] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:23.911317 6271 raft_consensus.cc:729] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:23.911840 6271 consensus_queue.cc:260] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.912886 7936 raft_consensus.cc:482] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.913004 7936 raft_consensus.cc:504] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.913566 7936 leader_election.cc:288] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.915591 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:23.915670 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:23.916217 5955 leader_election.cc:341] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:23.916582 5955 leader_election.cc:341] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.919662 6270 ts_tablet_manager.cc:1918] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:23.921988 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_66b57e8a1dc9422686b89f61bb0afcac" } modify_external_catalogs: true
I20260928 10:44:23.922173 6270 log.cc:1196] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4082931c332f40fc9c6530190fb61017
I20260928 10:44:23.922286 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_66b57e8a1dc9422686b89f61bb0afcac" } modify_external_catalogs: true
I20260928 10:44:23.922875 6270 ts_tablet_manager.cc:1939] T 4082931c332f40fc9c6530190fb61017 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.925843 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1195) took 3409 ms. Trace:
I20260928 10:44:23.926062 6269 ts_tablet_manager.cc:1905] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.926894 6270 rpcz_store.cc:276] 0928 10:44:20.516067 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.516125 (+ 58us) service_pool.cc:227] Handling call
0928 10:44:23.900824 (+3384699us) ts_tablet_manager.cc:1145] Deleting tablet 4082931c332f40fc9c6530190fb61017
0928 10:44:23.900835 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.911083 (+ 10248us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.919539 (+ 8456us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.925823 (+ 6284us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3384496}
W20260928 10:44:23.929731 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 60155.7us
I20260928 10:44:23.930819 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1205) took 3382 ms. Trace:
I20260928 10:44:23.931424 6270 rpcz_store.cc:276] 0928 10:44:20.548001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.548063 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:23.930683 (+3382620us) ts_tablet_manager.cc:1145] Deleting tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7
0928 10:44:23.930698 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.930797 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3382382}
I20260928 10:44:23.932078 6270 tablet_replica.cc:330] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:23.944026 7958 raft_consensus.cc:686] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Becoming Leader. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Running, Role: LEADER
I20260928 10:44:23.944658 7958 consensus_queue.cc:237] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.900544 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1f9fc7685a7541219b7207dc38b604e0 (table default.Table_ddb5219dc9654884a3cb905f60474969 [id=7555cadaf1a648b1b99aa958641aa949]) successfully deleted
W20260928 10:44:23.950007 5687 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 49465.6us
W20260928 10:44:23.950919 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet a658dce02ff740f086774aa44aef9fb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a658dce02ff740f086774aa44aef9fb8 already in progress: creating tablet
I20260928 10:44:23.951198 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4082931c332f40fc9c6530190fb61017 (table default.Table_cc3ed363602c40ac9aaaba04d960f861 [id=fefdbe66a3fa4e6ea9e91d2798b5bb09]) successfully deleted
W20260928 10:44:23.951416 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2ab439922c6e4ffea8d8cdb6b7d8d8d7 because the tablet was not found. No further retry: Not found: Tablet not found: 2ab439922c6e4ffea8d8cdb6b7d8d8d7
W20260928 10:44:23.951687 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 518c4112b4c54996815486b205646925 consensus state has no leader
W20260928 10:44:23.951946 5818 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.100.66:32919, user_credentials={real_user=slave}} blocked reactor thread for 114776us
W20260928 10:44:23.952174 5818 leader_election.cc:341] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.952260 5818 leader_election.cc:302] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.952142 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_e19b360bf73a49348f7f6d29241c91a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.952777 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19b360bf73a49348f7f6d29241c91a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.957944 6270 raft_consensus.cc:2229] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.958142 6270 raft_consensus.cc:2258] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.958691 6270 ts_tablet_manager.cc:1905] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.965430 6270 ts_tablet_manager.cc:1918] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.965586 6270 log.cc:1196] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1f3d2c79118e44bca3540d3e3ff524a6
I20260928 10:44:23.965884 6270 ts_tablet_manager.cc:1939] T 1f3d2c79118e44bca3540d3e3ff524a6 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:23.967303 6273 tablet_bootstrap.cc:654] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:23.968106 5955 consensus_peers.cc:487] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:23.968237 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d7765f14238742898bbc21e75798d446"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:23.968806 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7765f14238742898bbc21e75798d446 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:23.970145 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.970284 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.970352 5883 raft_consensus.cc:2454] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.970458 5872 raft_consensus.cc:2454] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:23.971570 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b2cabf659dc48028605b39c92e1e451" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:23.972339 7955 raft_consensus.cc:2726] T 527e00f713214484bfc19ab96044a1be P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.972364 6091 leader_election.cc:302] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:23.972602 7955 raft_consensus.cc:482] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.972723 8077 raft_consensus.cc:2726] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:23.972700 7955 raft_consensus.cc:504] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.973335 7955 leader_election.cc:288] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.977015 6275 ts_tablet_manager.cc:1428] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.114s user 0.025s sys 0.013s
I20260928 10:44:23.978046 6269 ts_tablet_manager.cc:1918] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:23.978516 6275 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:23.980248 6275 tablet_bootstrap.cc:654] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:23.983362 5957 leader_election.cc:302] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.983724 7937 raft_consensus.cc:2781] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.983798 7937 raft_consensus.cc:482] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.983853 7937 raft_consensus.cc:3037] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.986188 6150 raft_consensus.cc:3037] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.986627 6269 log.cc:1196] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/383eb18f1c0c46209ff5b47e468b9950
I20260928 10:44:23.986907 6269 ts_tablet_manager.cc:1939] T 383eb18f1c0c46209ff5b47e468b9950 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:23.986397 7937 raft_consensus.cc:504] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.987665 8077 raft_consensus.cc:482] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.987803 8077 raft_consensus.cc:504] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.987941 7937 leader_election.cc:288] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.988397 8077 leader_election.cc:288] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:23.988373 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:23.988776 7958 raft_consensus.cc:482] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:23.988899 7958 raft_consensus.cc:504] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.989164 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:23.989336 6021 raft_consensus.cc:2454] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:23.989456 7958 leader_election.cc:288] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:23.990016 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1006) took 7574 ms. Trace:
W20260928 10:44:23.990052 5955 leader_election.cc:341] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:23.990301 6090 leader_election.cc:302] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:23.990291 6269 rpcz_store.cc:276] 0928 10:44:16.415359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.415429 (+ 70us) service_pool.cc:227] Handling call
0928 10:44:23.852586 (+7437157us) ts_tablet_manager.cc:1145] Deleting tablet 383eb18f1c0c46209ff5b47e468b9950
0928 10:44:23.852601 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.974876 (+122275us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.977959 (+ 3083us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.989999 (+ 12040us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7436888}
I20260928 10:44:23.990869 8077 raft_consensus.cc:2781] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.990945 8077 raft_consensus.cc:482] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.991006 8077 raft_consensus.cc:3037] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.990947 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 383eb18f1c0c46209ff5b47e468b9950 (table default.Table_f049c872214e4df18f99f9fb5a53066e [id=71404aed630447bd8818fbfa887ce197]) successfully deleted
I20260928 10:44:23.991066 6269 tablet_replica.cc:330] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:23.991238 6269 raft_consensus.cc:2229] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:23.991381 6269 raft_consensus.cc:2258] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:23.991434 5957 leader_election.cc:302] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:23.991901 7937 raft_consensus.cc:2781] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:23.991971 7937 raft_consensus.cc:482] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:23.992028 7937 raft_consensus.cc:3037] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.992740 6269 ts_tablet_manager.cc:1905] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:23.993732 8077 raft_consensus.cc:504] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.994994 8077 leader_election.cc:288] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:23.994560 6091 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:23.995172 7937 raft_consensus.cc:504] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:23.995873 7937 leader_election.cc:288] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:23.996100 6091 leader_election.cc:341] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:23.996613 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe0dd05136840ee91d0b2a415ad49fc" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:23.996788 6021 raft_consensus.cc:3037] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:23.999429 6021 raft_consensus.cc:2454] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:24.000320 6090 leader_election.cc:302] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters: ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:24.000356 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:24.000728 8077 raft_consensus.cc:2781] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:24.000932 8077 raft_consensus.cc:686] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
W20260928 10:44:24.000988 5955 leader_election.cc:341] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.001293 8077 consensus_queue.cc:237] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.003499 7936 consensus_queue.cc:1035] T 96cc330167fa476a91a05be3f7e753e0 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.004665 7936 consensus_queue.cc:1035] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.005379 7936 consensus_queue.cc:1035] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.013718 6271 ts_tablet_manager.cc:1428] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.129s user 0.001s sys 0.001s
I20260928 10:44:24.015920 6271 tablet_bootstrap.cc:492] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.017333 6015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b217b6d4ad9a495795fe2b923144e8d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.019605 6269 ts_tablet_manager.cc:1918] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:24.020006 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f799021aca384269bfcd67829f3a7db5" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.020303 6269 log.cc:1196] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/f5a00b74133a406996820adcb71194df
I20260928 10:44:24.020870 6269 ts_tablet_manager.cc:1939] T f5a00b74133a406996820adcb71194df P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.018024 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1200) took 3470 ms. Trace:
I20260928 10:44:24.021216 6270 rpcz_store.cc:276] 0928 10:44:20.547588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.548459 (+ 871us) service_pool.cc:227] Handling call
0928 10:44:23.932024 (+3383565us) ts_tablet_manager.cc:1145] Deleting tablet 1f3d2c79118e44bca3540d3e3ff524a6
0928 10:44:23.932038 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.962265 (+ 30227us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:23.965320 (+ 3055us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.018004 (+ 52684us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25296,"tablet-delete.queue_time_us":3383358}
I20260928 10:44:24.021692 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1f3d2c79118e44bca3540d3e3ff524a6 (table default.Table_026184575e69478c879d0441560fcf70 [id=64ae3d6da0df4c33bb9963f2be175237]) successfully deleted
I20260928 10:44:24.023018 6270 tablet_replica.cc:330] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.023484 6270 raft_consensus.cc:2229] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.024134 6270 raft_consensus.cc:2258] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.024955 6270 ts_tablet_manager.cc:1905] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.025671 6271 tablet_bootstrap.cc:654] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.032557 5693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_68dbd6569dfb4a3288c9ef6a5fcdde21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:24.021136 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e149cdb22cc4c60b012c2d87868827b" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
W20260928 10:44:24.022449 5818 leader_election.cc:341] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.023232 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32560e881a1d4444a706bb8b60dda499" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
W20260928 10:44:24.033363 5693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68dbd6569dfb4a3288c9ef6a5fcdde21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:24.033455 5878 raft_consensus.cc:3037] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.033497 5869 raft_consensus.cc:3037] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:24.034435 5818 leader_election.cc:341] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:24.034544 5817 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 62865.8us
I20260928 10:44:24.035005 7955 raft_consensus.cc:482] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.035142 7955 raft_consensus.cc:504] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.035749 7955 leader_election.cc:288] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:24.036485 5878 raft_consensus.cc:2454] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:24.036936 5869 raft_consensus.cc:2454] T 32560e881a1d4444a706bb8b60dda499 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:24.036876 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b217b6d4ad9a495795fe2b923144e8d3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.036924 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea90e2cbd7624baab1522b8b4afa5f32" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.038518 5957 leader_election.cc:302] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.038700 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f799021aca384269bfcd67829f3a7db5" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.038806 7936 consensus_queue.cc:1035] T 0b67cd4597914a1483fe2bad4de4a8b8 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.039409 7936 raft_consensus.cc:2781] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:24.039543 7936 raft_consensus.cc:686] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:24.039738 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea90e2cbd7624baab1522b8b4afa5f32" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.039737 7936 consensus_queue.cc:237] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.042333 5957 leader_election.cc:302] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.043053 7874 raft_consensus.cc:2781] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:24.044325 7874 raft_consensus.cc:686] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:24.044716 7874 consensus_queue.cc:237] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.029328 6273 tablet_bootstrap.cc:492] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:24.042907 5818 leader_election.cc:341] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.047129 6273 ts_tablet_manager.cc:1397] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.153s user 0.009s sys 0.005s
I20260928 10:44:24.052744 6273 raft_consensus.cc:348] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.053129 6273 raft_consensus.cc:374] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.053246 6273 raft_consensus.cc:729] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.053546 6273 consensus_queue.cc:260] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.054608 6273 ts_tablet_manager.cc:1428] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:24.054919 6273 tablet_bootstrap.cc:492] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:24.055274 5817 leader_election.cc:341] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.055498 5817 leader_election.cc:302] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.055756 7955 raft_consensus.cc:2726] T b217b6d4ad9a495795fe2b923144e8d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:24.056173 5817 leader_election.cc:341] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.056633 5817 leader_election.cc:302] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.056962 6273 tablet_bootstrap.cc:654] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.040868 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1003) took 7625 ms. Trace:
I20260928 10:44:24.058774 6269 rpcz_store.cc:276] 0928 10:44:16.415072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.416035 (+ 963us) service_pool.cc:227] Handling call
0928 10:44:23.991021 (+7574986us) ts_tablet_manager.cc:1145] Deleting tablet f5a00b74133a406996820adcb71194df
0928 10:44:23.991032 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:23.995651 (+ 4619us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.019479 (+ 23828us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.040846 (+ 21367us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7574822}
I20260928 10:44:24.059562 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet f5a00b74133a406996820adcb71194df (table default.Table_e3bfd4162a934aa88b977518be6ad38b [id=0f450c671cde42699489fc5d5f4a99c0]) successfully deleted
I20260928 10:44:24.060019 6269 tablet_replica.cc:330] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.060781 8047 tablet.cc:1722] T dddbd630c6d9446b9ff317c963cd00d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:24.066411 5955 consensus_peers.cc:487] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.067479 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_01f1354d2ff6487a90ac060ac64c8723" } new_table_name: "default.Table_f7126c7e16a04b4eb1bb6fa9820f35f1" modify_external_catalogs: true
W20260928 10:44:24.068527 5955 consensus_peers.cc:487] T 59c67a02d7f84bed9c440c8c451ea4ff P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.070010 6269 raft_consensus.cc:2229] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.071322 8038 tablet.cc:1722] T dddbd630c6d9446b9ff317c963cd00d3 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 10:44:24.074348 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0596f6b57ca24a0e888e559cdcad6b71 consensus state has no leader
I20260928 10:44:24.074695 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet 7ed0451e509d4580be284739255821e2 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:24.078204 6271 tablet_bootstrap.cc:492] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.078346 6271 ts_tablet_manager.cc:1397] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.001s
I20260928 10:44:24.079022 6271 raft_consensus.cc:348] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.079237 6271 raft_consensus.cc:374] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.079286 6271 raft_consensus.cc:729] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.079353 6270 ts_tablet_manager.cc:1918] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.079470 6270 log.cc:1196] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/f95e1588a3d04142ab8d6bb257235dab
I20260928 10:44:24.079753 6270 ts_tablet_manager.cc:1939] T f95e1588a3d04142ab8d6bb257235dab P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.079913 6273 tablet_bootstrap.cc:492] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.080092 6273 ts_tablet_manager.cc:1397] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
I20260928 10:44:24.080467 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1201) took 3532 ms. Trace:
I20260928 10:44:24.087342 8048 tablet.cc:1722] T dddbd630c6d9446b9ff317c963cd00d3 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 10:44:24.092185 8101 tablet.cc:1722] T 3b2cabf659dc48028605b39c92e1e451 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:24.080868 6271 consensus_queue.cc:260] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.093330 7955 raft_consensus.cc:2726] T f799021aca384269bfcd67829f3a7db5 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:24.093890 5817 leader_election.cc:341] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.094174 5817 leader_election.cc:302] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.094782 7958 raft_consensus.cc:2726] T ea90e2cbd7624baab1522b8b4afa5f32 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.094918 7958 raft_consensus.cc:482] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.095119 6269 raft_consensus.cc:2258] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.095013 7958 raft_consensus.cc:504] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.095570 7958 leader_election.cc:288] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:24.095548 6273 raft_consensus.cc:348] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.096030 6273 raft_consensus.cc:374] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.096082 6273 raft_consensus.cc:729] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.096240 6273 consensus_queue.cc:260] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.096673 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917513e857de49a7a57416eca237f70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.096777 6273 ts_tablet_manager.cc:1428] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260928 10:44:24.097018 6273 tablet_bootstrap.cc:492] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:24.097229 5818 leader_election.cc:341] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.098374 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917513e857de49a7a57416eca237f70b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.099140 6269 ts_tablet_manager.cc:1905] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.102581 6273 tablet_bootstrap.cc:654] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.103672 6271 ts_tablet_manager.cc:1428] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260928 10:44:24.104089 6271 tablet_bootstrap.cc:492] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.105834 6271 tablet_bootstrap.cc:654] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.109756 7934 raft_consensus.cc:482] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:24.109740 5817 leader_election.cc:341] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.109949 5817 leader_election.cc:302] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.109894 7934 raft_consensus.cc:504] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.110172 8072 raft_consensus.cc:2726] T 917513e857de49a7a57416eca237f70b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.110809 7934 leader_election.cc:288] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.111413 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:24.111618 5869 raft_consensus.cc:2454] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:24.112119 5957 leader_election.cc:302] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters:
I20260928 10:44:24.112589 7934 raft_consensus.cc:2781] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:24.112666 7934 raft_consensus.cc:482] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:24.112725 7934 raft_consensus.cc:3037] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.112872 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.113427 5955 leader_election.cc:341] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.115366 7934 raft_consensus.cc:504] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.117048 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:24.117228 5869 raft_consensus.cc:3037] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.117892 6270 rpcz_store.cc:276] 0928 10:44:20.547694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.548699 (+ 1005us) service_pool.cc:227] Handling call
0928 10:44:24.022960 (+3474261us) ts_tablet_manager.cc:1145] Deleting tablet f95e1588a3d04142ab8d6bb257235dab
0928 10:44:24.022974 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.044125 (+ 21151us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.079255 (+ 35130us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.080447 (+ 1192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3474126}
I20260928 10:44:24.118374 6270 tablet_replica.cc:330] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.118584 6270 raft_consensus.cc:2229] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.118741 6270 raft_consensus.cc:2258] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.119200 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9012fa19e01f43238c895a84c6dc9815" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:24.119380 6270 ts_tablet_manager.cc:1905] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:24.119782 5955 leader_election.cc:341] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.120535 5869 raft_consensus.cc:2454] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:24.121048 5957 leader_election.cc:302] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.121405 7934 leader_election.cc:288] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.121703 7934 raft_consensus.cc:2781] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:24.121905 7934 raft_consensus.cc:686] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:24.122329 7934 consensus_queue.cc:237] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.124226 6269 ts_tablet_manager.cc:1918] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.125578 6269 log.cc:1196] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/58b58d0c904a423f9801a883a2a2dfc1
I20260928 10:44:24.126277 6269 ts_tablet_manager.cc:1939] T 58b58d0c904a423f9801a883a2a2dfc1 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.141273 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1005) took 7726 ms. Trace:
I20260928 10:44:24.143939 6269 rpcz_store.cc:276] 0928 10:44:16.415253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.424973 (+ 9720us) service_pool.cc:227] Handling call
0928 10:44:24.059963 (+7634990us) ts_tablet_manager.cc:1145] Deleting tablet 58b58d0c904a423f9801a883a2a2dfc1
0928 10:44:24.059978 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.102379 (+ 42401us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.124095 (+ 21716us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.141244 (+ 17149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24409,"tablet-delete.queue_time_us":7634716}
I20260928 10:44:24.145386 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 58b58d0c904a423f9801a883a2a2dfc1 (table default.Table_6fb701fbad2b4bbb8767a204ac5595f5 [id=94470e00e4224cc8b417e3356ffe1dbb]) successfully deleted
I20260928 10:44:24.145625 6269 tablet_replica.cc:330] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.145853 6269 raft_consensus.cc:2229] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.147099 6269 raft_consensus.cc:2258] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.147733 6269 ts_tablet_manager.cc:1905] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:24.152273 5957 consensus_peers.cc:487] T 58b58d0c904a423f9801a883a2a2dfc1 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58b58d0c904a423f9801a883a2a2dfc1. This is attempt 1: this message will repeat every 5th retry.
W20260928 10:44:24.154654 5955 consensus_peers.cc:487] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.160117 6273 tablet_bootstrap.cc:492] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.160347 6273 ts_tablet_manager.cc:1397] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.005s
I20260928 10:44:24.161213 6273 raft_consensus.cc:348] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.164352 6273 raft_consensus.cc:374] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.164523 6273 raft_consensus.cc:729] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.164863 6273 consensus_queue.cc:260] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:24.165381 5955 consensus_peers.cc:487] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.168440 6273 ts_tablet_manager.cc:1428] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 10:44:24.171924 6270 ts_tablet_manager.cc:1918] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.177793 6270 log.cc:1196] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/cd65a860b00d4a7ba8ae92dde5818212
I20260928 10:44:24.178447 6270 ts_tablet_manager.cc:1939] T cd65a860b00d4a7ba8ae92dde5818212 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.181094 6273 tablet_bootstrap.cc:492] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.175408 6271 tablet_bootstrap.cc:492] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.181758 6271 ts_tablet_manager.cc:1397] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.002s
W20260928 10:44:24.182155 5957 consensus_peers.cc:487] T e9e0bac650904b8f81474ba2dac9c04f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.182438 6271 raft_consensus.cc:348] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.182685 6271 raft_consensus.cc:374] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.182762 6271 raft_consensus.cc:729] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.182967 6271 consensus_queue.cc:260] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.183775 6271 ts_tablet_manager.cc:1428] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:24.184062 6271 tablet_bootstrap.cc:492] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.184618 6273 tablet_bootstrap.cc:654] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.185532 6271 tablet_bootstrap.cc:654] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.185798 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet f95e1588a3d04142ab8d6bb257235dab (table default.Table_b577808dfde24cf88b354b7f3e01eb74 [id=58cdd582bf784b1193b13c4dd60c4ead]) successfully deleted
I20260928 10:44:24.185886 6275 tablet_bootstrap.cc:492] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.186038 6275 ts_tablet_manager.cc:1397] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.208s user 0.016s sys 0.024s
I20260928 10:44:24.186750 6275 raft_consensus.cc:348] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.186952 6275 raft_consensus.cc:374] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.187002 6275 raft_consensus.cc:729] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.187182 6275 consensus_queue.cc:260] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.187655 6275 ts_tablet_manager.cc:1428] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.187891 6275 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.189248 6275 tablet_bootstrap.cc:654] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.190331 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1202) took 3642 ms. Trace:
I20260928 10:44:24.193485 6269 ts_tablet_manager.cc:1918] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.201500 8072 raft_consensus.cc:482] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.202718 8072 raft_consensus.cc:504] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.203505 6275 tablet_bootstrap.cc:492] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.203665 6275 ts_tablet_manager.cc:1397] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.005s
I20260928 10:44:24.203636 8072 leader_election.cc:288] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.204185 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "263b9844bdf6465fa7894ddcf2809f24" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.204617 6269 log.cc:1196] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/e9e0bac650904b8f81474ba2dac9c04f
W20260928 10:44:24.204773 5818 leader_election.cc:341] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.204833 6275 raft_consensus.cc:348] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.204068 6270 rpcz_store.cc:276] 0928 10:44:20.547777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.548859 (+ 1082us) service_pool.cc:227] Handling call
0928 10:44:24.118325 (+3569466us) ts_tablet_manager.cc:1145] Deleting tablet cd65a860b00d4a7ba8ae92dde5818212
0928 10:44:24.118338 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.159263 (+ 40925us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.171817 (+ 12554us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.190277 (+ 18460us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569327}
I20260928 10:44:24.205086 6269 ts_tablet_manager.cc:1939] T e9e0bac650904b8f81474ba2dac9c04f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
W20260928 10:44:24.191102 5955 consensus_peers.cc:487] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.205273 6275 raft_consensus.cc:374] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.205435 6275 raft_consensus.cc:729] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.205390 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet cd65a860b00d4a7ba8ae92dde5818212 (table default.Table_5cb651a795e04fc59d29bd7535556cbf [id=cfdc4695a4d8442b88b15f1a81a95c5b]) successfully deleted
I20260928 10:44:24.205693 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "263b9844bdf6465fa7894ddcf2809f24" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.205783 6270 tablet_replica.cc:330] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.205751 6275 consensus_queue.cc:260] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.206290 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1004) took 7791 ms. Trace:
W20260928 10:44:24.206313 5817 leader_election.cc:341] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.206745 5817 leader_election.cc:302] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.207007 8072 raft_consensus.cc:2726] T 263b9844bdf6465fa7894ddcf2809f24 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.207166 6275 ts_tablet_manager.cc:1428] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:24.207356 6269 rpcz_store.cc:276] 0928 10:44:16.415173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.425667 (+ 10494us) service_pool.cc:227] Handling call
0928 10:44:24.145563 (+7719896us) ts_tablet_manager.cc:1145] Deleting tablet e9e0bac650904b8f81474ba2dac9c04f
0928 10:44:24.145579 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.174101 (+ 28522us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.193365 (+ 19264us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.206268 (+ 12903us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7719619}
I20260928 10:44:24.208065 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet e9e0bac650904b8f81474ba2dac9c04f (table default.Table_ade01600340b4495ac021240bf24c832 [id=5bc055b852af4893be3a5ae115cb0d79]) successfully deleted
I20260928 10:44:24.208214 6275 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.208318 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1007) took 7743 ms. Trace:
I20260928 10:44:24.208410 6269 rpcz_store.cc:276] 0928 10:44:16.464543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.481929 (+ 17386us) service_pool.cc:227] Handling call
0928 10:44:24.208167 (+7726238us) ts_tablet_manager.cc:1145] Deleting tablet 8092cd377a6548a1bce299cf5ce8f4dd
0928 10:44:24.208180 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.208298 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7720838}
W20260928 10:44:24.208843 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 8092cd377a6548a1bce299cf5ce8f4dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8092cd377a6548a1bce299cf5ce8f4dd already in progress: creating tablet
I20260928 10:44:24.205991 6270 raft_consensus.cc:2229] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:24.210757 6275 tablet_bootstrap.cc:654] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.210908 6270 raft_consensus.cc:2258] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.211539 6270 ts_tablet_manager.cc:1905] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.213577 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1008) took 7722 ms. Trace:
I20260928 10:44:24.214509 6269 rpcz_store.cc:276] 0928 10:44:16.491343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.494444 (+ 3101us) service_pool.cc:227] Handling call
0928 10:44:24.213400 (+7718956us) ts_tablet_manager.cc:1145] Deleting tablet a0de9e5daf1c46889988bd66f01f11be
0928 10:44:24.213413 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.213548 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7718658}
W20260928 10:44:24.216301 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet a0de9e5daf1c46889988bd66f01f11be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0de9e5daf1c46889988bd66f01f11be already in progress: creating tablet
I20260928 10:44:24.217083 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1009) took 7718 ms. Trace:
I20260928 10:44:24.217433 6269 rpcz_store.cc:276] 0928 10:44:16.498585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.499670 (+ 1085us) service_pool.cc:227] Handling call
0928 10:44:24.216735 (+7717065us) ts_tablet_manager.cc:1145] Deleting tablet 882f017dc1df42c89495b4d06bb9f563
0928 10:44:24.216748 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.217061 (+ 313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7716792}
W20260928 10:44:24.218992 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 882f017dc1df42c89495b4d06bb9f563 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882f017dc1df42c89495b4d06bb9f563 already in progress: creating tablet
I20260928 10:44:24.219434 6269 tablet_replica.cc:330] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.219415 6273 tablet_bootstrap.cc:492] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.220238 6273 ts_tablet_manager.cc:1397] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.000s
I20260928 10:44:24.221068 6273 raft_consensus.cc:348] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.221407 6273 raft_consensus.cc:374] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.221498 6273 raft_consensus.cc:729] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.221740 6273 consensus_queue.cc:260] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.222425 6273 ts_tablet_manager.cc:1428] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.219905 6269 raft_consensus.cc:2229] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.222764 6269 raft_consensus.cc:2258] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.223838 6269 ts_tablet_manager.cc:1905] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.224578 6275 tablet_bootstrap.cc:492] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.224776 6275 ts_tablet_manager.cc:1397] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260928 10:44:24.225553 6275 raft_consensus.cc:348] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.225832 6275 raft_consensus.cc:374] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.225924 6275 raft_consensus.cc:729] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.226194 6270 ts_tablet_manager.cc:1918] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:24.226187 6275 consensus_queue.cc:260] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.226783 6275 ts_tablet_manager.cc:1428] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 10:44:24.226383 6270 log.cc:1196] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/bc7aa301bfbb4097b386a0d23cfa91e1
I20260928 10:44:24.229797 6270 ts_tablet_manager.cc:1939] T bc7aa301bfbb4097b386a0d23cfa91e1 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.223090 6273 tablet_bootstrap.cc:492] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.232717 6275 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.234396 6275 tablet_bootstrap.cc:654] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.235838 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1203) took 3687 ms. Trace:
I20260928 10:44:24.236042 6270 rpcz_store.cc:276] 0928 10:44:20.547847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.549022 (+ 1175us) service_pool.cc:227] Handling call
0928 10:44:24.205685 (+3656663us) ts_tablet_manager.cc:1145] Deleting tablet bc7aa301bfbb4097b386a0d23cfa91e1
0928 10:44:24.205696 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.220595 (+ 14899us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.226052 (+ 5457us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.235802 (+ 9750us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3656533}
I20260928 10:44:24.236578 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet bc7aa301bfbb4097b386a0d23cfa91e1 (table default.Table_6089745a618d42d496cff786eba718fa [id=2f4692f3be284f3c81ec608ace7d6d0f]) successfully deleted
I20260928 10:44:24.236716 6273 tablet_bootstrap.cc:654] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.237062 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1204) took 3689 ms. Trace:
I20260928 10:44:24.237231 6270 rpcz_store.cc:276] 0928 10:44:20.547931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.549176 (+ 1245us) service_pool.cc:227] Handling call
0928 10:44:24.236943 (+3687767us) ts_tablet_manager.cc:1145] Deleting tablet 1072cf156cdf4c2a8c9d9764de110c6d
0928 10:44:24.236957 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.237031 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3687650}
W20260928 10:44:24.237696 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1072cf156cdf4c2a8c9d9764de110c6d because the tablet was not found. No further retry: Not found: Tablet not found: 1072cf156cdf4c2a8c9d9764de110c6d
I20260928 10:44:24.238114 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1229) took 3360 ms. Trace:
I20260928 10:44:24.238270 6270 rpcz_store.cc:276] 0928 10:44:20.877534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.879139 (+ 1605us) service_pool.cc:227] Handling call
0928 10:44:24.237987 (+3358848us) ts_tablet_manager.cc:1145] Deleting tablet 3c2046ebde9440e8a5ce572172366877
0928 10:44:24.237999 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.238082 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358599}
W20260928 10:44:24.238766 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3c2046ebde9440e8a5ce572172366877 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2046ebde9440e8a5ce572172366877 already in progress: creating tablet
I20260928 10:44:24.239177 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1230) took 3337 ms. Trace:
I20260928 10:44:24.239329 6270 rpcz_store.cc:276] 0928 10:44:20.901864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.903947 (+ 2083us) service_pool.cc:227] Handling call
0928 10:44:24.239057 (+3335110us) ts_tablet_manager.cc:1145] Deleting tablet 495726dac8624c75aa20133c3e2757bc
0928 10:44:24.239067 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.239148 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3334907}
W20260928 10:44:24.239985 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 495726dac8624c75aa20133c3e2757bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495726dac8624c75aa20133c3e2757bc already in progress: creating tablet
I20260928 10:44:24.240624 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1231) took 3322 ms. Trace:
I20260928 10:44:24.240801 6270 rpcz_store.cc:276] 0928 10:44:20.918098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.921083 (+ 2985us) service_pool.cc:227] Handling call
0928 10:44:24.240297 (+3319214us) ts_tablet_manager.cc:1145] Deleting tablet c5a49133468840e6b7bed0126dd2182f
0928 10:44:24.240308 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.240395 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3318838}
W20260928 10:44:24.241230 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c5a49133468840e6b7bed0126dd2182f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5a49133468840e6b7bed0126dd2182f already in progress: creating tablet
I20260928 10:44:24.242290 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1228) took 3373 ms. Trace:
I20260928 10:44:24.242456 6270 rpcz_store.cc:276] 0928 10:44:20.868549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:20.871902 (+ 3353us) service_pool.cc:227] Handling call
0928 10:44:24.242169 (+3370267us) ts_tablet_manager.cc:1145] Deleting tablet 95fd004a4f724ae5bb285af67218d8d7
0928 10:44:24.242180 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.242258 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3227681}
W20260928 10:44:24.242996 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 95fd004a4f724ae5bb285af67218d8d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95fd004a4f724ae5bb285af67218d8d7 already in progress: creating tablet
I20260928 10:44:24.243325 6270 tablet_replica.cc:330] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.243606 6270 raft_consensus.cc:2229] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:24.244149 6270 raft_consensus.cc:2258] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.244827 6270 ts_tablet_manager.cc:1905] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.252029 8072 raft_consensus.cc:482] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.252225 8072 raft_consensus.cc:504] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.252882 8072 leader_election.cc:288] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.253393 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d1021f0b844a348e3fbed913758650" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.253360 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d1021f0b844a348e3fbed913758650" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.253995 5818 leader_election.cc:341] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:24.254136 5817 leader_election.cc:341] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.254217 5817 leader_election.cc:302] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.254670 8072 raft_consensus.cc:2726] T 79d1021f0b844a348e3fbed913758650 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.256789 6270 ts_tablet_manager.cc:1918] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 10:44:24.257046 6270 log.cc:1196] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/4ef1e7125d4e42f5b30f33bfa588511c
I20260928 10:44:24.257503 6270 ts_tablet_manager.cc:1939] T 4ef1e7125d4e42f5b30f33bfa588511c P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.258380 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1246) took 2913 ms. Trace:
I20260928 10:44:24.259068 6270 rpcz_store.cc:276] 0928 10:44:21.344586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.344674 (+ 88us) service_pool.cc:227] Handling call
0928 10:44:24.243265 (+2898591us) ts_tablet_manager.cc:1145] Deleting tablet 4ef1e7125d4e42f5b30f33bfa588511c
0928 10:44:24.243275 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.249497 (+ 6222us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.256025 (+ 6528us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.258266 (+ 2241us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":2898363}
I20260928 10:44:24.259708 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 4ef1e7125d4e42f5b30f33bfa588511c (table default.Table_db9adcd0bc9a4b4e90425535a5c52a58 [id=6c4f8a03470949939c8e51847b52ce13]) successfully deleted
I20260928 10:44:24.260183 6270 tablet_replica.cc:330] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.260465 6270 raft_consensus.cc:2229] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.260702 6270 raft_consensus.cc:2258] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.261312 6270 ts_tablet_manager.cc:1905] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.265679 6269 ts_tablet_manager.cc:1918] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.266185 6269 log.cc:1196] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/57b7976063024775b9dde91b32010754
I20260928 10:44:24.266261 8047 tablet.cc:1722] T 5afe4501ea584d44b511b89983e210e3 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:24.269021 8048 tablet.cc:1722] T 5afe4501ea584d44b511b89983e210e3 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:24.273319 8038 tablet.cc:1722] T 5afe4501ea584d44b511b89983e210e3 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 10:44:24.282275 6271 tablet_bootstrap.cc:492] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.282462 6271 ts_tablet_manager.cc:1397] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.098s user 0.017s sys 0.007s
I20260928 10:44:24.283162 6271 raft_consensus.cc:348] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.283392 6271 raft_consensus.cc:374] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.283465 6271 raft_consensus.cc:729] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.283713 6271 consensus_queue.cc:260] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.284243 6271 ts_tablet_manager.cc:1428] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:24.289423 6271 tablet_bootstrap.cc:492] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.290012 6275 tablet_bootstrap.cc:492] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.290140 6275 ts_tablet_manager.cc:1397] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.003s
I20260928 10:44:24.290680 8077 raft_consensus.cc:482] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.290813 8077 raft_consensus.cc:504] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.291400 8077 leader_election.cc:288] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.292244 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.293409 6271 tablet_bootstrap.cc:654] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:24.294055 5526 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 53454.5us
I20260928 10:44:24.294664 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cc330167fa476a91a05be3f7e753e0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:24.295189 7874 consensus_queue.cc:1035] T ed7cd14e0039402ea51f34e8b88e2605 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.298120 6091 leader_election.cc:302] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:24.298547 8077 raft_consensus.cc:2726] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:24.306372 5957 consensus_peers.cc:487] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 383eb18f1c0c46209ff5b47e468b9950. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.311002 8038 tablet.cc:1722] T 3c67f960eb84426f9ebdfef33306a9d0 P ab770e77cb704ea38b5ca8cff97dc73b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 10:44:24.311856 6275 raft_consensus.cc:348] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.313503 6275 raft_consensus.cc:374] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.313594 6275 raft_consensus.cc:729] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.315160 8048 tablet.cc:1722] T 3c67f960eb84426f9ebdfef33306a9d0 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 10:44:24.318533 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 3ae85d945b0242c289e2e930d1485758
I20260928 10:44:24.319011 5698 catalog_manager.cc:6565] ReplaceTablet: tablet 3ae85d945b0242c289e2e930d1485758 deleted and replaced by tablet b940d261b8f6434c8a7990d0832a755e
I20260928 10:44:24.318426 6275 consensus_queue.cc:260] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.319490 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae85d945b0242c289e2e930d1485758 with delete_type TABLET_DATA_DELETED (replaced by tablet b940d261b8f6434c8a7990d0832a755e) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.319537 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0821f14657fe4a7bac8eec4ade19063c
I20260928 10:44:24.319860 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae85d945b0242c289e2e930d1485758 with delete_type TABLET_DATA_DELETED (replaced by tablet b940d261b8f6434c8a7990d0832a755e) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.320497 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 0821f14657fe4a7bac8eec4ade19063c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.321202 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae85d945b0242c289e2e930d1485758 with delete_type TABLET_DATA_DELETED (replaced by tablet b940d261b8f6434c8a7990d0832a755e) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.321748 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 0821f14657fe4a7bac8eec4ade19063c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.323622 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 0821f14657fe4a7bac8eec4ade19063c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.326171 6275 ts_tablet_manager.cc:1428] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260928 10:44:24.327232 7874 raft_consensus.cc:482] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.327299 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:24.327385 7874 raft_consensus.cc:504] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.327581 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:24.327939 7874 leader_election.cc:288] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.327951 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:24.328138 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:24.328377 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet dddbd630c6d9446b9ff317c963cd00d3 (table default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717]). Expected version 3 got 0
I20260928 10:44:24.328627 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:24.328833 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 5afe4501ea584d44b511b89983e210e3 (table default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73]). Expected version 1 got 0
I20260928 10:44:24.329224 5699 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:24.330205 5697 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_8efd871139c84e1fadace980a7742a81 [id=3daf4c7bcf784fb0948e743ecec939ed] alter complete (version 2)
I20260928 10:44:24.331525 6273 tablet_bootstrap.cc:492] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.332713 6273 ts_tablet_manager.cc:1397] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.110s user 0.011s sys 0.006s
W20260928 10:44:24.333253 5957 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: b1cdff9f01974354a81179dd9bd5a26e
I20260928 10:44:24.333688 7874 consensus_queue.cc:1035] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.333694 6273 raft_consensus.cc:348] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.333871 6273 raft_consensus.cc:374] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.333920 6273 raft_consensus.cc:729] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.334115 6273 consensus_queue.cc:260] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.334206 8047 tablet.cc:1722] T 3c67f960eb84426f9ebdfef33306a9d0 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 10:44:24.334641 6273 ts_tablet_manager.cc:1428] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.334884 6273 tablet_bootstrap.cc:492] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.336311 6273 tablet_bootstrap.cc:654] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.328678 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cdff9f01974354a81179dd9bd5a26e" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.340039 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 9cf66ffbaf9f401a8d9635911616748e (DEFAULT_TABLE table=default.Table_a25a99ff9b81405db025150d99b40b96 [id=5246e2936a5b4c168b685c1647d3b3cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.341341 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cf66ffbaf9f401a8d9635911616748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.341558 6269 ts_tablet_manager.cc:1939] T 57b7976063024775b9dde91b32010754 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.342304 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1010) took 7770 ms. Trace:
I20260928 10:44:24.342396 6269 rpcz_store.cc:276] 0928 10:44:16.572316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.585009 (+ 12693us) service_pool.cc:227] Handling call
0928 10:44:24.219384 (+7634375us) ts_tablet_manager.cc:1145] Deleting tablet 57b7976063024775b9dde91b32010754
0928 10:44:24.219395 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.243170 (+ 23775us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.246432 (+ 3262us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.342283 (+ 95851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7634106}
I20260928 10:44:24.342929 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 57b7976063024775b9dde91b32010754 (table default.Table_18ea40c9c4d247179baafb67f810b161 [id=57eb67151ca647bf9621b98e90aa2a82]) successfully deleted
I20260928 10:44:24.344796 7937 raft_consensus.cc:482] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.344938 7937 raft_consensus.cc:504] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.345468 7937 leader_election.cc:288] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.346374 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.346963 5955 leader_election.cc:341] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.347077 5955 leader_election.cc:302] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027; no voters: 4dab87557ec9445dbe35ea05e3561a94, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:24.347467 7937 raft_consensus.cc:2726] T b1cdff9f01974354a81179dd9bd5a26e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:24.347918 5955 leader_election.cc:341] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.350191 7958 raft_consensus.cc:482] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.350343 7958 raft_consensus.cc:504] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.351002 7958 leader_election.cc:288] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.351893 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c8c53b5ae244cda8dff396935fc8e82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.352053 6269 tablet_replica.cc:330] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.352255 6269 raft_consensus.cc:2229] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:24.353619 6269 raft_consensus.cc:2258] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:24.354640 5817 leader_election.cc:341] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.357259 6269 ts_tablet_manager.cc:1905] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.359165 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:24.359424 5883 raft_consensus.cc:2454] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:24.359788 6275 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.364431 5957 leader_election.cc:302] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.364946 7937 raft_consensus.cc:2781] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:24.365027 7937 raft_consensus.cc:482] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:24.365080 7937 raft_consensus.cc:3037] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.367487 7937 raft_consensus.cc:504] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.368445 7937 leader_election.cc:288] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.368492 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:24.368646 6273 tablet_bootstrap.cc:492] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
W20260928 10:44:24.369078 5955 leader_election.cc:341] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:24.369279 5955 consensus_peers.cc:487] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.369418 6273 ts_tablet_manager.cc:1397] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20260928 10:44:24.369411 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c8c53b5ae244cda8dff396935fc8e82" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.370129 6273 raft_consensus.cc:348] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.370333 6273 raft_consensus.cc:374] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.370390 6273 raft_consensus.cc:729] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.370628 6273 consensus_queue.cc:260] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.370682 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 9cf66ffbaf9f401a8d9635911616748e (DEFAULT_TABLE table=default.Table_a25a99ff9b81405db025150d99b40b96 [id=5246e2936a5b4c168b685c1647d3b3cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.371071 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cf66ffbaf9f401a8d9635911616748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.371315 6273 ts_tablet_manager.cc:1428] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.371559 6273 tablet_bootstrap.cc:492] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.372818 6273 tablet_bootstrap.cc:654] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.376133 6269 ts_tablet_manager.cc:1918] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 10:44:24.382570 6269 log.cc:1196] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/c2f078ae6d2b498d8c5af90afba887ad
I20260928 10:44:24.382997 6269 ts_tablet_manager.cc:1939] T c2f078ae6d2b498d8c5af90afba887ad P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.384415 6273 tablet_bootstrap.cc:492] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.384541 6273 ts_tablet_manager.cc:1397] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
W20260928 10:44:24.381563 5818 leader_election.cc:341] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.385041 5818 leader_election.cc:302] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.385267 7958 raft_consensus.cc:2726] T 1c8c53b5ae244cda8dff396935fc8e82 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.385149 6273 raft_consensus.cc:348] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.385360 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 9cf66ffbaf9f401a8d9635911616748e (DEFAULT_TABLE table=default.Table_a25a99ff9b81405db025150d99b40b96 [id=5246e2936a5b4c168b685c1647d3b3cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.385466 6273 raft_consensus.cc:374] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.385551 6273 raft_consensus.cc:729] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.385749 6273 consensus_queue.cc:260] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.386314 6273 ts_tablet_manager.cc:1428] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:24.387275 6129 tablet_service.cc:1467] Processing CreateTablet for tablet bcb78f1f0cb14c60bb4226359fa9c9db (DEFAULT_TABLE table=default.Table_a46997a4fbd848cc8ce98c4d82af4886 [id=e0114be10bcd4f0e925d5a8b12070b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.387566 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1011) took 7642 ms. Trace:
I20260928 10:44:24.387681 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb78f1f0cb14c60bb4226359fa9c9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.387650 6269 rpcz_store.cc:276] 0928 10:44:16.745186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.745723 (+ 537us) service_pool.cc:227] Handling call
0928 10:44:24.352003 (+7606280us) ts_tablet_manager.cc:1145] Deleting tablet c2f078ae6d2b498d8c5af90afba887ad
0928 10:44:24.352015 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.367087 (+ 15072us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.376051 (+ 8964us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.387547 (+ 11496us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7561637}
I20260928 10:44:24.388571 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet c2f078ae6d2b498d8c5af90afba887ad (table default.Table_e1ac09d1496a4872a1200c7b5a277c41 [id=d97832b104544da6b36061c55120b204]) successfully deleted
I20260928 10:44:24.388994 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1016) took 7483 ms. Trace:
I20260928 10:44:24.389075 6269 rpcz_store.cc:276] 0928 10:44:16.905079 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.905128 (+ 49us) service_pool.cc:227] Handling call
0928 10:44:24.387881 (+7482753us) ts_tablet_manager.cc:1145] Deleting tablet 069469d23ccf446284e67d970ffd6efa
0928 10:44:24.388857 (+ 976us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.388978 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7460138}
W20260928 10:44:24.389528 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 069469d23ccf446284e67d970ffd6efa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069469d23ccf446284e67d970ffd6efa already in progress: creating tablet
I20260928 10:44:24.390008 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cf66ffbaf9f401a8d9635911616748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.389925 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c6ed97f74540b786ed3a6378dea0d3" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:24.390100 5883 raft_consensus.cc:3037] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.392551 5883 raft_consensus.cc:2454] T 11c6ed97f74540b786ed3a6378dea0d3 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:24.393481 5957 leader_election.cc:302] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:24.393819 7936 raft_consensus.cc:2781] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:24.393944 7936 raft_consensus.cc:686] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:24.394152 7936 consensus_queue.cc:237] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.394513 6273 tablet_bootstrap.cc:492] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.394973 6269 tablet_replica.cc:330] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.395179 6269 raft_consensus.cc:2229] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.395313 6269 raft_consensus.cc:2258] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.395776 6269 ts_tablet_manager.cc:1905] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.396317 5994 tablet_service.cc:1467] Processing CreateTablet for tablet bcb78f1f0cb14c60bb4226359fa9c9db (DEFAULT_TABLE table=default.Table_a46997a4fbd848cc8ce98c4d82af4886 [id=e0114be10bcd4f0e925d5a8b12070b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.396679 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb78f1f0cb14c60bb4226359fa9c9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.403360 6269 ts_tablet_manager.cc:1918] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.381282 6275 tablet_bootstrap.cc:654] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.406533 6273 tablet_bootstrap.cc:654] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.408613 5857 tablet_service.cc:1467] Processing CreateTablet for tablet bcb78f1f0cb14c60bb4226359fa9c9db (DEFAULT_TABLE table=default.Table_a46997a4fbd848cc8ce98c4d82af4886 [id=e0114be10bcd4f0e925d5a8b12070b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.409197 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb78f1f0cb14c60bb4226359fa9c9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.410413 6269 log.cc:1196] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/0e149cdb22cc4c60b012c2d87868827b
I20260928 10:44:24.410964 6269 ts_tablet_manager.cc:1939] T 0e149cdb22cc4c60b012c2d87868827b P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.412117 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1018) took 7481 ms. Trace:
I20260928 10:44:24.414467 6269 rpcz_store.cc:276] 0928 10:44:16.930299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.931359 (+ 1060us) service_pool.cc:227] Handling call
0928 10:44:24.389289 (+7457930us) ts_tablet_manager.cc:1145] Deleting tablet 0e149cdb22cc4c60b012c2d87868827b
0928 10:44:24.394926 (+ 5637us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.398623 (+ 3697us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.403249 (+ 4626us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.412094 (+ 8845us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7457697}
I20260928 10:44:24.415345 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 0e149cdb22cc4c60b012c2d87868827b (table default.Table_b8e5fedeb2f242fca078d64788bf6c33 [id=60cc8d4d98524885be57b8bf246f2182]) successfully deleted
I20260928 10:44:24.416489 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 57bdd454769e49fe8dba851f89d743f6 (DEFAULT_TABLE table=default.Table_5264a9430f6445e4a30c1ac53aa65c3c [id=bc97e0c25c464e3a9096f6640c939b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.416918 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57bdd454769e49fe8dba851f89d743f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.417649 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 57bdd454769e49fe8dba851f89d743f6 (DEFAULT_TABLE table=default.Table_5264a9430f6445e4a30c1ac53aa65c3c [id=bc97e0c25c464e3a9096f6640c939b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.418084 6152 raft_consensus.cc:3037] T cc2990e37a9648669eb39a865392c9e7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.418649 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 644fb6e3043a47638f6cb0a45f46a170 (DEFAULT_TABLE table=default.Table_cebb1338808c4507a0d552d4d2e2a040 [id=842312133ec1430dac94b2d83d33e697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.418983 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644fb6e3043a47638f6cb0a45f46a170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.423906 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57bdd454769e49fe8dba851f89d743f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.424695 5955 consensus_peers.cc:487] T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.425518 6273 tablet_bootstrap.cc:492] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.425685 6273 ts_tablet_manager.cc:1397] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.000s
I20260928 10:44:24.426373 6273 raft_consensus.cc:348] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.426717 6273 raft_consensus.cc:374] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.426815 6273 raft_consensus.cc:729] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.427074 6273 consensus_queue.cc:260] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.427722 6273 ts_tablet_manager.cc:1428] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.369485 6270 ts_tablet_manager.cc:1918] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.436368 6270 log.cc:1196] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:24.436785 6270 ts_tablet_manager.cc:1939] T 9fe0dd05136840ee91d0b2a415ad49fc P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.438040 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1247) took 2954 ms. Trace:
I20260928 10:44:24.438167 6270 rpcz_store.cc:276] 0928 10:44:21.483619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.483687 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:24.260046 (+2776359us) ts_tablet_manager.cc:1145] Deleting tablet 9fe0dd05136840ee91d0b2a415ad49fc
0928 10:44:24.260103 (+ 57us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.317459 (+ 57356us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.369374 (+ 51915us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.438013 (+ 68639us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2761751}
I20260928 10:44:24.438714 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 9fe0dd05136840ee91d0b2a415ad49fc (table default.Table_bd415a38e4344ac0a4f2bfb479d01b58 [id=01274b7dde224a98ae1da73c01701045]) successfully deleted
I20260928 10:44:24.439234 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1249) took 2955 ms. Trace:
I20260928 10:44:24.439339 6270 rpcz_store.cc:276] 0928 10:44:21.483807 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.483868 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:24.439111 (+2955243us) ts_tablet_manager.cc:1145] Deleting tablet 4b6db38f77f64cfe9a7802d5307aa949
0928 10:44:24.439124 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.439216 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2940635}
W20260928 10:44:24.439832 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4b6db38f77f64cfe9a7802d5307aa949 because the tablet was not found. No further retry: Not found: Tablet not found: 4b6db38f77f64cfe9a7802d5307aa949
I20260928 10:44:24.440153 6270 tablet_replica.cc:330] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.440398 6270 raft_consensus.cc:2229] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:24.445477 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 644fb6e3043a47638f6cb0a45f46a170 (DEFAULT_TABLE table=default.Table_cebb1338808c4507a0d552d4d2e2a040 [id=842312133ec1430dac94b2d83d33e697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.445933 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644fb6e3043a47638f6cb0a45f46a170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.446197 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 644fb6e3043a47638f6cb0a45f46a170 (DEFAULT_TABLE table=default.Table_cebb1338808c4507a0d552d4d2e2a040 [id=842312133ec1430dac94b2d83d33e697]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.448295 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 47d32b3ed41e4431b0ef3e4e28552ded (DEFAULT_TABLE table=default.Table_1e4ab4b6d51343429fe4445b4f4fa81c [id=5d41d14b7739488591bbd58047e999a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.448643 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47d32b3ed41e4431b0ef3e4e28552ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.449594 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 34bc869a976a452495dc94a3e1878809 (DEFAULT_TABLE table=default.Table_48cb0207f1174f79af8de081c5ceea1a [id=76c8f35f8e504e439f1d9e57e7b817ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.449995 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bc869a976a452495dc94a3e1878809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.454078 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 47d32b3ed41e4431b0ef3e4e28552ded (DEFAULT_TABLE table=default.Table_1e4ab4b6d51343429fe4445b4f4fa81c [id=5d41d14b7739488591bbd58047e999a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.456400 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 47d32b3ed41e4431b0ef3e4e28552ded (DEFAULT_TABLE table=default.Table_1e4ab4b6d51343429fe4445b4f4fa81c [id=5d41d14b7739488591bbd58047e999a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.456836 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47d32b3ed41e4431b0ef3e4e28552ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.458904 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 57bdd454769e49fe8dba851f89d743f6 (DEFAULT_TABLE table=default.Table_5264a9430f6445e4a30c1ac53aa65c3c [id=bc97e0c25c464e3a9096f6640c939b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.459347 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57bdd454769e49fe8dba851f89d743f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.462776 6273 tablet_bootstrap.cc:492] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.464187 6273 tablet_bootstrap.cc:654] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.466778 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644fb6e3043a47638f6cb0a45f46a170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.470727 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47d32b3ed41e4431b0ef3e4e28552ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.474372 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 34bc869a976a452495dc94a3e1878809 (DEFAULT_TABLE table=default.Table_48cb0207f1174f79af8de081c5ceea1a [id=76c8f35f8e504e439f1d9e57e7b817ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.474797 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bc869a976a452495dc94a3e1878809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.474833 6275 tablet_bootstrap.cc:492] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.474975 6275 ts_tablet_manager.cc:1397] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.000s
I20260928 10:44:24.475687 6275 raft_consensus.cc:348] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.475893 6275 raft_consensus.cc:374] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.475939 6275 raft_consensus.cc:729] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.476100 6275 consensus_queue.cc:260] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.476883 6275 ts_tablet_manager.cc:1428] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:24.477138 6275 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.488232 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 4205aa3638244fba90935f5ff46616ab (DEFAULT_TABLE table=default.Table_05f78676f8474c24bb3bc74b804474c3 [id=b422abbe28fe4b6e8749a4cbcb7f2f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.488757 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4205aa3638244fba90935f5ff46616ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.488725 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 4205aa3638244fba90935f5ff46616ab (DEFAULT_TABLE table=default.Table_05f78676f8474c24bb3bc74b804474c3 [id=b422abbe28fe4b6e8749a4cbcb7f2f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.489118 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4205aa3638244fba90935f5ff46616ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.492311 5957 consensus_peers.cc:487] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57b7976063024775b9dde91b32010754. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.494776 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 34bc869a976a452495dc94a3e1878809 (DEFAULT_TABLE table=default.Table_48cb0207f1174f79af8de081c5ceea1a [id=76c8f35f8e504e439f1d9e57e7b817ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.495179 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bc869a976a452495dc94a3e1878809. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.500689 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 3ae85d945b0242c289e2e930d1485758 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae85d945b0242c289e2e930d1485758 already in progress: creating tablet
I20260928 10:44:24.501001 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1025) took 7523 ms. Trace:
I20260928 10:44:24.501282 6269 rpcz_store.cc:276] 0928 10:44:16.975704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:16.978525 (+ 2821us) service_pool.cc:227] Handling call
0928 10:44:24.415765 (+7437240us) ts_tablet_manager.cc:1145] Deleting tablet 5640b425dd9945539dbdf658994c7918
0928 10:44:24.498835 (+ 83070us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.498975 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7437068}
W20260928 10:44:24.501427 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0821f14657fe4a7bac8eec4ade19063c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0821f14657fe4a7bac8eec4ade19063c already in progress: creating tablet
W20260928 10:44:24.502141 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 5640b425dd9945539dbdf658994c7918 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5640b425dd9945539dbdf658994c7918 already in progress: creating tablet
I20260928 10:44:24.502434 6270 raft_consensus.cc:2258] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.502238 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1038) took 7160 ms. Trace:
I20260928 10:44:24.502771 6269 rpcz_store.cc:276] 0928 10:44:17.341573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.386533 (+ 44960us) service_pool.cc:227] Handling call
0928 10:44:24.502120 (+7115587us) ts_tablet_manager.cc:1145] Deleting tablet d605cff11a05407b979c5aeea4534893
0928 10:44:24.502130 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.502219 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7115378}
W20260928 10:44:24.503558 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet d605cff11a05407b979c5aeea4534893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d605cff11a05407b979c5aeea4534893 already in progress: creating tablet
I20260928 10:44:24.504051 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1039) took 7070 ms. Trace:
I20260928 10:44:24.504474 6269 rpcz_store.cc:276] 0928 10:44:17.433384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.434789 (+ 1405us) service_pool.cc:227] Handling call
0928 10:44:24.503910 (+7069121us) ts_tablet_manager.cc:1145] Deleting tablet b7065d8329b146b789216da84c9357b2
0928 10:44:24.503923 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.504031 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7068903}
W20260928 10:44:24.505151 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b7065d8329b146b789216da84c9357b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7065d8329b146b789216da84c9357b2 already in progress: creating tablet
I20260928 10:44:24.505596 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1040) took 7014 ms. Trace:
I20260928 10:44:24.506742 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db691292246d4d74a972b8254d349d6a" } modify_external_catalogs: true
I20260928 10:44:24.506922 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_db691292246d4d74a972b8254d349d6a" } modify_external_catalogs: true
I20260928 10:44:24.507248 5696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0cab5ed3a4bc4d88a0f3ec63f1409406
I20260928 10:44:24.509207 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_8fbb460009ed459fa1f30626ea9c9047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:24.509776 6270 ts_tablet_manager.cc:1905] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 10:44:24.509828 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fbb460009ed459fa1f30626ea9c9047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:24.510895 5701 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.67:50395 (request call id 209) took 932 ms (client timeout 1000 ms). Trace:
W20260928 10:44:24.510980 5701 rpcz_store.cc:269] 0928 10:44:23.578929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:23.578982 (+ 53us) service_pool.cc:227] Handling call
0928 10:44:23.591826 (+ 12844us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.510871 (+919045us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":28322688}
I20260928 10:44:24.511184 5697 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_41aa05e6247a4ea2a283c5c0531b6099" } new_table_name: "default.Table_ae435c4499f54de2b7b8a12a99a44328" modify_external_catalogs: true
I20260928 10:44:24.511405 5701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0b712584195740a08a9503efe77e1a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:24.511909 5701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b712584195740a08a9503efe77e1a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:24.512951 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.514103 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.514286 6275 tablet_bootstrap.cc:654] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.516194 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:24.516671 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet d6c48b8a7efa41a684205df3e6969370 (table default.Table_45fb73a0f9e1445c8e355b4dad0839df [id=5746764388a94c4aa38985de816e9c54]). Expected version 1 got 0
I20260928 10:44:24.516957 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:24.517426 5696 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:24.513988 6269 rpcz_store.cc:276] 0928 10:44:17.491248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.491313 (+ 65us) service_pool.cc:227] Handling call
0928 10:44:24.505482 (+7014169us) ts_tablet_manager.cc:1145] Deleting tablet b2c52b6b88a44a4e925dcf1c3f9232e1
0928 10:44:24.505493 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.505578 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7013963}
I20260928 10:44:24.513497 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.518882 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 4205aa3638244fba90935f5ff46616ab (DEFAULT_TABLE table=default.Table_05f78676f8474c24bb3bc74b804474c3 [id=b422abbe28fe4b6e8749a4cbcb7f2f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.519335 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4205aa3638244fba90935f5ff46616ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.519512 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet b2c52b6b88a44a4e925dcf1c3f9232e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2c52b6b88a44a4e925dcf1c3f9232e1 already in progress: creating tablet
I20260928 10:44:24.519732 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.520211 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1041) took 7024 ms. Trace:
I20260928 10:44:24.521544 6269 rpcz_store.cc:276] 0928 10:44:17.495525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.495597 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:24.520072 (+7024475us) ts_tablet_manager.cc:1145] Deleting tablet 6eeceb0dbb064221b6ff2a76c8bf8b79
0928 10:44:24.520081 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.520188 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7024269}
W20260928 10:44:24.522082 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eeceb0dbb064221b6ff2a76c8bf8b79 already in progress: creating tablet
I20260928 10:44:24.521423 6273 tablet_bootstrap.cc:492] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.522462 6273 ts_tablet_manager.cc:1397] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.006s
I20260928 10:44:24.523308 6273 raft_consensus.cc:348] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.523586 6273 raft_consensus.cc:374] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.524307 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 11bfc04f7b754226a484021d98e6b329 (DEFAULT_TABLE table=default.Table_865a5be7cc6a4be0819fef08d263c581 [id=cc6a296c707249018890e75bfed98694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.524335 6134 tablet_service.cc:1467] Processing CreateTablet for tablet f321a88e23e44082a9b28135fd82a226 (DEFAULT_TABLE table=default.Table_b4fca997384b4e73903d9b24f25988a5 [id=c9119fbf7e2d463c8b920e390735faba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.524689 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11bfc04f7b754226a484021d98e6b329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.524690 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321a88e23e44082a9b28135fd82a226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.525197 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 1287ba419598439d8a5a8997735502ac (DEFAULT_TABLE table=default.Table_7e40eb9b813a4bbcbca8a9779e822a60 [id=967f3d038ed34bbeb87732628992fa14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.525534 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1287ba419598439d8a5a8997735502ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.527174 5853 tablet_service.cc:1467] Processing CreateTablet for tablet f321a88e23e44082a9b28135fd82a226 (DEFAULT_TABLE table=default.Table_b4fca997384b4e73903d9b24f25988a5 [id=c9119fbf7e2d463c8b920e390735faba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.527525 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321a88e23e44082a9b28135fd82a226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.527866 5855 tablet_service.cc:1467] Processing CreateTablet for tablet a748402aaacd4253859eb170326b6d72 (DEFAULT_TABLE table=default.Table_0521bf32495649f384dc06bfe6463cb5 [id=fc28dd77f2f7400a94b75d4dc685b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.528163 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a748402aaacd4253859eb170326b6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.528554 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 6788cb3dc4f4430d86171ad81c904d0a (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.528843 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6788cb3dc4f4430d86171ad81c904d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.530730 6132 tablet_service.cc:1467] Processing CreateTablet for tablet a748402aaacd4253859eb170326b6d72 (DEFAULT_TABLE table=default.Table_0521bf32495649f384dc06bfe6463cb5 [id=fc28dd77f2f7400a94b75d4dc685b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.531039 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a748402aaacd4253859eb170326b6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.531483 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 6788cb3dc4f4430d86171ad81c904d0a (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.531792 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6788cb3dc4f4430d86171ad81c904d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.534348 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb865c657b14e61801022f658080afc (DEFAULT_TABLE table=default.Table_0515d5e8afcd4c82b5b1914d2d2740a6 [id=de9cac599714448795a56abae69e87f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.534704 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb865c657b14e61801022f658080afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.534749 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 1287ba419598439d8a5a8997735502ac (DEFAULT_TABLE table=default.Table_7e40eb9b813a4bbcbca8a9779e822a60 [id=967f3d038ed34bbeb87732628992fa14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.535060 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1287ba419598439d8a5a8997735502ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.536559 5817 consensus_peers.cc:487] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.536649 6273 raft_consensus.cc:729] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.536870 6273 consensus_queue.cc:260] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.537552 6273 ts_tablet_manager.cc:1428] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260928 10:44:24.537801 6273 tablet_bootstrap.cc:492] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.538123 5996 tablet_service.cc:1467] Processing CreateTablet for tablet 1287ba419598439d8a5a8997735502ac (DEFAULT_TABLE table=default.Table_7e40eb9b813a4bbcbca8a9779e822a60 [id=967f3d038ed34bbeb87732628992fa14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.538709 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb865c657b14e61801022f658080afc (DEFAULT_TABLE table=default.Table_0515d5e8afcd4c82b5b1914d2d2740a6 [id=de9cac599714448795a56abae69e87f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.539063 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb865c657b14e61801022f658080afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.538993 5990 tablet_service.cc:1467] Processing CreateTablet for tablet 11bfc04f7b754226a484021d98e6b329 (DEFAULT_TABLE table=default.Table_865a5be7cc6a4be0819fef08d263c581 [id=cc6a296c707249018890e75bfed98694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.540154 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1042) took 7029 ms. Trace:
I20260928 10:44:24.540231 6269 rpcz_store.cc:276] 0928 10:44:17.510228 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.510291 (+ 63us) service_pool.cc:227] Handling call
0928 10:44:24.540030 (+7029739us) ts_tablet_manager.cc:1145] Deleting tablet 4706d214d3184f4ebcec28f609b00a53
0928 10:44:24.540043 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.540137 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7029487}
W20260928 10:44:24.540669 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 4706d214d3184f4ebcec28f609b00a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4706d214d3184f4ebcec28f609b00a53 already in progress: creating tablet
I20260928 10:44:24.541424 6273 tablet_bootstrap.cc:654] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.542083 6128 tablet_service.cc:1467] Processing CreateTablet for tablet e4820f15def1402bb23db5db8aafabf5 (DEFAULT_TABLE table=default.Table_3dcf323e6c7d48b887a9a5df83f6fa57 [id=4df0f7dbbb8e4a2dae19f11b36ff95c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.542145 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1043) took 7013 ms. Trace:
I20260928 10:44:24.542181 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb865c657b14e61801022f658080afc (DEFAULT_TABLE table=default.Table_0515d5e8afcd4c82b5b1914d2d2740a6 [id=de9cac599714448795a56abae69e87f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.542222 6269 rpcz_store.cc:276] 0928 10:44:17.528758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.530412 (+ 1654us) service_pool.cc:227] Handling call
0928 10:44:24.542032 (+7011620us) ts_tablet_manager.cc:1145] Deleting tablet 6286ae20ffbe4e24a585f29444acfe17
0928 10:44:24.542041 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.542128 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7011403}
I20260928 10:44:24.542416 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4820f15def1402bb23db5db8aafabf5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.543090 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 6286ae20ffbe4e24a585f29444acfe17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6286ae20ffbe4e24a585f29444acfe17 already in progress: creating tablet
I20260928 10:44:24.543303 5992 tablet_service.cc:1467] Processing CreateTablet for tablet 6788cb3dc4f4430d86171ad81c904d0a (DEFAULT_TABLE table=default.Table_9320d3128971494699408a9aada2c5ef [id=f6c6739f11ea42e198eb3f323e11580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.543460 5983 tablet_service.cc:1467] Processing CreateTablet for tablet a748402aaacd4253859eb170326b6d72 (DEFAULT_TABLE table=default.Table_0521bf32495649f384dc06bfe6463cb5 [id=fc28dd77f2f7400a94b75d4dc685b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.551362 6002 tablet_service.cc:1467] Processing CreateTablet for tablet e4820f15def1402bb23db5db8aafabf5 (DEFAULT_TABLE table=default.Table_3dcf323e6c7d48b887a9a5df83f6fa57 [id=4df0f7dbbb8e4a2dae19f11b36ff95c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.551909 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1287ba419598439d8a5a8997735502ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.552845 6269 tablet_replica.cc:330] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.553050 6269 raft_consensus.cc:2229] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.553211 6269 raft_consensus.cc:2258] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.553990 6269 ts_tablet_manager.cc:1905] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.554143 6275 tablet_bootstrap.cc:492] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.554283 6275 ts_tablet_manager.cc:1397] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.000s
I20260928 10:44:24.555049 6275 raft_consensus.cc:348] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.555368 6275 raft_consensus.cc:374] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.555477 6275 raft_consensus.cc:729] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.555766 6275 consensus_queue.cc:260] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.557544 6275 ts_tablet_manager.cc:1428] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:24.559451 6275 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.559736 5985 tablet_service.cc:1467] Processing CreateTablet for tablet f321a88e23e44082a9b28135fd82a226 (DEFAULT_TABLE table=default.Table_b4fca997384b4e73903d9b24f25988a5 [id=c9119fbf7e2d463c8b920e390735faba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.561139 6275 tablet_bootstrap.cc:654] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.564512 6273 tablet_bootstrap.cc:492] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.564657 6273 ts_tablet_manager.cc:1397] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
W20260928 10:44:24.565987 5955 consensus_peers.cc:487] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.566392 6273 raft_consensus.cc:348] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.566627 6273 raft_consensus.cc:374] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.566686 6273 raft_consensus.cc:729] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.566851 6273 consensus_queue.cc:260] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.567539 6273 ts_tablet_manager.cc:1428] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:24.567793 6273 tablet_bootstrap.cc:492] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.568301 5855 tablet_service.cc:1467] Processing CreateTablet for tablet e4820f15def1402bb23db5db8aafabf5 (DEFAULT_TABLE table=default.Table_3dcf323e6c7d48b887a9a5df83f6fa57 [id=4df0f7dbbb8e4a2dae19f11b36ff95c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.568925 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4820f15def1402bb23db5db8aafabf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.569875 6273 tablet_bootstrap.cc:654] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.573695 5993 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fee86e193447e8cabe5658e0a2a5f (DEFAULT_TABLE table=default.Table_3b99217e4aba47bfa730b2c4a56c269c [id=97d9b3f3cfc742709a2902fec038b5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.575259 5998 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8ac2b0aae9475c910505b38207e113 (DEFAULT_TABLE table=default.Table_db36b67d12bf4dcd8a50c552c5d3d0a6 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.575709 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb (DEFAULT_TABLE table=default.Table_dc60ba66820c465dbc02cdb577f5c4f3 [id=de332402a9e84b81a9951e1ce2c0a330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.577780 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 38326c8e94a84a97a5ecd536c68252dc (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.578750 6270 ts_tablet_manager.cc:1918] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:24.579661 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 38326c8e94a84a97a5ecd536c68252dc (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.581185 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8ac2b0aae9475c910505b38207e113 (DEFAULT_TABLE table=default.Table_db36b67d12bf4dcd8a50c552c5d3d0a6 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.581499 5857 tablet_service.cc:1467] Processing CreateTablet for tablet 38326c8e94a84a97a5ecd536c68252dc (DEFAULT_TABLE table=default.Table_db76dbab7ae943c08f4ea4e705e48e5e [id=02cf4df041a744349efe5d92658bac86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.581605 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8ac2b0aae9475c910505b38207e113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.581815 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38326c8e94a84a97a5ecd536c68252dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.580817 5955 consensus_peers.cc:487] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.582048 6270 log.cc:1196] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/a908ac5d44a74c05b35f6853ab769d91
I20260928 10:44:24.582408 6270 ts_tablet_manager.cc:1939] T a908ac5d44a74c05b35f6853ab769d91 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.581220 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb (DEFAULT_TABLE table=default.Table_dc60ba66820c465dbc02cdb577f5c4f3 [id=de332402a9e84b81a9951e1ce2c0a330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.582708 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.582816 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fee86e193447e8cabe5658e0a2a5f (DEFAULT_TABLE table=default.Table_3b99217e4aba47bfa730b2c4a56c269c [id=97d9b3f3cfc742709a2902fec038b5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.583093 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fee86e193447e8cabe5658e0a2a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.583787 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb (DEFAULT_TABLE table=default.Table_dc60ba66820c465dbc02cdb577f5c4f3 [id=de332402a9e84b81a9951e1ce2c0a330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.584237 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 84dd90da33484afab6b5de01ed9950d6 (DEFAULT_TABLE table=default.Table_46d70ac8178548fabc14a33e77d1bc5c [id=c093d2667d7544318452376edf6e51ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.584339 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8ac2b0aae9475c910505b38207e113 (DEFAULT_TABLE table=default.Table_db36b67d12bf4dcd8a50c552c5d3d0a6 [id=524b640779de4c3aa3a2ff75502a1cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.584596 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38326c8e94a84a97a5ecd536c68252dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.584947 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fee86e193447e8cabe5658e0a2a5f (DEFAULT_TABLE table=default.Table_3b99217e4aba47bfa730b2c4a56c269c [id=97d9b3f3cfc742709a2902fec038b5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.585120 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84dd90da33484afab6b5de01ed9950d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.585364 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.590999 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fee86e193447e8cabe5658e0a2a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.591459 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 84dd90da33484afab6b5de01ed9950d6 (DEFAULT_TABLE table=default.Table_46d70ac8178548fabc14a33e77d1bc5c [id=c093d2667d7544318452376edf6e51ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.594934 8077 raft_consensus.cc:482] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.595078 8077 raft_consensus.cc:504] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.595613 8077 leader_election.cc:288] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.596263 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.597000 5995 tablet_service.cc:1467] Processing CreateTablet for tablet be3ba1abb7c94de6adb97f77c02121b3 (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.597224 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 84dd90da33484afab6b5de01ed9950d6 (DEFAULT_TABLE table=default.Table_46d70ac8178548fabc14a33e77d1bc5c [id=c093d2667d7544318452376edf6e51ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.597515 6117 tablet_service.cc:1467] Processing CreateTablet for tablet be3ba1abb7c94de6adb97f77c02121b3 (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.597790 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84dd90da33484afab6b5de01ed9950d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.598037 6127 tablet_service.cc:1467] Processing CreateTablet for tablet f5490b15e2f74299a27ba37c22971f79 (DEFAULT_TABLE table=default.Table_8a230d3aa7424bef90d2adb952790fe6 [id=3118cedbe7a34bbabd396791f41a0a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.598604 5989 tablet_service.cc:1467] Processing CreateTablet for tablet f5490b15e2f74299a27ba37c22971f79 (DEFAULT_TABLE table=default.Table_8a230d3aa7424bef90d2adb952790fe6 [id=3118cedbe7a34bbabd396791f41a0a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.598970 5863 tablet_service.cc:1467] Processing CreateTablet for tablet be3ba1abb7c94de6adb97f77c02121b3 (DEFAULT_TABLE table=default.Table_1778b0bdcd7d47d391f0e2dde52a7f6d [id=d2a38cd0086a4e008f0406a7f6b9bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.581506 6269 ts_tablet_manager.cc:1918] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:24.599498 6269 log.cc:1196] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/2d71edffecf044ba9cec14a70683a56f
I20260928 10:44:24.599542 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3ba1abb7c94de6adb97f77c02121b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.599720 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3ba1abb7c94de6adb97f77c02121b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.600996 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5490b15e2f74299a27ba37c22971f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.601123 6269 ts_tablet_manager.cc:1939] T 2d71edffecf044ba9cec14a70683a56f P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.604120 6275 tablet_bootstrap.cc:492] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.604254 6275 ts_tablet_manager.cc:1397] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260928 10:44:24.604954 6275 raft_consensus.cc:348] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.605155 6275 raft_consensus.cc:374] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.605203 6275 raft_consensus.cc:729] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.605425 6275 consensus_queue.cc:260] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.606637 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8ac2b0aae9475c910505b38207e113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.607267 6275 ts_tablet_manager.cc:1428] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:24.608615 6275 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.610692 6121 tablet_service.cc:1467] Processing CreateTablet for tablet d89973e6913244068c33fbca3dab6f0c (DEFAULT_TABLE table=default.Table_84723497434e4863be28332667fc4f66 [id=6b7bc8eda47e4b48b901ac103b6002f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.611086 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89973e6913244068c33fbca3dab6f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.612490 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 11bfc04f7b754226a484021d98e6b329 (DEFAULT_TABLE table=default.Table_865a5be7cc6a4be0819fef08d263c581 [id=cc6a296c707249018890e75bfed98694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.612843 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11bfc04f7b754226a484021d98e6b329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.615505 5862 tablet_service.cc:1467] Processing CreateTablet for tablet f5490b15e2f74299a27ba37c22971f79 (DEFAULT_TABLE table=default.Table_8a230d3aa7424bef90d2adb952790fe6 [id=3118cedbe7a34bbabd396791f41a0a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.615911 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5490b15e2f74299a27ba37c22971f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.617179 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1044) took 7083 ms. Trace:
W20260928 10:44:24.622911 5955 consensus_peers.cc:487] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.617343 6269 rpcz_store.cc:276] 0928 10:44:17.534219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.534281 (+ 62us) service_pool.cc:227] Handling call
0928 10:44:24.552791 (+7018510us) ts_tablet_manager.cc:1145] Deleting tablet 2d71edffecf044ba9cec14a70683a56f
0928 10:44:24.552802 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.566451 (+ 13649us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.581407 (+ 14956us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.617156 (+ 35749us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7018315}
I20260928 10:44:24.625381 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 2d71edffecf044ba9cec14a70683a56f (table default.Table_47dbd199fad2491596114b4eefdb2b68 [id=b79d417448e74edd9a9155b79a77f61c]) successfully deleted
I20260928 10:44:24.625865 6269 tablet_replica.cc:330] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.626142 6269 raft_consensus.cc:2229] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.626420 6269 raft_consensus.cc:2258] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.627064 5997 tablet_service.cc:1467] Processing CreateTablet for tablet d89973e6913244068c33fbca3dab6f0c (DEFAULT_TABLE table=default.Table_84723497434e4863be28332667fc4f66 [id=6b7bc8eda47e4b48b901ac103b6002f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.627609 6269 ts_tablet_manager.cc:1905] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.631794 6275 tablet_bootstrap.cc:654] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:24.632373 5689 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7f8389880591441a9c2aabf22d67005f (table default.Table_24cd9b070a6143739a36e9e9670978e1 [id=8ae8d1a492204e2b9d15a82b63dbf67c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f8389880591441a9c2aabf22d67005f consensus state has no leader
I20260928 10:44:24.632854 5864 tablet_service.cc:1467] Processing CreateTablet for tablet d89973e6913244068c33fbca3dab6f0c (DEFAULT_TABLE table=default.Table_84723497434e4863be28332667fc4f66 [id=6b7bc8eda47e4b48b901ac103b6002f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.633301 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89973e6913244068c33fbca3dab6f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.633595 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 15811b6c980c467caeec2c2a253d4831 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.633944 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15811b6c980c467caeec2c2a253d4831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.643783 5987 tablet_service.cc:1467] Processing CreateTablet for tablet 15811b6c980c467caeec2c2a253d4831 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.642517 8077 raft_consensus.cc:482] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.644721 8077 raft_consensus.cc:504] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.645408 8077 leader_election.cc:288] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.646158 5700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 741ca8fa10bb47efbd5d6a95d30f1987
I20260928 10:44:24.646600 5700 catalog_manager.cc:6565] ReplaceTablet: tablet 741ca8fa10bb47efbd5d6a95d30f1987 deleted and replaced by tablet 2f26bfa078c24157b61c8d0cafc28cfa
I20260928 10:44:24.646695 5700 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:45112 (request call id 1575) took 1056 ms. Trace:
I20260928 10:44:24.646759 5700 rpcz_store.cc:276] 0928 10:44:23.590743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:23.594209 (+ 3466us) service_pool.cc:227] Handling call
0928 10:44:24.646679 (+1052470us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.503885 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.504042 (+ 157us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.504049 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:24.504051 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:24.504197 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.504213 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.504219 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.504334 (+ 115us) tablet.cc:699] Row locks acquired
0928 10:44:24.504337 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:24.504389 (+ 52us) write_op.cc:270] Start()
0928 10:44:24.504450 (+ 61us) write_op.cc:276] Timestamp: P: 1790592264504364 usec, L: 0
0928 10:44:24.504454 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.640350 (+135896us) log.cc:842] Serialized 625 byte log entry
0928 10:44:24.640587 (+ 237us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6d8ad6d02 00007fa6d9e097f1 00007fa6d9e08359 00007fa6d9e101bb 00007fa6d9e10038 00000000009edb7c 00007fa6cd60e344 00007fa6cd61191b 00007fa6cd611798 00000000009edb7c
0928 10:44:24.644757 (+ 4170us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.644950 (+ 193us) write_op.cc:301] APPLY: starting
0928 10:44:24.644967 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.645015 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.645018 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.645133 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.645195 (+ 62us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:24.645201 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:24.645283 (+ 82us) log.cc:842] Serialized 29 byte log entry
0928 10:44:24.645352 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.645375 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:24.645382 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:24.645443 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.645447 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":149,"apply.run_cpu_time_us":565,"apply.run_wall_time_us":565,"num_ops":2,"prepare.queue_time_us":194592,"prepare.run_cpu_time_us":1232,"prepare.run_wall_time_us":136797,"raft.queue_time_us":1981,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":259,"replication_time_us":140279,"spinlock_wait_cycles":311927168}]]}
I20260928 10:44:24.648433 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 11b732758c1f4565b3051309cdfd9649
I20260928 10:44:24.648839 5694 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1583) took 1011 ms. Trace:
I20260928 10:44:24.648928 5694 rpcz_store.cc:276] 0928 10:44:23.637757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:23.915214 (+277457us) service_pool.cc:227] Handling call
0928 10:44:23.921939 (+ 6725us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05ff2e6 00007fa6d78f2126 00007fa6d78f1e55 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:23.922460 (+ 521us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:23.922606 (+ 146us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:23.922682 (+ 76us) catalog_manager.cc:2761] Locking tablets
0928 10:44:24.309051 (+386369us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:24.648275 (+339224us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:24.648356 (+ 81us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:24.648405 (+ 49us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:24.648822 (+ 417us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.640719 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.640845 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.640852 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:24.640855 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:24.640980 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.640993 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.640998 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.641108 (+ 110us) tablet.cc:699] Row locks acquired
0928 10:44:24.641111 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:24.641151 (+ 40us) write_op.cc:270] Start()
0928 10:44:24.641189 (+ 38us) write_op.cc:276] Timestamp: P: 1790592264641115 usec, L: 0
0928 10:44:24.641192 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.641369 (+ 177us) log.cc:842] Serialized 759 byte log entry
0928 10:44:24.644813 (+ 3444us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.645547 (+ 734us) write_op.cc:301] APPLY: starting
0928 10:44:24.645559 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.645595 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.645619 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.645681 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.645710 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:24.645716 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:24.645777 (+ 61us) log.cc:842] Serialized 29 byte log entry
0928 10:44:24.645823 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.645839 (+ 16us) write_op.cc:454] Released schema lock
0928 10:44:24.645844 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:24.645888 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.645891 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":14745984,"child_traces":[["op",{"apply.queue_time_us":707,"apply.run_cpu_time_us":383,"apply.run_wall_time_us":382,"num_ops":2,"prepare.queue_time_us":331137,"raft.queue_time_us":686,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":3609}]]}
I20260928 10:44:24.649888 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f26bfa078c24157b61c8d0cafc28cfa) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.650332 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 11b732758c1f4565b3051309cdfd9649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.650653 5859 tablet_service.cc:1514] Processing DeleteTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f26bfa078c24157b61c8d0cafc28cfa) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.651268 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 11b732758c1f4565b3051309cdfd9649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.652647 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 11b732758c1f4565b3051309cdfd9649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.652930 6132 tablet_service.cc:1514] Processing DeleteTablet for tablet 741ca8fa10bb47efbd5d6a95d30f1987 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f26bfa078c24157b61c8d0cafc28cfa) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.653211 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 21f095310a064632a4f9a573555bef42 (DEFAULT_TABLE table=default.Table_75f0017090af4347873c9c9e1c58b081 [id=134821f06cc74b589860ed34de408f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.653201 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 21f095310a064632a4f9a573555bef42 (DEFAULT_TABLE table=default.Table_75f0017090af4347873c9c9e1c58b081 [id=134821f06cc74b589860ed34de408f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.653664 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f095310a064632a4f9a573555bef42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.654737 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d71edffecf044ba9cec14a70683a56f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.654924 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 21f095310a064632a4f9a573555bef42 (DEFAULT_TABLE table=default.Table_75f0017090af4347873c9c9e1c58b081 [id=134821f06cc74b589860ed34de408f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.655352 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f095310a064632a4f9a573555bef42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.655499 5932 tablet.cc:2369] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:44:24.652863 6117 tablet_service.cc:1467] Processing CreateTablet for tablet 15811b6c980c467caeec2c2a253d4831 (DEFAULT_TABLE table=default.Table_942a770217f24831a97388ce947c5ae6 [id=b8c3947b91cd44408ca135a953b8f6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.658970 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15811b6c980c467caeec2c2a253d4831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.660737 8120 tablet_replica.cc:330] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:24.660956 8120 raft_consensus.cc:2229] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:24.661190 8120 pending_rounds.cc:62] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Trying to abort 1 pending ops.
I20260928 10:44:24.661235 8120 pending_rounds.cc:68] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334265913352429568 op_type: NO_OP noop_request { }
I20260928 10:44:24.661351 8120 raft_consensus.cc:2866] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 10:44:24.661424 8120 raft_consensus.cc:2258] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.662384 5883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c67a02d7f84bed9c440c8c451ea4ff" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:24.661430 6132 tablet_service.cc:1467] Processing CreateTablet for tablet c3a298842895457e8bf5244a952f07ca (DEFAULT_TABLE table=default.Table_ea5480bdc0a1454a9886641ff125cd07 [id=e1066904f2f94af39dd949f56cbc6803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.663161 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a298842895457e8bf5244a952f07ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.666572 5988 tablet_service.cc:1467] Processing CreateTablet for tablet c3a298842895457e8bf5244a952f07ca (DEFAULT_TABLE table=default.Table_ea5480bdc0a1454a9886641ff125cd07 [id=e1066904f2f94af39dd949f56cbc6803]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:24.669041 5817 consensus_peers.cc:487] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.670390 5862 tablet_service.cc:1467] Processing CreateTablet for tablet c3a298842895457e8bf5244a952f07ca (DEFAULT_TABLE table=default.Table_ea5480bdc0a1454a9886641ff125cd07 [id=e1066904f2f94af39dd949f56cbc6803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.671042 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a298842895457e8bf5244a952f07ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.676700 5955 consensus_peers.cc:487] T 57b7976063024775b9dde91b32010754 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.676949 6275 tablet_bootstrap.cc:492] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.677112 6275 ts_tablet_manager.cc:1397] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.004s
I20260928 10:44:24.677892 6275 raft_consensus.cc:348] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.678174 6275 raft_consensus.cc:374] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.678277 6275 raft_consensus.cc:729] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.678553 6275 consensus_queue.cc:260] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.679152 6275 ts_tablet_manager.cc:1428] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.679464 6275 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.679555 8120 ts_tablet_manager.cc:1905] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.680073 6269 ts_tablet_manager.cc:1918] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:24.680244 6269 log.cc:1196] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/503a4bcb9d37441aadf66b45238a3737
I20260928 10:44:24.680615 6269 ts_tablet_manager.cc:1939] T 503a4bcb9d37441aadf66b45238a3737 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.681020 6275 tablet_bootstrap.cc:654] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.681401 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1045) took 7146 ms. Trace:
I20260928 10:44:24.681535 6269 rpcz_store.cc:276] 0928 10:44:17.534692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.534733 (+ 41us) service_pool.cc:227] Handling call
0928 10:44:24.625808 (+7091075us) ts_tablet_manager.cc:1145] Deleting tablet 503a4bcb9d37441aadf66b45238a3737
0928 10:44:24.625821 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.675106 (+ 49285us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.679980 (+ 4874us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.681381 (+ 1401us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7090937}
I20260928 10:44:24.682068 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 503a4bcb9d37441aadf66b45238a3737 (table default.Table_bcf12c0441964bec8f8b7d378ca8977f [id=9efb880407fa43a4afcbdff554229099]) successfully deleted
I20260928 10:44:24.682431 6269 tablet_replica.cc:330] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.682528 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 7f51e18a5e1240e4a41ce157506405f2 (DEFAULT_TABLE table=default.Table_9e2edac220624ab4aedc351ce5014443 [id=9da0c71ddf544e6ab67747cd3acd3b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.682688 6269 raft_consensus.cc:2229] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.682824 6269 raft_consensus.cc:2258] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.682664 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_34c613e66020489d863dbf677a70dc87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:24.683229 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c613e66020489d863dbf677a70dc87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:24.683866 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 7f51e18a5e1240e4a41ce157506405f2 (DEFAULT_TABLE table=default.Table_9e2edac220624ab4aedc351ce5014443 [id=9da0c71ddf544e6ab67747cd3acd3b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.684223 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f51e18a5e1240e4a41ce157506405f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.686965 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:24.687374 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (table default.Table_02f5489736974455aefc7ae3da68ae7e [id=5b8a74dc9dfd4b2685d2d688454e9670]). Expected version 1 got 0
I20260928 10:44:24.687712 5700 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:24.690685 6269 ts_tablet_manager.cc:1905] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.691366 5990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11bfc04f7b754226a484021d98e6b329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.694900 5994 tablet_service.cc:1467] Processing CreateTablet for tablet b6a49666ec2045859cb9c350c997d866 (DEFAULT_TABLE table=default.Table_b00a13cb5f4341668a185c768b9975b8 [id=d7f403756749455b8dd53cb8c64aeec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.695262 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a49666ec2045859cb9c350c997d866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.695482 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb865c657b14e61801022f658080afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.697817 6271 tablet_bootstrap.cc:492] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.697945 6271 ts_tablet_manager.cc:1397] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.409s user 0.078s sys 0.084s
I20260928 10:44:24.698747 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6788cb3dc4f4430d86171ad81c904d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.698660 6271 raft_consensus.cc:348] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.698879 6271 raft_consensus.cc:374] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.698941 6002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4820f15def1402bb23db5db8aafabf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.699142 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a748402aaacd4253859eb170326b6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.698941 6271 raft_consensus.cc:729] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.700016 6271 consensus_queue.cc:260] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.700551 6271 ts_tablet_manager.cc:1428] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 10:44:24.700796 6271 tablet_bootstrap.cc:492] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.702095 6271 tablet_bootstrap.cc:654] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.681397 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 7f51e18a5e1240e4a41ce157506405f2 (DEFAULT_TABLE table=default.Table_9e2edac220624ab4aedc351ce5014443 [id=9da0c71ddf544e6ab67747cd3acd3b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.690801 6117 tablet_service.cc:1467] Processing CreateTablet for tablet b6a49666ec2045859cb9c350c997d866 (DEFAULT_TABLE table=default.Table_b00a13cb5f4341668a185c768b9975b8 [id=d7f403756749455b8dd53cb8c64aeec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.704007 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a49666ec2045859cb9c350c997d866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.704564 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f51e18a5e1240e4a41ce157506405f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.705389 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 97a712acdf07471d926721a7a492cd58 (DEFAULT_TABLE table=default.Table_368933fff1624ef4b64b1f8a83225d10 [id=061f7997b30c457c992c0fdcbf195e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.705691 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a712acdf07471d926721a7a492cd58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.693397 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 97a712acdf07471d926721a7a492cd58 (DEFAULT_TABLE table=default.Table_368933fff1624ef4b64b1f8a83225d10 [id=061f7997b30c457c992c0fdcbf195e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.696151 6121 tablet_service.cc:1467] Processing CreateTablet for tablet ad53c012de514392a00e5cb02513bae7 (DEFAULT_TABLE table=default.Table_a8f8fd63ec8243e8b89da30593662165 [id=f9d422bea2aa4baeb3f4096cb2491b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.709673 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a712acdf07471d926721a7a492cd58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.709879 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad53c012de514392a00e5cb02513bae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.712329 5983 tablet_service.cc:1467] Processing CreateTablet for tablet ad53c012de514392a00e5cb02513bae7 (DEFAULT_TABLE table=default.Table_a8f8fd63ec8243e8b89da30593662165 [id=f9d422bea2aa4baeb3f4096cb2491b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.699652 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 8a88bb3fb1a842b69f120ee67a517563 (DEFAULT_TABLE table=default.Table_76e6f3d32aff4e74a39a388e9207c0fc [id=3800e446600748a19e8bcd2f47bbe2e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.712729 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad53c012de514392a00e5cb02513bae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.712921 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a88bb3fb1a842b69f120ee67a517563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.716106 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 8a88bb3fb1a842b69f120ee67a517563 (DEFAULT_TABLE table=default.Table_76e6f3d32aff4e74a39a388e9207c0fc [id=3800e446600748a19e8bcd2f47bbe2e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.716513 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a88bb3fb1a842b69f120ee67a517563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.717041 6150 raft_consensus.cc:3037] T f5a00b74133a406996820adcb71194df P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.724052 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fee86e193447e8cabe5658e0a2a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.726720 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8ac2b0aae9475c910505b38207e113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.697693 5859 tablet_service.cc:1467] Processing CreateTablet for tablet ad53c012de514392a00e5cb02513bae7 (DEFAULT_TABLE table=default.Table_a8f8fd63ec8243e8b89da30593662165 [id=f9d422bea2aa4baeb3f4096cb2491b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.702442 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 97a712acdf07471d926721a7a492cd58 (DEFAULT_TABLE table=default.Table_368933fff1624ef4b64b1f8a83225d10 [id=061f7997b30c457c992c0fdcbf195e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.730755 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700cb1dcaf2418d81b0fd9cbd65cdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.730773 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97a712acdf07471d926721a7a492cd58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.730964 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84dd90da33484afab6b5de01ed9950d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.731295 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1250) took 3247 ms. Trace:
I20260928 10:44:24.731386 6270 rpcz_store.cc:276] 0928 10:44:21.483917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.483990 (+ 73us) service_pool.cc:227] Handling call
0928 10:44:24.440101 (+2956111us) ts_tablet_manager.cc:1145] Deleting tablet a908ac5d44a74c05b35f6853ab769d91
0928 10:44:24.440111 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.513386 (+ 73275us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.578646 (+ 65260us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.731275 (+152629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941560}
I20260928 10:44:24.731711 6270 tablet_replica.cc:330] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:24.731882 6270 raft_consensus.cc:2229] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:24.732030 6270 raft_consensus.cc:2258] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.732525 6270 ts_tablet_manager.cc:1905] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.734743 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be3ba1abb7c94de6adb97f77c02121b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.737859 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321a88e23e44082a9b28135fd82a226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.738382 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5490b15e2f74299a27ba37c22971f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.738620 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21f095310a064632a4f9a573555bef42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.738790 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f51e18a5e1240e4a41ce157506405f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.739140 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38326c8e94a84a97a5ecd536c68252dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.742616 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a298842895457e8bf5244a952f07ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.742815 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15811b6c980c467caeec2c2a253d4831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.744977 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet a908ac5d44a74c05b35f6853ab769d91 (table default.Table_2fbadc72e6434348aedb000cdb6b9579 [id=48f06cee1ca2460cad2383e5bbfb83ea]) successfully deleted
I20260928 10:44:24.746608 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89973e6913244068c33fbca3dab6f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.750818 7958 raft_consensus.cc:482] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.751014 7958 raft_consensus.cc:504] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.751609 7958 leader_election.cc:288] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.754274 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c48b8a7efa41a684205df3e6969370" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.754945 5817 leader_election.cc:341] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.760347 6270 ts_tablet_manager.cc:1918] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.760771 6270 log.cc:1196] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/75539c390965493eaa69a0d1215fa922
I20260928 10:44:24.761178 6270 ts_tablet_manager.cc:1939] T 75539c390965493eaa69a0d1215fa922 P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:24.762790 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1248) took 3279 ms. Trace:
I20260928 10:44:24.763101 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad53c012de514392a00e5cb02513bae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.763396 7958 raft_consensus.cc:482] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.763545 7958 raft_consensus.cc:504] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.764118 7958 leader_election.cc:288] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.764811 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.765389 5817 leader_election.cc:341] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.766268 6269 ts_tablet_manager.cc:1918] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:24.767630 6132 tablet_service.cc:1467] Processing CreateTablet for tablet e3fbb4cef12e4f41a0f9adba42af54f0 (DEFAULT_TABLE table=default.Table_4baa3fa5bf1142a283ad2ebced810d54 [id=635f2a9f6a084d6a8b9e0bb98159eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.768075 6270 rpcz_store.cc:276] 0928 10:44:21.483727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.484093 (+ 366us) service_pool.cc:227] Handling call
0928 10:44:24.731675 (+3247582us) ts_tablet_manager.cc:1145] Deleting tablet 75539c390965493eaa69a0d1215fa922
0928 10:44:24.731685 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.756446 (+ 24761us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.760243 (+ 3797us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.762768 (+ 2525us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3233085}
I20260928 10:44:24.729803 5862 tablet_service.cc:1467] Processing CreateTablet for tablet 8a88bb3fb1a842b69f120ee67a517563 (DEFAULT_TABLE table=default.Table_76e6f3d32aff4e74a39a388e9207c0fc [id=3800e446600748a19e8bcd2f47bbe2e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.770345 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a88bb3fb1a842b69f120ee67a517563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.770820 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fbb4cef12e4f41a0f9adba42af54f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.771967 5955 consensus_peers.cc:487] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.772184 5989 tablet_service.cc:1467] Processing CreateTablet for tablet e3fbb4cef12e4f41a0f9adba42af54f0 (DEFAULT_TABLE table=default.Table_4baa3fa5bf1142a283ad2ebced810d54 [id=635f2a9f6a084d6a8b9e0bb98159eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.772580 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 75539c390965493eaa69a0d1215fa922 (table default.Table_5199c77c44b746dba7428ddc716b0da3 [id=b74cd22518f44206ba964136bb12f3a8]) successfully deleted
I20260928 10:44:24.772750 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fbb4cef12e4f41a0f9adba42af54f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.773243 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1251) took 3281 ms. Trace:
W20260928 10:44:24.780239 5955 consensus_peers.cc:487] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.782338 5863 tablet_service.cc:1467] Processing CreateTablet for tablet e3fbb4cef12e4f41a0f9adba42af54f0 (DEFAULT_TABLE table=default.Table_4baa3fa5bf1142a283ad2ebced810d54 [id=635f2a9f6a084d6a8b9e0bb98159eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.782303 6270 rpcz_store.cc:276] 0928 10:44:21.491721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.491785 (+ 64us) service_pool.cc:227] Handling call
0928 10:44:24.773119 (+3281334us) ts_tablet_manager.cc:1145] Deleting tablet 1e22a551121d4d6abb7f43b4bb4d6e06
0928 10:44:24.773131 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.773227 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3274412}
I20260928 10:44:24.782748 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fbb4cef12e4f41a0f9adba42af54f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.782930 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 1e22a551121d4d6abb7f43b4bb4d6e06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e22a551121d4d6abb7f43b4bb4d6e06 already in progress: creating tablet
I20260928 10:44:24.784216 6125 tablet_service.cc:1467] Processing CreateTablet for tablet 39cd8aae36784589a3b678eb4fcdb5bf (DEFAULT_TABLE table=default.Table_43b0d7ede61447d2af06a56ea5c886b0 [id=9176ebf190d144cfa2760ba80267377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.784571 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cd8aae36784589a3b678eb4fcdb5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.791925 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1253) took 3239 ms. Trace:
I20260928 10:44:24.792033 6270 rpcz_store.cc:276] 0928 10:44:21.552284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.554216 (+ 1932us) service_pool.cc:227] Handling call
0928 10:44:24.791779 (+3237563us) ts_tablet_manager.cc:1145] Deleting tablet 7adcdfdbeb074696a1081d7eb5d96926
0928 10:44:24.791792 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.791892 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3237379}
W20260928 10:44:24.792454 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 7adcdfdbeb074696a1081d7eb5d96926 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7adcdfdbeb074696a1081d7eb5d96926 already in progress: creating tablet
I20260928 10:44:24.793718 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 39cd8aae36784589a3b678eb4fcdb5bf (DEFAULT_TABLE table=default.Table_43b0d7ede61447d2af06a56ea5c886b0 [id=9176ebf190d144cfa2760ba80267377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.794119 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cd8aae36784589a3b678eb4fcdb5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.800433 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1252) took 3248 ms. Trace:
I20260928 10:44:24.800237 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 39cd8aae36784589a3b678eb4fcdb5bf (DEFAULT_TABLE table=default.Table_43b0d7ede61447d2af06a56ea5c886b0 [id=9176ebf190d144cfa2760ba80267377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.800563 6270 rpcz_store.cc:276] 0928 10:44:21.552146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.554542 (+ 2396us) service_pool.cc:227] Handling call
0928 10:44:24.800285 (+3245743us) ts_tablet_manager.cc:1145] Deleting tablet d837b4e19de9467082a1578b292792e6
0928 10:44:24.800299 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.800411 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3245574}
W20260928 10:44:24.801045 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet d837b4e19de9467082a1578b292792e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d837b4e19de9467082a1578b292792e6 already in progress: creating tablet
I20260928 10:44:24.801239 5702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 45b2c0fdd8ee43d6a7b47b01583332c2
I20260928 10:44:24.801424 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39cd8aae36784589a3b678eb4fcdb5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.801678 5702 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1576) took 1185 ms. Trace:
I20260928 10:44:24.802052 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.801764 5702 rpcz_store.cc:276] 0928 10:44:23.616056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:23.619606 (+ 3550us) service_pool.cc:227] Handling call
0928 10:44:23.620201 (+ 595us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:23.620410 (+ 209us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:23.620476 (+ 66us) catalog_manager.cc:2761] Locking tablets
0928 10:44:24.309722 (+689246us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:24.801072 (+491350us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:24.801162 (+ 90us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:24.801208 (+ 46us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:24.801661 (+ 453us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.689042 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.689147 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.689153 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:24.689156 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:24.689316 (+ 160us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.689330 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.689335 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.791380 (+102045us) tablet.cc:699] Row locks acquired
0928 10:44:24.791383 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:24.791442 (+ 59us) write_op.cc:270] Start()
0928 10:44:24.791483 (+ 41us) write_op.cc:276] Timestamp: P: 1790592264791392 usec, L: 0
0928 10:44:24.791487 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.791690 (+ 203us) log.cc:842] Serialized 728 byte log entry
0928 10:44:24.794565 (+ 2875us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.799915 (+ 5350us) write_op.cc:301] APPLY: starting
0928 10:44:24.799934 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.799984 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.800009 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.800096 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.800136 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:24.800143 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:24.800226 (+ 83us) log.cc:842] Serialized 29 byte log entry
0928 10:44:24.800313 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.800337 (+ 24us) write_op.cc:454] Released schema lock
0928 10:44:24.800346 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:24.800421 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.800424 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5300,"apply.run_cpu_time_us":567,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":378784,"prepare.run_cpu_time_us":907,"prepare.run_wall_time_us":106968,"raft.queue_time_us":364,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":241,"replication_time_us":3055}]]}
I20260928 10:44:24.804086 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 7ed0451e509d4580be284739255821e2
I20260928 10:44:24.804510 5693 catalog_manager.cc:6565] ReplaceTablet: tablet 7ed0451e509d4580be284739255821e2 deleted and replaced by tablet b28b055198124251bd497d4f1cb65739
I20260928 10:44:24.804616 5693 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:45112 (request call id 1588) took 1086 ms. Trace:
I20260928 10:44:24.805009 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed0451e509d4580be284739255821e2 with delete_type TABLET_DATA_DELETED (replaced by tablet b28b055198124251bd497d4f1cb65739) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:24.804690 5693 rpcz_store.cc:276] 0928 10:44:23.718083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.074656 (+356573us) service_pool.cc:227] Handling call
0928 10:44:24.153659 (+ 79003us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e060a527 00007fa6d78fcda7 00007fa6d78fcad5 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.804599 (+650940us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.796041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.796160 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.796167 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:24.796170 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:24.796292 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.796304 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.796309 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.796386 (+ 77us) tablet.cc:699] Row locks acquired
0928 10:44:24.796389 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:24.796427 (+ 38us) write_op.cc:270] Start()
0928 10:44:24.796458 (+ 31us) write_op.cc:276] Timestamp: P: 1790592264796378 usec, L: 0
0928 10:44:24.796461 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.796641 (+ 180us) log.cc:842] Serialized 625 byte log entry
0928 10:44:24.799773 (+ 3132us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.800514 (+ 741us) write_op.cc:301] APPLY: starting
0928 10:44:24.800526 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.800564 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.800586 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.800688 (+ 102us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.800753 (+ 65us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:24.800759 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:24.800824 (+ 65us) log.cc:842] Serialized 29 byte log entry
0928 10:44:24.800883 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.800901 (+ 18us) write_op.cc:454] Released schema lock
0928 10:44:24.800907 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:24.800961 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.800964 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":180633344,"child_traces":[["op",{"apply.queue_time_us":700,"apply.run_cpu_time_us":495,"apply.run_wall_time_us":495,"num_ops":2,"prepare.queue_time_us":483168,"raft.queue_time_us":32,"replication_time_us":3289}]]}
I20260928 10:44:24.805272 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet d5da28a9cb2f49639abc40b5208a96b7 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:24.806814 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1254) took 3213 ms. Trace:
I20260928 10:44:24.807132 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.807252 6127 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed0451e509d4580be284739255821e2 with delete_type TABLET_DATA_DELETED (replaced by tablet b28b055198124251bd497d4f1cb65739) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.811499 5858 tablet_service.cc:1467] Processing CreateTablet for tablet f82f8de727ab4eacab84e73e6a4a7cee (DEFAULT_TABLE table=default.Table_f3c7ad9611054c3d92b93aee18e7e70b [id=cb1a7c9629ca4e7c95016a1b553752cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.811941 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82f8de727ab4eacab84e73e6a4a7cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.812132 6127 tablet_service.cc:1467] Processing CreateTablet for tablet cfb52e940aed4169a9edd2e4c6bacade (DEFAULT_TABLE table=default.Table_0b8767ef9ec3453bbe858244b9c284b7 [id=e3411b684164439bbf1f70cb3dadc909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.812530 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb52e940aed4169a9edd2e4c6bacade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.807005 6270 rpcz_store.cc:276] 0928 10:44:21.593557 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.593618 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:24.806592 (+3212974us) ts_tablet_manager.cc:1145] Deleting tablet c1ffbf968fc7478b99ca11e307398363
0928 10:44:24.806606 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.806793 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3212780}
I20260928 10:44:24.809077 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed0451e509d4580be284739255821e2 with delete_type TABLET_DATA_DELETED (replaced by tablet b28b055198124251bd497d4f1cb65739) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:24.814059 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c1ffbf968fc7478b99ca11e307398363 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1ffbf968fc7478b99ca11e307398363 already in progress: creating tablet
I20260928 10:44:24.809122 5995 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:23 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.769924 6269 log.cc:1196] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/22f47338950743eb8a06e779a3ca5c69
I20260928 10:44:24.814582 6269 ts_tablet_manager.cc:1939] T 22f47338950743eb8a06e779a3ca5c69 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:24.815395 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1046) took 7280 ms. Trace:
I20260928 10:44:24.815480 6269 rpcz_store.cc:276] 0928 10:44:17.535112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.535159 (+ 47us) service_pool.cc:227] Handling call
0928 10:44:24.682386 (+7147227us) ts_tablet_manager.cc:1145] Deleting tablet 22f47338950743eb8a06e779a3ca5c69
0928 10:44:24.682398 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.749237 (+ 66839us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.766181 (+ 16944us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:24.815375 (+ 49194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7147077}
I20260928 10:44:24.815873 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 22f47338950743eb8a06e779a3ca5c69 (table default.Table_ccf58bc5a32444a6a9eb4ee2e6178b6d [id=338060758dcb4f57bde86aa3da0dce31]) successfully deleted
I20260928 10:44:24.816676 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1256) took 2987 ms. Trace:
I20260928 10:44:24.816792 6270 rpcz_store.cc:276] 0928 10:44:21.829540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.829608 (+ 68us) service_pool.cc:227] Handling call
0928 10:44:24.816547 (+2986939us) ts_tablet_manager.cc:1145] Deleting tablet 10ab23279fec4478be7031ae1c79d074
0928 10:44:24.816561 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.816658 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2986715}
W20260928 10:44:24.817207 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 10ab23279fec4478be7031ae1c79d074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10ab23279fec4478be7031ae1c79d074 already in progress: creating tablet
I20260928 10:44:24.809691 5985 tablet_service.cc:1467] Processing CreateTablet for tablet f82f8de727ab4eacab84e73e6a4a7cee (DEFAULT_TABLE table=default.Table_f3c7ad9611054c3d92b93aee18e7e70b [id=cb1a7c9629ca4e7c95016a1b553752cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.817989 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82f8de727ab4eacab84e73e6a4a7cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.818708 8077 raft_consensus.cc:482] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.818828 8077 raft_consensus.cc:504] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.819368 8077 leader_election.cc:288] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:24.820087 6090 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 75539c390965493eaa69a0d1215fa922
I20260928 10:44:24.813563 5989 tablet_service.cc:1467] Processing CreateTablet for tablet cfb52e940aed4169a9edd2e4c6bacade (DEFAULT_TABLE table=default.Table_0b8767ef9ec3453bbe858244b9c284b7 [id=e3411b684164439bbf1f70cb3dadc909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.821982 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb52e940aed4169a9edd2e4c6bacade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.827234 5858 tablet_service.cc:1467] Processing CreateTablet for tablet cfb52e940aed4169a9edd2e4c6bacade (DEFAULT_TABLE table=default.Table_0b8767ef9ec3453bbe858244b9c284b7 [id=e3411b684164439bbf1f70cb3dadc909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.827718 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb52e940aed4169a9edd2e4c6bacade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.828760 5995 tablet_service.cc:1467] Processing CreateTablet for tablet e4ca725a7470496682d1e2d9e739470e (DEFAULT_TABLE table=default.Table_494c12b4b5c84c6db72f23c50e458418 [id=941dd1d93aff47169315c37080c32225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.829162 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ca725a7470496682d1e2d9e739470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.832537 5860 tablet_service.cc:1467] Processing CreateTablet for tablet b6a49666ec2045859cb9c350c997d866 (DEFAULT_TABLE table=default.Table_b00a13cb5f4341668a185c768b9975b8 [id=d7f403756749455b8dd53cb8c64aeec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.833037 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a49666ec2045859cb9c350c997d866. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.836339 5955 consensus_peers.cc:487] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.817559 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1257) took 2971 ms. Trace:
I20260928 10:44:24.836841 6270 rpcz_store.cc:276] 0928 10:44:21.846551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.846621 (+ 70us) service_pool.cc:227] Handling call
0928 10:44:24.817446 (+2970825us) ts_tablet_manager.cc:1145] Deleting tablet 2cfef184644b4fec8058759dd2e70cd2
0928 10:44:24.817458 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.817542 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2970617}
I20260928 10:44:24.837019 6269 tablet_replica.cc:330] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:24.837366 6269 raft_consensus.cc:2229] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 10:44:24.837430 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 2cfef184644b4fec8058759dd2e70cd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cfef184644b4fec8058759dd2e70cd2 already in progress: creating tablet
I20260928 10:44:24.837710 6269 raft_consensus.cc:2258] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:24.837880 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1258) took 2981 ms. Trace:
I20260928 10:44:24.837980 6270 rpcz_store.cc:276] 0928 10:44:21.856280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.858665 (+ 2385us) service_pool.cc:227] Handling call
0928 10:44:24.837744 (+2979079us) ts_tablet_manager.cc:1145] Deleting tablet 3bcced40ef4f4cedb8542c1189b5cd82
0928 10:44:24.837757 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.837860 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2978877}
W20260928 10:44:24.838377 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 3bcced40ef4f4cedb8542c1189b5cd82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bcced40ef4f4cedb8542c1189b5cd82 already in progress: creating tablet
I20260928 10:44:24.838624 6269 ts_tablet_manager.cc:1905] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:24.838796 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1259) took 2962 ms. Trace:
I20260928 10:44:24.838927 6270 rpcz_store.cc:276] 0928 10:44:21.876598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.876659 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:24.838669 (+2962010us) ts_tablet_manager.cc:1145] Deleting tablet 606a9cb61e0f4f558008d09177ded9f7
0928 10:44:24.838681 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.838778 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2961820}
W20260928 10:44:24.839366 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 606a9cb61e0f4f558008d09177ded9f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 606a9cb61e0f4f558008d09177ded9f7 already in progress: creating tablet
I20260928 10:44:24.839977 6091 leader_election.cc:302] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:24.840140 7958 raft_consensus.cc:482] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.840265 7958 raft_consensus.cc:504] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
W20260928 10:44:24.840415 6091 leader_election.cc:341] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 2d71edffecf044ba9cec14a70683a56f
I20260928 10:44:24.840520 6091 leader_election.cc:302] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:24.840852 7958 leader_election.cc:288] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.840785 7874 consensus_queue.cc:1035] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.840982 8077 raft_consensus.cc:2726] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.841125 8077 raft_consensus.cc:2726] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:24.842666 5864 tablet_service.cc:1467] Processing CreateTablet for tablet e4ca725a7470496682d1e2d9e739470e (DEFAULT_TABLE table=default.Table_494c12b4b5c84c6db72f23c50e458418 [id=941dd1d93aff47169315c37080c32225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.843080 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ca725a7470496682d1e2d9e739470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.844285 6134 tablet_service.cc:1467] Processing CreateTablet for tablet e4ca725a7470496682d1e2d9e739470e (DEFAULT_TABLE table=default.Table_494c12b4b5c84c6db72f23c50e458418 [id=941dd1d93aff47169315c37080c32225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.844674 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ca725a7470496682d1e2d9e739470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.848222 5995 tablet_service.cc:1467] Processing CreateTablet for tablet eead10986fe942a19bd4c3a0e275bbf1 (DEFAULT_TABLE table=default.Table_1611ed7264404dfa82d700b42e8cb93e [id=68ed0dbd458d48c2a55ff1ec77dc6919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.848718 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eead10986fe942a19bd4c3a0e275bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.849329 7958 raft_consensus.cc:482] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.849476 7958 raft_consensus.cc:504] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:24.849725 5817 consensus_peers.cc:487] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.850037 7958 leader_election.cc:288] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.850751 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c30726853549dfbc57f65fd31603fa" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.851500 5817 leader_election.cc:341] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.852337 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb945bc6b99a44e0932b2a94f05db6c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.852931 5817 leader_election.cc:341] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.855489 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:24.855767 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:24.856166 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:24.856388 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:24.856714 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:24.856904 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 22c4cea3f8ea413493c3ac23f83d0801 (table default.Table_fd728deb26884d0ab358a6df27ce4026 [id=263ec4300c4145479b53f240aad4198a]). Expected version 1 got 0
I20260928 10:44:24.857511 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet 37669fbe13614892a9b8cc2df4e10b4a (table default.Table_fb35582dd0e647778ff1e5b0ffedab4c [id=c4f2acb80d99427b9232dc5e56d3365b]). Expected version 1 got 0
I20260928 10:44:24.858176 5702 catalog_manager.cc:5495] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66). New cstate: current_term: 1 leader_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260928 10:44:24.859148 5702 catalog_manager.cc:5587] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919) does not have the latest schema for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_e51c54bdc7ea467491d09018c4ea3e3c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]). Expected version 3 got 0
I20260928 10:44:24.860500 5864 tablet_service.cc:1467] Processing CreateTablet for tablet eead10986fe942a19bd4c3a0e275bbf1 (DEFAULT_TABLE table=default.Table_1611ed7264404dfa82d700b42e8cb93e [id=68ed0dbd458d48c2a55ff1ec77dc6919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.860903 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eead10986fe942a19bd4c3a0e275bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.860972 7874 consensus_queue.cc:1035] T 30fb3f88e66b4f8582fb348e035af290 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.862001 7874 consensus_queue.cc:1035] T adb1f2e6392b4329b5520d0e292d6f98 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:24.862787 5957 consensus_peers.cc:487] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5a00b74133a406996820adcb71194df. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.867342 6273 tablet_bootstrap.cc:492] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:24.867493 6273 ts_tablet_manager.cc:1397] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.300s user 0.021s sys 0.016s
I20260928 10:44:24.868330 6128 tablet_service.cc:1467] Processing CreateTablet for tablet eead10986fe942a19bd4c3a0e275bbf1 (DEFAULT_TABLE table=default.Table_1611ed7264404dfa82d700b42e8cb93e [id=68ed0dbd458d48c2a55ff1ec77dc6919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.868588 5699 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_514aa835c8a64739843deef2c227d378 [id=33dceb6fb65c4d4590e8acca3fca51f1] alter complete (version 1)
I20260928 10:44:24.868614 6273 raft_consensus.cc:348] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.868811 6273 raft_consensus.cc:374] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.868858 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eead10986fe942a19bd4c3a0e275bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.868861 6273 raft_consensus.cc:729] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.869112 6273 consensus_queue.cc:260] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:24.870381 5699 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 179) took 1104 ms (client timeout 1000 ms). Trace:
W20260928 10:44:24.870507 5699 rpcz_store.cc:269] 0928 10:44:23.765826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:23.783938 (+ 18112us) service_pool.cc:227] Handling call
0928 10:44:23.792141 (+ 8203us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.870358 (+1078217us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.863094 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.863211 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.863218 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:24.863221 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:24.863336 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.863351 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.863356 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:24.863437 (+ 81us) tablet.cc:699] Row locks acquired
0928 10:44:24.863440 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:24.863479 (+ 39us) write_op.cc:270] Start()
0928 10:44:24.863516 (+ 37us) write_op.cc:276] Timestamp: P: 1790592264863421 usec, L: 0
0928 10:44:24.863520 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.863709 (+ 189us) log.cc:842] Serialized 356 byte log entry
0928 10:44:24.866633 (+ 2924us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.868040 (+ 1407us) write_op.cc:301] APPLY: starting
0928 10:44:24.868061 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.868103 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.868127 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.868185 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.868219 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:24.868226 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:24.868320 (+ 94us) log.cc:842] Serialized 23 byte log entry
0928 10:44:24.868395 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.868429 (+ 34us) write_op.cc:454] Released schema lock
0928 10:44:24.868437 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":37,"spinlock_wait_cycles":14758656,"child_traces":[["op",{"apply.queue_time_us":1349,"num_ops":1,"prepare.queue_time_us":525256,"raft.queue_time_us":39,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":4144,"replication_time_us":3086}]]}
I20260928 10:44:24.871848 6271 tablet_bootstrap.cc:492] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.871985 6271 ts_tablet_manager.cc:1397] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.171s user 0.024s sys 0.027s
I20260928 10:44:24.872684 6271 raft_consensus.cc:348] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.872890 6271 raft_consensus.cc:374] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.872948 6271 raft_consensus.cc:729] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.873157 6271 consensus_queue.cc:260] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.873337 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 9012fa19e01f43238c895a84c6dc9815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.873559 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f9fc7685a7541219b7207dc38b604e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:19 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.873792 6271 ts_tablet_manager.cc:1428] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:24.874039 6271 tablet_bootstrap.cc:492] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:24.875231 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7aa301bfbb4097b386a0d23cfa91e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:06 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.875432 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 3abfedf425b84f679b22d6ca9bef718a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.876048 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.876339 6273 ts_tablet_manager.cc:1428] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 10:44:24.877054 5986 tablet_service.cc:1514] Processing DeleteTablet for tablet 490f8a4f1f9245cfab168b96511e18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:01 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.877192 6271 tablet_bootstrap.cc:654] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.878609 6275 tablet_bootstrap.cc:492] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.878733 6275 ts_tablet_manager.cc:1397] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.199s user 0.017s sys 0.034s
I20260928 10:44:24.879381 6275 raft_consensus.cc:348] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.879601 6275 raft_consensus.cc:374] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.879660 6275 raft_consensus.cc:729] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.879833 6275 consensus_queue.cc:260] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.880115 5986 tablet_service.cc:1467] Processing CreateTablet for tablet bd49b945b63a4e289336ae9e15d9c5b9 (DEFAULT_TABLE table=default.Table_39ff19a83ef04dbe998993361ba7e720 [id=d05fd0aebdc9479d9f5db0ffa4a5f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.880338 6275 ts_tablet_manager.cc:1428] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:24.880581 6275 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.881953 5997 tablet_service.cc:1467] Processing CreateTablet for tablet ab81f4e371e348d9a838791ea6888d9b (DEFAULT_TABLE table=default.Table_976f971df4c24691977dc7bfec47c561 [id=8fd9b1c1723848a7b795139131ebd07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.882052 6275 tablet_bootstrap.cc:654] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.881986 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 2f599c9205164737a142e710c9c0c1b3 (DEFAULT_TABLE table=default.Table_3ad92c16b49f41e1aaf622c7392f4bca [id=552f8f16402b4aa48984a506d5a24225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.882347 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f599c9205164737a142e710c9c0c1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.882400 6126 tablet_service.cc:1467] Processing CreateTablet for tablet ab81f4e371e348d9a838791ea6888d9b (DEFAULT_TABLE table=default.Table_976f971df4c24691977dc7bfec47c561 [id=8fd9b1c1723848a7b795139131ebd07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.882727 6127 tablet_service.cc:1467] Processing CreateTablet for tablet bd49b945b63a4e289336ae9e15d9c5b9 (DEFAULT_TABLE table=default.Table_39ff19a83ef04dbe998993361ba7e720 [id=d05fd0aebdc9479d9f5db0ffa4a5f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.882898 5853 tablet_service.cc:1467] Processing CreateTablet for tablet bd49b945b63a4e289336ae9e15d9c5b9 (DEFAULT_TABLE table=default.Table_39ff19a83ef04dbe998993361ba7e720 [id=d05fd0aebdc9479d9f5db0ffa4a5f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.883028 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd49b945b63a4e289336ae9e15d9c5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.883270 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd49b945b63a4e289336ae9e15d9c5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.883558 6273 tablet_bootstrap.cc:492] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:24.884222 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab81f4e371e348d9a838791ea6888d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.884363 5984 tablet_service.cc:1467] Processing CreateTablet for tablet 2f599c9205164737a142e710c9c0c1b3 (DEFAULT_TABLE table=default.Table_3ad92c16b49f41e1aaf622c7392f4bca [id=552f8f16402b4aa48984a506d5a24225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.895778 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c48b8a7efa41a684205df3e6969370" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.896759 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.897511 7936 consensus_queue.cc:1035] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:24.898852 6129 tablet_service.cc:1467] Processing CreateTablet for tablet f82f8de727ab4eacab84e73e6a4a7cee (DEFAULT_TABLE table=default.Table_f3c7ad9611054c3d92b93aee18e7e70b [id=cb1a7c9629ca4e7c95016a1b553752cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.899092 6150 raft_consensus.cc:3037] T 59c67a02d7f84bed9c440c8c451ea4ff P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.899492 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82f8de727ab4eacab84e73e6a4a7cee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.899858 6070 tablet.cc:2369] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:44:24.904621 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 2f599c9205164737a142e710c9c0c1b3 (DEFAULT_TABLE table=default.Table_3ad92c16b49f41e1aaf622c7392f4bca [id=552f8f16402b4aa48984a506d5a24225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.906181 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f599c9205164737a142e710c9c0c1b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:24.908762 6204 tablet.cc:2369] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 10:44:24.912503 6271 tablet_bootstrap.cc:492] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:24.912671 6271 ts_tablet_manager.cc:1397] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.006s
I20260928 10:44:24.913491 6271 raft_consensus.cc:348] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.913721 6271 raft_consensus.cc:374] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.913790 6271 raft_consensus.cc:729] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.914100 6271 consensus_queue.cc:260] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.915740 6275 tablet_bootstrap.cc:492] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.915885 6275 ts_tablet_manager.cc:1397] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.006s
I20260928 10:44:24.916002 6271 ts_tablet_manager.cc:1428] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 10:44:24.916574 6275 raft_consensus.cc:348] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.916739 6275 raft_consensus.cc:374] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.916775 6275 raft_consensus.cc:729] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.916953 6275 consensus_queue.cc:260] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.917378 6275 ts_tablet_manager.cc:1428] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 10:44:24.918598 6275 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.919960 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_61e0ba949070480d896d7a070b3e252d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:24.920536 6275 tablet_bootstrap.cc:654] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:24.920588 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61e0ba949070480d896d7a070b3e252d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:24.924976 7958 raft_consensus.cc:482] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.925138 7958 raft_consensus.cc:504] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.926252 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "402378e09a1d43ea92f694fe24f9c544" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.927091 5817 leader_election.cc:341] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.934258 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 2db842351a0942f3b4ec62a917a71234
I20260928 10:44:24.934793 5695 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1590) took 1169 ms. Trace:
I20260928 10:44:24.935063 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db842351a0942f3b4ec62a917a71234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:24 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:24.934885 5695 rpcz_store.cc:276] 0928 10:44:23.765490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.319994 (+554504us) service_pool.cc:227] Handling call
0928 10:44:24.506704 (+186710us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05ff2e6 00007fa6d78f2126 00007fa6d78f1e55 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.507051 (+ 347us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:24.507167 (+ 116us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:24.507226 (+ 59us) catalog_manager.cc:2761] Locking tablets
0928 10:44:24.507357 (+ 131us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:24.934088 (+426731us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:24.934173 (+ 85us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:24.934221 (+ 48us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:24.934774 (+ 553us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.927957 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.928103 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.928110 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:24.928112 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:24.928247 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.928263 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.928268 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.928383 (+ 115us) tablet.cc:699] Row locks acquired
0928 10:44:24.928385 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:24.928443 (+ 58us) write_op.cc:270] Start()
0928 10:44:24.928484 (+ 41us) write_op.cc:276] Timestamp: P: 1790592264928363 usec, L: 0
0928 10:44:24.928488 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.928730 (+ 242us) log.cc:842] Serialized 759 byte log entry
0928 10:44:24.931987 (+ 3257us) op_driver.cc:444] REPLICATION: finished
0928 10:44:24.933497 (+ 1510us) write_op.cc:301] APPLY: starting
0928 10:44:24.933518 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:24.933565 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:24.933592 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:24.933667 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:24.933705 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:24.933711 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:24.933803 (+ 92us) log.cc:842] Serialized 29 byte log entry
0928 10:44:24.933881 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.933906 (+ 25us) write_op.cc:454] Released schema lock
0928 10:44:24.933914 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:24.933974 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:24.933977 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":428821888,"child_traces":[["op",{"apply.queue_time_us":1445,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":539,"num_ops":2,"prepare.queue_time_us":419869,"raft.queue_time_us":41,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":2371,"replication_time_us":3471,"spinlock_wait_cycles":91392}]]}
I20260928 10:44:24.936170 6275 tablet_bootstrap.cc:492] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.936311 6275 ts_tablet_manager.cc:1397] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260928 10:44:24.937110 6275 raft_consensus.cc:348] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.937453 6275 raft_consensus.cc:374] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.937366 5863 tablet_service.cc:1467] Processing CreateTablet for tablet ab81f4e371e348d9a838791ea6888d9b (DEFAULT_TABLE table=default.Table_976f971df4c24691977dc7bfec47c561 [id=8fd9b1c1723848a7b795139131ebd07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:24.937665 5999 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db842351a0942f3b4ec62a917a71234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:24 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:24.937798 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab81f4e371e348d9a838791ea6888d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.937935 6275 raft_consensus.cc:729] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.938237 6275 consensus_queue.cc:260] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.939222 6275 ts_tablet_manager.cc:1428] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 10:44:24.940204 6275 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.941798 6275 tablet_bootstrap.cc:654] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.941936 7958 leader_election.cc:288] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:24.942081 7958 raft_consensus.cc:482] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.942844 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd49b945b63a4e289336ae9e15d9c5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.942937 5858 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db842351a0942f3b4ec62a917a71234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:24 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:24.944324 5955 consensus_peers.cc:487] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:24.946871 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab81f4e371e348d9a838791ea6888d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.950707 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f599c9205164737a142e710c9c0c1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:24.952152 6275 tablet_bootstrap.cc:492] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.952378 8140 raft_consensus.cc:482] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.952497 8140 raft_consensus.cc:504] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.953145 8140 leader_election.cc:288] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.953318 6275 ts_tablet_manager.cc:1397] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260928 10:44:24.954139 6275 raft_consensus.cc:348] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.954357 6275 raft_consensus.cc:374] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.954403 6275 raft_consensus.cc:729] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.954629 6275 consensus_queue.cc:260] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.955546 6275 ts_tablet_manager.cc:1428] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:24.955814 6275 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.959239 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "383eb18f1c0c46209ff5b47e468b9950" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.959373 6275 tablet_bootstrap.cc:654] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.976076 6275 tablet_bootstrap.cc:492] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.976258 6275 ts_tablet_manager.cc:1397] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260928 10:44:24.977010 6275 raft_consensus.cc:348] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.977245 6275 raft_consensus.cc:374] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.977298 6275 raft_consensus.cc:729] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.977496 6275 consensus_queue.cc:260] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.978425 6275 ts_tablet_manager.cc:1428] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:24.979159 6275 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.982713 7958 raft_consensus.cc:504] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.983412 7958 leader_election.cc:288] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.983549 7958 raft_consensus.cc:482] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.983644 7958 raft_consensus.cc:504] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.984108 6275 tablet_bootstrap.cc:654] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.984098 7958 leader_election.cc:288] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.984203 7958 raft_consensus.cc:482] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.984278 7958 raft_consensus.cc:504] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:24.984658 7958 leader_election.cc:288] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:24.985790 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520ab6acc2142a2a3b8e1f0dabedc7a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.986194 6152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f913900914d149b48d64a0d53908482c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:24.986469 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c00ec4cec42a48388360e8723283829b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:24.987072 5817 leader_election.cc:341] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:24.987226 5817 leader_election.cc:341] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:24.987339 5817 leader_election.cc:341] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:24.988188 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_b881f09af6124ff699b10ab9756f4e2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:24.988754 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b881f09af6124ff699b10ab9756f4e2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:24.992630 6143 raft_consensus.cc:3037] T 96cc330167fa476a91a05be3f7e753e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:24.995340 6275 tablet_bootstrap.cc:492] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:24.995474 6275 ts_tablet_manager.cc:1397] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260928 10:44:24.996212 6275 raft_consensus.cc:348] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.996412 6275 raft_consensus.cc:374] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:24.996464 6275 raft_consensus.cc:729] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:24.996628 6275 consensus_queue.cc:260] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.997112 6275 ts_tablet_manager.cc:1428] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:24.997293 8077 raft_consensus.cc:482] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:24.997370 6275 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:24.997403 8077 raft_consensus.cc:504] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:24.997913 8077 leader_election.cc:288] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:24.998699 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:24.998916 6021 raft_consensus.cc:2454] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 0.
I20260928 10:44:24.999172 6275 tablet_bootstrap.cc:654] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:24.999442 6090 leader_election.cc:302] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:24.999665 8077 raft_consensus.cc:2781] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:24.999737 8077 raft_consensus.cc:482] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:24.999794 8077 raft_consensus.cc:3037] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.003248 5698 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1589) took 1257 ms. Trace:
I20260928 10:44:25.003376 5698 rpcz_store.cc:276] 0928 10:44:23.745469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.319233 (+573764us) service_pool.cc:227] Handling call
0928 10:44:24.509109 (+189876us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.509921 (+ 812us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:24.510444 (+ 523us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.002979 (+492535us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.003113 (+ 134us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.003216 (+ 103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:24.989943 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:24.990063 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:24.990069 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:24.990071 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:24.990161 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:24.990175 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:24.990179 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:24.990257 (+ 78us) tablet.cc:699] Row locks acquired
0928 10:44:24.990259 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:24.990294 (+ 35us) write_op.cc:270] Start()
0928 10:44:24.990329 (+ 35us) write_op.cc:276] Timestamp: P: 1790592264990274 usec, L: 0
0928 10:44:24.990333 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:24.990573 (+ 240us) log.cc:842] Serialized 433 byte log entry
0928 10:44:24.997246 (+ 6673us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.000774 (+ 3528us) write_op.cc:301] APPLY: starting
0928 10:44:25.000797 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.000846 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.000875 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.001021 (+ 146us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.001060 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.001067 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.001169 (+ 102us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.001244 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.001269 (+ 25us) write_op.cc:454] Released schema lock
0928 10:44:25.001278 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.001342 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.001346 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":436013312,"child_traces":[["op",{"apply.queue_time_us":3470,"apply.run_cpu_time_us":634,"apply.run_wall_time_us":632,"num_ops":2,"prepare.queue_time_us":477234,"raft.queue_time_us":56,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":9997,"replication_time_us":6884}]]}
I20260928 10:44:25.005285 8077 raft_consensus.cc:504] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.005945 8077 leader_election.cc:288] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Requested vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.006431 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e19b8189894e91a8be5a150f54cb6b" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027"
I20260928 10:44:25.006672 6021 raft_consensus.cc:3037] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.009464 6021 raft_consensus.cc:2454] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dab87557ec9445dbe35ea05e3561a94 in term 1.
I20260928 10:44:25.009985 6090 leader_election.cc:302] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:25.010282 8077 raft_consensus.cc:2781] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:25.010735 8077 raft_consensus.cc:686] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [term 1 LEADER]: Becoming Leader. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Running, Role: LEADER
I20260928 10:44:25.011059 8077 consensus_queue.cc:237] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.016813 6273 tablet_bootstrap.cc:654] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.018548 6152 raft_consensus.cc:3037] T 0b67cd4597914a1483fe2bad4de4a8b8 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.025390 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d5a0dd5f9b9b449c90c294aad914b8a6" } new_table_name: "default.Table_4e7a6e050c5d44c89e7e4108da272948" modify_external_catalogs: true
I20260928 10:44:25.026100 6275 tablet_bootstrap.cc:492] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.026254 6275 ts_tablet_manager.cc:1397] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260928 10:44:25.027036 6275 raft_consensus.cc:348] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.027264 6275 raft_consensus.cc:374] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.027311 6275 raft_consensus.cc:729] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.027523 6275 consensus_queue.cc:260] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.028051 6275 ts_tablet_manager.cc:1428] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:25.028323 6275 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.029992 6275 tablet_bootstrap.cc:654] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.032931 8145 raft_consensus.cc:482] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.033100 8145 raft_consensus.cc:504] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.033296 8120 ts_tablet_manager.cc:1918] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:25.033432 8120 log.cc:1196] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/9fe0dd05136840ee91d0b2a415ad49fc
I20260928 10:44:25.033761 8120 ts_tablet_manager.cc:1939] T 9fe0dd05136840ee91d0b2a415ad49fc P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:25.033804 8145 leader_election.cc:288] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.034814 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.035456 5955 leader_election.cc:341] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.041873 6150 raft_consensus.cc:3037] T ed7cd14e0039402ea51f34e8b88e2605 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.044873 8140 raft_consensus.cc:482] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.045630 6275 tablet_bootstrap.cc:492] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.045760 6275 ts_tablet_manager.cc:1397] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260928 10:44:25.045022 8140 raft_consensus.cc:504] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.046494 6275 raft_consensus.cc:348] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.046633 8140 leader_election.cc:288] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.046681 6275 raft_consensus.cc:374] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.046729 6275 raft_consensus.cc:729] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.048162 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.048288 8140 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.048403 8140 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.048885 8140 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.049311 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.049556 6021 raft_consensus.cc:2379] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
W20260928 10:44:25.050899 5697 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5c7540acde04667b9f8aef0bce23940 consensus state has no leader
I20260928 10:44:25.051069 5697 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:45112 (request call id 1591) took 1238 ms. Trace:
I20260928 10:44:25.051162 5697 rpcz_store.cc:276] 0928 10:44:23.812483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.330891 (+518408us) service_pool.cc:227] Handling call
0928 10:44:24.511152 (+180261us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e0600586 00007fa6d78f3de6 00007fa6d78f3b15 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.511354 (+ 202us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:24.511525 (+ 171us) catalog_manager.cc:3616] Apply alter schema
0928 10:44:24.517569 (+ 6044us) catalog_manager.cc:3639] Acquired catalog manager lock
0928 10:44:24.517649 (+ 80us) catalog_manager.cc:3786] Updating metadata on disk
0928 10:44:25.050671 (+533022us) catalog_manager.cc:3817] Committing alterations to in-memory state
0928 10:44:25.051052 (+ 381us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.023027 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.023176 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.023184 (+ 8us) write_op.cc:435] Acquired schema lock
0928 10:44:25.023186 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.028065 (+ 4879us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.028088 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.028098 (+ 10us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.028207 (+ 109us) tablet.cc:699] Row locks acquired
0928 10:44:25.028210 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.028266 (+ 56us) write_op.cc:270] Start()
0928 10:44:25.028311 (+ 45us) write_op.cc:276] Timestamp: P: 1790592265028238 usec, L: 0
0928 10:44:25.028314 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.028545 (+ 231us) log.cc:842] Serialized 405 byte log entry
0928 10:44:25.046079 (+ 17534us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.050020 (+ 3941us) write_op.cc:301] APPLY: starting
0928 10:44:25.050046 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.050093 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.050121 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.050190 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.050230 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.050237 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.050332 (+ 95us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.050523 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.050560 (+ 37us) write_op.cc:454] Released schema lock
0928 10:44:25.050570 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":413982080,"child_traces":[["op",{"apply.queue_time_us":3855,"num_ops":1,"prepare.queue_time_us":504862,"raft.queue_time_us":11047,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":678,"replication_time_us":17734}]]}
I20260928 10:44:25.051496 6275 consensus_queue.cc:260] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.053038 6275 ts_tablet_manager.cc:1428] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 10:44:25.053376 6275 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:25.057258 6091 leader_election.cc:341] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75539c390965493eaa69a0d1215fa922
I20260928 10:44:25.057411 6091 leader_election.cc:302] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.059963 5873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.060216 5873 raft_consensus.cc:2454] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:25.061813 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c00ec4cec42a48388360e8723283829b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.064998 6275 tablet_bootstrap.cc:654] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.065634 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_5c7fecfa171d40b09ce29f4ebfd3b7ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.066226 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c7fecfa171d40b09ce29f4ebfd3b7ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.066643 6020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c30726853549dfbc57f65fd31603fa" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.067013 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "402378e09a1d43ea92f694fe24f9c544" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.067276 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520ab6acc2142a2a3b8e1f0dabedc7a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.067508 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f913900914d149b48d64a0d53908482c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.070225 6275 tablet_bootstrap.cc:492] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.070372 6275 ts_tablet_manager.cc:1397] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
W20260928 10:44:25.070497 6091 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75e19b8189894e91a8be5a150f54cb6b
W20260928 10:44:25.070807 6091 leader_election.cc:341] T 75e19b8189894e91a8be5a150f54cb6b P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 75e19b8189894e91a8be5a150f54cb6b
I20260928 10:44:25.071138 8140 raft_consensus.cc:2726] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.071141 6275 raft_consensus.cc:348] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.071393 6275 raft_consensus.cc:374] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.071439 6275 raft_consensus.cc:729] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.071619 6275 consensus_queue.cc:260] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.072553 6275 ts_tablet_manager.cc:1428] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:25.072808 6275 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:25.075290 5957 consensus_peers.cc:487] T 22f47338950743eb8a06e779a3ca5c69 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22f47338950743eb8a06e779a3ca5c69. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.075626 8145 consensus_queue.cc:1035] T 45a8098440fb4e919bc5e3f4dd3241a7 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.078764 6275 tablet_bootstrap.cc:654] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.081139 5701 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1592) took 1197 ms. Trace:
I20260928 10:44:25.081243 5701 rpcz_store.cc:276] 0928 10:44:23.883358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.511217 (+627859us) service_pool.cc:227] Handling call
0928 10:44:24.517611 (+ 6394us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:24.518041 (+ 430us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.080908 (+562867us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.081027 (+ 119us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.081119 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.067482 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.067578 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.067584 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:25.067587 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.067673 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.067687 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.067691 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.075873 (+ 8182us) tablet.cc:699] Row locks acquired
0928 10:44:25.075877 (+ 4us) write_op.cc:260] PREPARE: finished
0928 10:44:25.075916 (+ 39us) write_op.cc:270] Start()
0928 10:44:25.075953 (+ 37us) write_op.cc:276] Timestamp: P: 1790592265075889 usec, L: 0
0928 10:44:25.075956 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.076123 (+ 167us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.079139 (+ 3016us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.080357 (+ 1218us) write_op.cc:301] APPLY: starting
0928 10:44:25.080375 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.080421 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.080504 (+ 83us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.080623 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.080661 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.080667 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.080743 (+ 76us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.080803 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.080825 (+ 22us) write_op.cc:454] Released schema lock
0928 10:44:25.080832 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1161,"num_ops":2,"prepare.queue_time_us":549022,"raft.queue_time_us":37,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":805,"replication_time_us":3159}]]}
I20260928 10:44:25.083348 6275 tablet_bootstrap.cc:492] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.083644 6275 ts_tablet_manager.cc:1397] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260928 10:44:25.085129 6275 raft_consensus.cc:348] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.085302 6275 raft_consensus.cc:374] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.085348 6275 raft_consensus.cc:729] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.085546 6275 consensus_queue.cc:260] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.086088 6275 ts_tablet_manager.cc:1428] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:25.086331 6275 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.087940 6275 tablet_bootstrap.cc:654] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.089977 6269 ts_tablet_manager.cc:1918] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:25.090087 6269 log.cc:1196] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/78295825061a4d75984e2d6e110e1c55
I20260928 10:44:25.090369 6269 ts_tablet_manager.cc:1939] T 78295825061a4d75984e2d6e110e1c55 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:25.095427 6273 tablet_bootstrap.cc:492] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.095638 6273 ts_tablet_manager.cc:1397] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.212s user 0.002s sys 0.005s
I20260928 10:44:25.096220 8149 raft_consensus.cc:482] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:25.096400 5818 leader_election.cc:341] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.096354 8149 raft_consensus.cc:504] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.096524 5818 leader_election.cc:302] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:25.096889 5818 leader_election.cc:341] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.096930 8149 leader_election.cc:288] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.097244 8146 raft_consensus.cc:2726] T d6c48b8a7efa41a684205df3e6969370 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.097293 5818 leader_election.cc:302] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.097508 8146 raft_consensus.cc:2726] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.098104 8146 consensus_queue.cc:1035] T 58c0af95fa58451490947176ec9301e3 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 10:44:25.101342 5818 leader_election.cc:341] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.101552 5818 leader_election.cc:302] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.101809 8146 raft_consensus.cc:2726] T c00ec4cec42a48388360e8723283829b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.103052 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d03d764256a4a8d9d8bb17b82fe8bda" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.104405 5817 leader_election.cc:341] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.106228 8146 raft_consensus.cc:482] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.106423 8146 raft_consensus.cc:504] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.107179 8146 leader_election.cc:288] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.107903 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381b12c993c74ba6ba78804c1f6c01e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.108614 5817 leader_election.cc:341] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.110992 6273 raft_consensus.cc:348] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.111317 6273 raft_consensus.cc:374] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.111377 6273 raft_consensus.cc:729] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.111614 6273 consensus_queue.cc:260] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.112299 6273 ts_tablet_manager.cc:1428] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.017s user 0.000s sys 0.000s
I20260928 10:44:25.114722 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb945bc6b99a44e0932b2a94f05db6c2" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:25.115135 5818 leader_election.cc:341] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.115278 5818 leader_election.cc:302] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:25.115470 5955 consensus_peers.cc:487] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.116518 6273 tablet_bootstrap.cc:492] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:25.116514 7996 raft_consensus.cc:482] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.116681 7996 raft_consensus.cc:504] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.117261 7996 leader_election.cc:288] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.118702 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.119341 5955 leader_election.cc:341] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.123450 6273 tablet_bootstrap.cc:654] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:25.134263 5818 leader_election.cc:341] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.134817 6271 tablet_bootstrap.cc:492] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:25.134550 5818 leader_election.cc:302] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.136461 6271 tablet_bootstrap.cc:654] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.137508 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1260) took 3224 ms. Trace:
I20260928 10:44:25.137662 6270 rpcz_store.cc:276] 0928 10:44:21.913144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.913216 (+ 72us) service_pool.cc:227] Handling call
0928 10:44:24.909533 (+2996317us) ts_tablet_manager.cc:1145] Deleting tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb
0928 10:44:25.134457 (+224924us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.137489 (+ 3032us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2994011}
I20260928 10:44:25.138204 6270 tablet_replica.cc:330] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:25.138674 6270 raft_consensus.cc:2229] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.139173 6270 raft_consensus.cc:2258] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.140012 6270 ts_tablet_manager.cc:1905] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.141556 8168 raft_consensus.cc:2726] T 84c30726853549dfbc57f65fd31603fa P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.142141 8171 raft_consensus.cc:2726] T 402378e09a1d43ea92f694fe24f9c544 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.142418 5818 leader_election.cc:341] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.142570 5818 leader_election.cc:302] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.142759 8168 raft_consensus.cc:2726] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.142912 5818 leader_election.cc:341] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.143006 5818 leader_election.cc:302] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.143181 8171 raft_consensus.cc:2726] T f913900914d149b48d64a0d53908482c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.143301 5818 leader_election.cc:341] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.143395 5818 leader_election.cc:302] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.143548 8171 raft_consensus.cc:2726] T eb945bc6b99a44e0932b2a94f05db6c2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.143985 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.144229 5878 raft_consensus.cc:2379] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:25.144455 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30fb3f88e66b4f8582fb348e035af290" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
W20260928 10:44:25.145104 5957 consensus_peers.cc:487] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e149cdb22cc4c60b012c2d87868827b. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.146281 7996 consensus_queue.cc:1035] T ee0b7f3bd78a49368abc13ab9e171880 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.148185 6275 tablet_bootstrap.cc:492] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.148133 7934 consensus_queue.cc:1035] T 32560e881a1d4444a706bb8b60dda499 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.148319 6275 ts_tablet_manager.cc:1397] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.014s
I20260928 10:44:25.148377 6152 raft_consensus.cc:3037] T e9e0bac650904b8f81474ba2dac9c04f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.149085 6275 raft_consensus.cc:348] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.149300 6275 raft_consensus.cc:374] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.149353 6273 tablet_bootstrap.cc:492] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.149351 6275 raft_consensus.cc:729] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.149472 6273 ts_tablet_manager.cc:1397] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260928 10:44:25.149533 6275 consensus_queue.cc:260] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.150048 6275 ts_tablet_manager.cc:1428] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:25.150184 7934 consensus_queue.cc:1035] T 9012fa19e01f43238c895a84c6dc9815 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.150365 6275 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.150914 5957 leader_election.cc:302] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.151243 7934 raft_consensus.cc:2781] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:25.151316 7934 raft_consensus.cc:482] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:25.151376 7934 raft_consensus.cc:3037] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.152180 6275 tablet_bootstrap.cc:654] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.154080 7934 raft_consensus.cc:504] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.158560 7934 leader_election.cc:288] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.159305 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:25.160218 5955 leader_election.cc:341] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:25.160485 6091 leader_election.cc:341] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 383eb18f1c0c46209ff5b47e468b9950
I20260928 10:44:25.160581 6091 leader_election.cc:302] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.160696 6275 tablet_bootstrap.cc:492] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.160826 6275 ts_tablet_manager.cc:1397] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260928 10:44:25.160885 8140 raft_consensus.cc:2726] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.161587 5955 consensus_peers.cc:487] T 0e149cdb22cc4c60b012c2d87868827b P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.161705 6275 raft_consensus.cc:348] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.161913 6275 raft_consensus.cc:374] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 10:44:25.161960 5957 consensus_peers.cc:487] T 78295825061a4d75984e2d6e110e1c55 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.161979 6275 raft_consensus.cc:729] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.162187 6275 consensus_queue.cc:260] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.162695 6275 ts_tablet_manager.cc:1428] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:25.163041 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d03d764256a4a8d9d8bb17b82fe8bda" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.163295 6275 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.165477 6275 tablet_bootstrap.cc:654] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.171167 6273 raft_consensus.cc:348] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.172581 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381b12c993c74ba6ba78804c1f6c01e3" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.199906 6273 raft_consensus.cc:374] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.200116 6273 raft_consensus.cc:729] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.200392 6273 consensus_queue.cc:260] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.203269 6275 tablet_bootstrap.cc:492] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.203438 6275 ts_tablet_manager.cc:1397] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.017s
I20260928 10:44:25.204129 5686 catalog_manager.cc:4841] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): tablet 9fe0dd05136840ee91d0b2a415ad49fc (table default.Table_bd415a38e4344ac0a4f2bfb479d01b58 [id=01274b7dde224a98ae1da73c01701045]) successfully deleted
I20260928 10:44:25.204200 6275 raft_consensus.cc:348] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.204404 6275 raft_consensus.cc:374] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.204461 6275 raft_consensus.cc:729] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.204653 6275 consensus_queue.cc:260] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:25.204761 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cab5ed3a4bc4d88a0f3ec63f1409406 already in progress: creating tablet
W20260928 10:44:25.204983 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 11b732758c1f4565b3051309cdfd9649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11b732758c1f4565b3051309cdfd9649 already in progress: creating tablet
W20260928 10:44:25.205161 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 741ca8fa10bb47efbd5d6a95d30f1987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 741ca8fa10bb47efbd5d6a95d30f1987 already in progress: creating tablet
W20260928 10:44:25.205322 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 45b2c0fdd8ee43d6a7b47b01583332c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45b2c0fdd8ee43d6a7b47b01583332c2 already in progress: creating tablet
W20260928 10:44:25.205492 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 7ed0451e509d4580be284739255821e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ed0451e509d4580be284739255821e2 already in progress: creating tablet
W20260928 10:44:25.205684 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 2db842351a0942f3b4ec62a917a71234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2db842351a0942f3b4ec62a917a71234 already in progress: creating tablet
I20260928 10:44:25.205842 6275 ts_tablet_manager.cc:1428] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:25.206090 6275 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.207736 6275 tablet_bootstrap.cc:654] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.204139 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.217765 5875 raft_consensus.cc:2454] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:25.218556 6273 ts_tablet_manager.cc:1428] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.069s user 0.003s sys 0.000s
I20260928 10:44:25.218935 6273 tablet_bootstrap.cc:492] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:25.221915 8077 raft_consensus.cc:482] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.222070 8077 raft_consensus.cc:504] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.222920 8077 leader_election.cc:288] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.227782 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_eda004e06ddd4668bbe3d0d4838c4578" } new_table_name: "default.Table_2fc137a6b1514e7d842e5919fec263f9" modify_external_catalogs: true
I20260928 10:44:25.238953 6143 raft_consensus.cc:3037] T 58b58d0c904a423f9801a883a2a2dfc1 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.241151 5694 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1593) took 1342 ms. Trace:
I20260928 10:44:25.241289 5694 rpcz_store.cc:276] 0928 10:44:23.898333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.649590 (+751257us) service_pool.cc:227] Handling call
0928 10:44:24.682584 (+ 32994us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.683327 (+ 743us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:24.683745 (+ 418us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.240877 (+557132us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.241011 (+ 134us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.241120 (+ 109us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.115871 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.127738 (+ 11867us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.127747 (+ 9us) write_op.cc:435] Acquired schema lock
0928 10:44:25.127750 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.127868 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.127884 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.127890 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.128000 (+ 110us) tablet.cc:699] Row locks acquired
0928 10:44:25.128002 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.192672 (+ 64670us) write_op.cc:270] Start()
0928 10:44:25.192719 (+ 47us) write_op.cc:276] Timestamp: P: 1790592265192611 usec, L: 0
0928 10:44:25.192724 (+ 5us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.229396 (+ 36672us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.229588 (+ 192us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6d8ad6d02 00007fa6d9e097f1 00007fa6d9e08359 00007fa6d9e101bb 00007fa6d9e10038 00000000009edb7c 00007fa6cd60e344 00007fa6cd61191b 00007fa6cd611798 00000000009edb7c
0928 10:44:25.239126 (+ 9538us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.239432 (+ 306us) write_op.cc:301] APPLY: starting
0928 10:44:25.239449 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.239494 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.239497 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.239625 (+ 128us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.239661 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.239667 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.239746 (+ 79us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.239817 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.239836 (+ 19us) write_op.cc:454] Released schema lock
0928 10:44:25.239843 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.239898 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.239902 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":75166976,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":520,"apply.run_wall_time_us":519,"num_ops":2,"prepare.queue_time_us":431688,"prepare.run_cpu_time_us":1369,"prepare.run_wall_time_us":113789,"raft.queue_time_us":1627,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":240,"replication_time_us":46374,"spinlock_wait_cycles":83881728}]]}
I20260928 10:44:25.242249 5700 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_0cb5f3cda89b4570a6d88355781a45db [id=13c323309f6d42d49f3e4a1448e2ff73] alter complete (version 1)
I20260928 10:44:25.243762 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d5da28a9cb2f49639abc40b5208a96b7
I20260928 10:44:25.244220 5693 catalog_manager.cc:6565] ReplaceTablet: tablet d5da28a9cb2f49639abc40b5208a96b7 deleted and replaced by tablet e88b838cd5c048a1b5cb7b3b9522f563
I20260928 10:44:25.244223 6271 tablet_bootstrap.cc:492] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:25.244325 5693 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:45112 (request call id 1594) took 1307 ms. Trace:
I20260928 10:44:25.244385 6271 ts_tablet_manager.cc:1397] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.001s
I20260928 10:44:25.244398 5693 rpcz_store.cc:276] 0928 10:44:23.936954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.805234 (+868280us) service_pool.cc:227] Handling call
0928 10:44:24.849283 (+ 44049us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e060a527 00007fa6d78fcda7 00007fa6d78fcad5 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.244310 (+395027us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.230407 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.230522 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.230527 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.230529 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.230621 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.230631 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.230635 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.230713 (+ 78us) tablet.cc:699] Row locks acquired
0928 10:44:25.230715 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.230746 (+ 31us) write_op.cc:270] Start()
0928 10:44:25.230776 (+ 30us) write_op.cc:276] Timestamp: P: 1790592265230703 usec, L: 0
0928 10:44:25.230780 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.230928 (+ 148us) log.cc:842] Serialized 625 byte log entry
0928 10:44:25.239224 (+ 8296us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.240365 (+ 1141us) write_op.cc:301] APPLY: starting
0928 10:44:25.240374 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.240403 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.240448 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.240527 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.240573 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.240579 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.240638 (+ 59us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.240706 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.240719 (+ 13us) write_op.cc:454] Released schema lock
0928 10:44:25.240724 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.240768 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.240771 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":100619008,"child_traces":[["op",{"apply.queue_time_us":1115,"apply.run_cpu_time_us":443,"apply.run_wall_time_us":442,"num_ops":2,"prepare.queue_time_us":380211,"prepare.run_cpu_time_us":609,"prepare.run_wall_time_us":609,"raft.queue_time_us":562,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":8432,"threads_started":1}]]}
I20260928 10:44:25.245280 6271 raft_consensus.cc:348] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.245560 6271 raft_consensus.cc:374] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.245612 6271 raft_consensus.cc:729] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.245859 6271 consensus_queue.cc:260] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.246460 6271 ts_tablet_manager.cc:1428] T 1c8c53b5ae244cda8dff396935fc8e82 P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:25.247411 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet e88b838cd5c048a1b5cb7b3b9522f563) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.247535 8189 tablet.cc:1722] T 5ced63ab7188472e80d4ff52350be3e0 P 4dab87557ec9445dbe35ea05e3561a94: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:25.248860 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet e88b838cd5c048a1b5cb7b3b9522f563) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.250236 6270 ts_tablet_manager.cc:1918] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:25.250355 6270 log.cc:1196] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/1d0584d6b80e43eb913c3932256cd89e
I20260928 10:44:25.250686 6270 ts_tablet_manager.cc:1939] T 1d0584d6b80e43eb913c3932256cd89e P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:25.251499 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1264) took 3279 ms. Trace:
I20260928 10:44:25.251603 6270 rpcz_store.cc:276] 0928 10:44:21.971764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.971819 (+ 55us) service_pool.cc:227] Handling call
0928 10:44:25.138154 (+3166335us) ts_tablet_manager.cc:1145] Deleting tablet 1d0584d6b80e43eb913c3932256cd89e
0928 10:44:25.138165 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.181100 (+ 42935us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.250127 (+ 69027us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.251477 (+ 1350us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3166141}
I20260928 10:44:25.251933 6270 tablet_replica.cc:330] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:25.252118 6270 raft_consensus.cc:2229] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.252276 6270 raft_consensus.cc:2258] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.252781 6270 ts_tablet_manager.cc:1905] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.267179 6271 tablet_bootstrap.cc:492] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:25.269845 5881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cab5ed3a4bc4d88a0f3ec63f1409406" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:25.270041 5881 raft_consensus.cc:3037] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:25.272171 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60eb976fe2d34eb7a1a32eab8aa3bdfb already in progress: creating tablet
I20260928 10:44:25.272568 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 1d0584d6b80e43eb913c3932256cd89e (table default.Table_34c0c54e906048a6981e6e89da155bc0 [id=a0459c792b1c4e1d869bcf0606f9d447]) successfully deleted
I20260928 10:44:25.272691 5881 raft_consensus.cc:2454] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:25.297623 5695 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1596) took 1310 ms. Trace:
W20260928 10:44:25.297930 5698 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 148a0e6334424831abbb6c19d6b39baa consensus state has no leader
I20260928 10:44:25.298100 5698 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:45112 (request call id 1597) took 1296 ms. Trace:
I20260928 10:44:25.298532 5699 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1595) took 1354 ms. Trace:
I20260928 10:44:25.298632 5699 rpcz_store.cc:276] 0928 10:44:23.944348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.871098 (+926750us) service_pool.cc:227] Handling call
0928 10:44:24.919862 (+ 48764us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.920791 (+ 929us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:24.921226 (+ 435us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.298311 (+377085us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.298403 (+ 92us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.298509 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.231548 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.231624 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.231628 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.231631 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.231721 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.231728 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.231733 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.231793 (+ 60us) tablet.cc:699] Row locks acquired
0928 10:44:25.231795 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.231819 (+ 24us) write_op.cc:270] Start()
0928 10:44:25.231845 (+ 26us) write_op.cc:276] Timestamp: P: 1790592265231779 usec, L: 0
0928 10:44:25.231849 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.231982 (+ 133us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.295594 (+ 63612us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.296454 (+ 860us) write_op.cc:301] APPLY: starting
0928 10:44:25.296463 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.296496 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.296519 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.296625 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.296653 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.296660 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.296731 (+ 71us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.296788 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.296803 (+ 15us) write_op.cc:454] Released schema lock
0928 10:44:25.296808 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.296854 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.296857 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":111438080,"child_traces":[["op",{"apply.queue_time_us":833,"apply.run_cpu_time_us":444,"apply.run_wall_time_us":443,"num_ops":2,"prepare.queue_time_us":309822,"prepare.run_cpu_time_us":491,"prepare.run_wall_time_us":490,"replication_time_us":63733}]]}
I20260928 10:44:25.298167 5698 rpcz_store.cc:276] 0928 10:44:24.001200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.004105 (+1002905us) service_pool.cc:227] Handling call
0928 10:44:25.025334 (+ 21229us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e0600586 00007fa6d78f3de6 00007fa6d78f3b15 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.052606 (+ 27272us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:25.052830 (+ 224us) catalog_manager.cc:3616] Apply alter schema
0928 10:44:25.053062 (+ 232us) catalog_manager.cc:3639] Acquired catalog manager lock
0928 10:44:25.053128 (+ 66us) catalog_manager.cc:3786] Updating metadata on disk
0928 10:44:25.297726 (+244598us) catalog_manager.cc:3817] Committing alterations to in-memory state
0928 10:44:25.298084 (+ 358us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.232573 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.232690 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.232694 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.232696 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.232766 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.232773 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.232778 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.232825 (+ 47us) tablet.cc:699] Row locks acquired
0928 10:44:25.232828 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.232854 (+ 26us) write_op.cc:270] Start()
0928 10:44:25.232880 (+ 26us) write_op.cc:276] Timestamp: P: 1790592265232813 usec, L: 0
0928 10:44:25.232884 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.233013 (+ 129us) log.cc:842] Serialized 405 byte log entry
0928 10:44:25.295681 (+ 62668us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.297371 (+ 1690us) write_op.cc:301] APPLY: starting
0928 10:44:25.297379 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.297404 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.297424 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.297459 (+ 35us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.297481 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.297486 (+ 5us) write_op.cc:312] APPLY: finished
0928 10:44:25.297532 (+ 46us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.297579 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.297589 (+ 10us) write_op.cc:454] Released schema lock
0928 10:44:25.297594 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.297636 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.297640 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":48163712,"child_traces":[["op",{"apply.queue_time_us":1666,"apply.run_cpu_time_us":302,"apply.run_wall_time_us":303,"num_ops":1,"prepare.queue_time_us":178972,"prepare.run_cpu_time_us":497,"prepare.run_wall_time_us":496,"replication_time_us":62785,"threads_started":1}]]}
I20260928 10:44:25.297748 5695 rpcz_store.cc:276] 0928 10:44:23.987510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.935528 (+948018us) service_pool.cc:227] Handling call
0928 10:44:24.988100 (+ 52572us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:24.988840 (+ 740us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:24.989259 (+ 419us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.297337 (+308078us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.297486 (+ 149us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.297598 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.232069 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.232142 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.232146 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.232148 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.232210 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.232218 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.232222 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.232279 (+ 57us) tablet.cc:699] Row locks acquired
0928 10:44:25.232281 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.232307 (+ 26us) write_op.cc:270] Start()
0928 10:44:25.232334 (+ 27us) write_op.cc:276] Timestamp: P: 1790592265232266 usec, L: 0
0928 10:44:25.232338 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.232486 (+ 148us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.295645 (+ 63159us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.296926 (+ 1281us) write_op.cc:301] APPLY: starting
0928 10:44:25.296934 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.296962 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.297004 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.297106 (+ 102us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.297131 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.297137 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.297186 (+ 49us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.297237 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.297250 (+ 13us) write_op.cc:454] Released schema lock
0928 10:44:25.297255 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.297302 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.297305 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":120262016,"child_traces":[["op",{"apply.queue_time_us":1254,"apply.run_cpu_time_us":416,"apply.run_wall_time_us":415,"num_ops":2,"prepare.queue_time_us":242374,"prepare.run_cpu_time_us":472,"prepare.run_wall_time_us":471,"replication_time_us":63295}]]}
I20260928 10:44:25.306720 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da28a9cb2f49639abc40b5208a96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet e88b838cd5c048a1b5cb7b3b9522f563) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.310382 7958 raft_consensus.cc:482] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 10:44:25.310587 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d5da28a9cb2f49639abc40b5208a96b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5da28a9cb2f49639abc40b5208a96b7 already in progress: creating tablet
I20260928 10:44:25.310668 7958 raft_consensus.cc:504] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.311283 7958 leader_election.cc:288] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:25.312456 8077 raft_consensus.cc:482] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.312656 8077 raft_consensus.cc:504] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.313541 8077 leader_election.cc:288] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.315598 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c056c078c95461b82c1ca1f31d90752" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.316416 5817 leader_election.cc:341] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.320750 8077 raft_consensus.cc:482] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.321024 8077 raft_consensus.cc:504] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.322211 6152 raft_consensus.cc:3037] T 383eb18f1c0c46209ff5b47e468b9950 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.269121 6271 tablet_bootstrap.cc:654] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.289410 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b7976063024775b9dde91b32010754" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.313776 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "503a4bcb9d37441aadf66b45238a3737" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:25.325977 5955 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.100.67:43661, user_credentials={real_user=slave}} blocked reactor thread for 70754.4us
I20260928 10:44:25.293506 8184 tablet.cc:1722] T 5ced63ab7188472e80d4ff52350be3e0 P 2f6ffbf4f0534383bf89d15aa37e3027: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 10:44:25.322338 8077 leader_election.cc:288] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:25.323293 6090 leader_election.cc:341] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Not found: Tablet not found: 1f9fc7685a7541219b7207dc38b604e0
I20260928 10:44:25.337466 6091 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.339167 6091 leader_election.cc:302] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.339538 8140 raft_consensus.cc:3037] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.342063 8140 raft_consensus.cc:2726] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.342233 8140 raft_consensus.cc:2726] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.352836 5955 consensus_peers.cc:487] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Couldn't send request to peer 4dab87557ec9445dbe35ea05e3561a94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.355886 6273 tablet_bootstrap.cc:654] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.356642 8167 raft_consensus.cc:482] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.356921 8167 raft_consensus.cc:504] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.358182 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03fd57e996c486384f92000925aff8a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.359246 5817 leader_election.cc:341] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.359411 6271 tablet_bootstrap.cc:492] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:25.359570 6271 ts_tablet_manager.cc:1397] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.093s user 0.002s sys 0.001s
I20260928 10:44:25.360388 6271 raft_consensus.cc:348] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.360625 6271 raft_consensus.cc:374] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.360677 6271 raft_consensus.cc:729] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.360875 6271 consensus_queue.cc:260] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.362691 8167 leader_election.cc:288] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
W20260928 10:44:25.368781 5818 leader_election.cc:341] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.368944 5818 leader_election.cc:302] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:25.369410 5818 leader_election.cc:341] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.369460 7958 raft_consensus.cc:482] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.369506 5818 leader_election.cc:302] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.369582 7958 raft_consensus.cc:504] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.369755 5875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9fc7685a7541219b7207dc38b604e0" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.369962 5875 raft_consensus.cc:2379] T 1f9fc7685a7541219b7207dc38b604e0 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:25.370116 7958 leader_election.cc:288] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.370414 8146 raft_consensus.cc:2726] T 8d03d764256a4a8d9d8bb17b82fe8bda P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.370600 8146 consensus_queue.cc:1035] T 9319d4d4102e43b19c0caa0b0a4b4740 P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.370980 8146 raft_consensus.cc:2726] T 381b12c993c74ba6ba78804c1f6c01e3 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.372254 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcecdf79aafe497080e2a1f6256ef6fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.372886 5817 leader_election.cc:341] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.376318 5957 leader_election.cc:302] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.376554 8191 raft_consensus.cc:2781] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 10:44:25.376695 8191 raft_consensus.cc:482] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:25.376757 8191 raft_consensus.cc:3037] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.377164 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c056c078c95461b82c1ca1f31d90752" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:25.377386 5957 consensus_peers.cc:487] T 2d71edffecf044ba9cec14a70683a56f P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d71edffecf044ba9cec14a70683a56f. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.377521 5957 leader_election.cc:302] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b; no voters: 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.377650 7874 consensus_queue.cc:1035] T 11c6ed97f74540b786ed3a6378dea0d3 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.377954 8192 raft_consensus.cc:2781] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 10:44:25.378050 8192 raft_consensus.cc:686] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:25.378297 8192 consensus_queue.cc:237] T 0cab5ed3a4bc4d88a0f3ec63f1409406 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.379300 8191 raft_consensus.cc:504] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:25.380054 5957 consensus_peers.cc:487] T 503a4bcb9d37441aadf66b45238a3737 P 2f6ffbf4f0534383bf89d15aa37e3027 -> Peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Couldn't send request to peer ab770e77cb704ea38b5ca8cff97dc73b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 503a4bcb9d37441aadf66b45238a3737. This is attempt 1: this message will repeat every 5th retry.
I20260928 10:44:25.384423 6271 ts_tablet_manager.cc:1428] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260928 10:44:25.384639 6143 raft_consensus.cc:3037] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.384720 6271 tablet_bootstrap.cc:492] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:25.386663 8191 leader_election.cc:288] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.390520 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
W20260928 10:44:25.391270 5955 leader_election.cc:341] T d39e1e4d18d6450580e28614ae4c2895 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.395358 6270 ts_tablet_manager.cc:1918] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:25.405870 6153 raft_consensus.cc:3037] T 2d71edffecf044ba9cec14a70683a56f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.416399 6270 log.cc:1196] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/75e19b8189894e91a8be5a150f54cb6b
I20260928 10:44:25.420001 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d84bf40eb66a46179460ac24c87e2688" } new_table_name: "default.Table_102ee6fa5bcc4a5b90b2c8b2ed6b2975" modify_external_catalogs: true
I20260928 10:44:25.420680 5698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_224ddddb44d84d849b446332c445ae8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.421190 5698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_224ddddb44d84d849b446332c445ae8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.421435 5697 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1598) took 1373 ms. Trace:
I20260928 10:44:25.421780 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_99438fcae7cc433d865d751abb68357e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:25.421518 5697 rpcz_store.cc:276] 0928 10:44:24.047653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.051751 (+1004098us) service_pool.cc:227] Handling call
0928 10:44:25.065537 (+ 13786us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.066324 (+ 787us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:25.066803 (+ 479us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.421228 (+354425us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.421326 (+ 98us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.421416 (+ 90us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.233099 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.233170 (+ 71us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.233175 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.233176 (+ 1us) tablet.cc:660] Decoding operations
0928 10:44:25.233238 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.233245 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.233249 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.233310 (+ 61us) tablet.cc:699] Row locks acquired
0928 10:44:25.233313 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.233339 (+ 26us) write_op.cc:270] Start()
0928 10:44:25.233384 (+ 45us) write_op.cc:276] Timestamp: P: 1790592265233298 usec, L: 0
0928 10:44:25.233388 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.233528 (+ 140us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.419497 (+185969us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.420695 (+ 1198us) write_op.cc:301] APPLY: starting
0928 10:44:25.420713 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.420770 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.420802 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.420921 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.420959 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.420966 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.421043 (+ 77us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.421120 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.421138 (+ 18us) write_op.cc:454] Released schema lock
0928 10:44:25.421146 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.421208 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.421211 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":31048064,"child_traces":[["op",{"apply.queue_time_us":1125,"apply.run_cpu_time_us":570,"apply.run_wall_time_us":570,"num_ops":2,"prepare.queue_time_us":165828,"prepare.run_cpu_time_us":482,"prepare.run_wall_time_us":481,"replication_time_us":186079}]]}
W20260928 10:44:25.422202 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99438fcae7cc433d865d751abb68357e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.422783 5699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_ea4db81d1e8747e3997b73ac2d49ba20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.423183 5699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea4db81d1e8747e3997b73ac2d49ba20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.423686 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_0b0207925c9d4840b6cd3845ca532e8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.424053 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b0207925c9d4840b6cd3845ca532e8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.425518 6273 tablet_bootstrap.cc:492] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.426731 6273 ts_tablet_manager.cc:1397] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.208s user 0.003s sys 0.000s
I20260928 10:44:25.429247 8140 raft_consensus.cc:482] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.429388 8140 raft_consensus.cc:504] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.429935 8140 leader_election.cc:288] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.431030 6275 tablet_bootstrap.cc:492] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.427697 6273 raft_consensus.cc:348] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.431229 6275 ts_tablet_manager.cc:1397] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.225s user 0.008s sys 0.001s
I20260928 10:44:25.431435 6273 raft_consensus.cc:374] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.431579 6273 raft_consensus.cc:729] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.431901 6273 consensus_queue.cc:260] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.432214 6275 raft_consensus.cc:348] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.432459 6275 raft_consensus.cc:374] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.432559 6275 raft_consensus.cc:729] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.432806 6275 consensus_queue.cc:260] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.433470 6275 ts_tablet_manager.cc:1428] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:25.433768 6275 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.435433 6275 tablet_bootstrap.cc:654] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.436687 6273 ts_tablet_manager.cc:1428] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 10:44:25.437052 6273 tablet_bootstrap.cc:492] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:25.441941 6273 tablet_bootstrap.cc:654] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.442864 6270 ts_tablet_manager.cc:1939] T 75e19b8189894e91a8be5a150f54cb6b P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:25.443711 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1265) took 3471 ms. Trace:
I20260928 10:44:25.443866 6270 rpcz_store.cc:276] 0928 10:44:21.972157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.972197 (+ 40us) service_pool.cc:227] Handling call
0928 10:44:25.251885 (+3279688us) ts_tablet_manager.cc:1145] Deleting tablet 75e19b8189894e91a8be5a150f54cb6b
0928 10:44:25.251896 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.362849 (+110953us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.395237 (+ 32388us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.443683 (+ 48446us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3279532}
I20260928 10:44:25.444450 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet 75e19b8189894e91a8be5a150f54cb6b (table default.Table_516bd0195afa484681570b1f84d17ee4 [id=643bd72a41aa4477bc796c4a43eef8ac]) successfully deleted
I20260928 10:44:25.444927 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1266) took 3472 ms. Trace:
I20260928 10:44:25.445080 7958 raft_consensus.cc:482] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.445083 6270 rpcz_store.cc:276] 0928 10:44:21.972464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.972500 (+ 36us) service_pool.cc:227] Handling call
0928 10:44:25.444801 (+3472301us) ts_tablet_manager.cc:1145] Deleting tablet c5c1a1c5e22e455d91de92f0aa3535c7
0928 10:44:25.444812 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.444901 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3472159}
I20260928 10:44:25.445226 7958 raft_consensus.cc:504] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:25.445515 5687 catalog_manager.cc:4808] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet c5c1a1c5e22e455d91de92f0aa3535c7 because the tablet was not found. No further retry: Not found: Tablet not found: c5c1a1c5e22e455d91de92f0aa3535c7
I20260928 10:44:25.445825 6270 tablet_replica.cc:330] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:25.446009 7958 leader_election.cc:288] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.446023 6270 raft_consensus.cc:2229] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.446156 6270 raft_consensus.cc:2258] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.430536 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.447008 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3a0fb7a0ca4c3c905bdf32f0ecaae4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.444007 8206 raft_consensus.cc:482] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.412400 6271 tablet_bootstrap.cc:654] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.447415 8206 raft_consensus.cc:504] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.448038 8206 leader_election.cc:288] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:25.448303 5817 leader_election.cc:341] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
W20260928 10:44:25.449082 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 509f7571433d4a93b806da738e046a68 consensus state has no leader
I20260928 10:44:25.449239 5693 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:45112 (request call id 1601) took 1294 ms. Trace:
I20260928 10:44:25.449301 5693 rpcz_store.cc:276] 0928 10:44:24.155176 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.245050 (+1089874us) service_pool.cc:227] Handling call
0928 10:44:25.419950 (+174900us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e0600586 00007fa6d78f3de6 00007fa6d78f3b15 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.420296 (+ 346us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:25.420499 (+ 203us) catalog_manager.cc:3616] Apply alter schema
0928 10:44:25.420699 (+ 200us) catalog_manager.cc:3639] Acquired catalog manager lock
0928 10:44:25.420780 (+ 81us) catalog_manager.cc:3786] Updating metadata on disk
0928 10:44:25.448866 (+ 28086us) catalog_manager.cc:3817] Committing alterations to in-memory state
0928 10:44:25.449222 (+ 356us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.427859 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.428001 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.428006 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.428008 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.428096 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.428106 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.428111 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.428168 (+ 57us) tablet.cc:699] Row locks acquired
0928 10:44:25.428170 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.428199 (+ 29us) write_op.cc:270] Start()
0928 10:44:25.428228 (+ 29us) write_op.cc:276] Timestamp: P: 1790592265428138 usec, L: 0
0928 10:44:25.428231 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.428382 (+ 151us) log.cc:842] Serialized 405 byte log entry
0928 10:44:25.443782 (+ 15400us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.444256 (+ 474us) write_op.cc:301] APPLY: starting
0928 10:44:25.444278 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.444324 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.444349 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.444410 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.444450 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.444455 (+ 5us) write_op.cc:312] APPLY: finished
0928 10:44:25.444569 (+ 114us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.444644 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.444667 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:25.444675 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.444734 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.444737 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":401570560,"child_traces":[["op",{"apply.queue_time_us":399,"apply.run_cpu_time_us":546,"apply.run_wall_time_us":547,"num_ops":1,"prepare.queue_time_us":6630,"prepare.run_cpu_time_us":619,"prepare.run_wall_time_us":618,"raft.queue_time_us":61,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":15523}]]}
I20260928 10:44:25.450100 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_fe50ad3f7d3747b493b0adc467e88325" } new_table_name: "default.Table_5c118d9a8c1e43ef93fdbf18a51477ba" modify_external_catalogs: true
I20260928 10:44:25.453397 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.453572 6138 raft_consensus.cc:3037] T 22f47338950743eb8a06e779a3ca5c69 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:25.454003 5955 leader_election.cc:341] T ba67a229f61e4a6b8078b59fe89fae7f P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.459882 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03fd57e996c486384f92000925aff8a" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.461182 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcecdf79aafe497080e2a1f6256ef6fd" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:25.461474 5693 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed1d3dd8a4d741199a8349a4d9520432 consensus state has no leader
I20260928 10:44:25.461676 5693 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:45112 (request call id 1605) took 1184 ms. Trace:
I20260928 10:44:25.461906 6091 leader_election.cc:302] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.461819 5693 rpcz_store.cc:276] 0928 10:44:24.277288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.449893 (+1172605us) service_pool.cc:227] Handling call
0928 10:44:25.450309 (+ 416us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:25.450555 (+ 246us) catalog_manager.cc:3616] Apply alter schema
0928 10:44:25.450952 (+ 397us) catalog_manager.cc:3639] Acquired catalog manager lock
0928 10:44:25.451018 (+ 66us) catalog_manager.cc:3786] Updating metadata on disk
0928 10:44:25.461229 (+ 10211us) catalog_manager.cc:3817] Committing alterations to in-memory state
0928 10:44:25.461656 (+ 427us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.451575 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.451679 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.451686 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:25.451689 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.451799 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.451813 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.451817 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.451886 (+ 69us) tablet.cc:699] Row locks acquired
0928 10:44:25.451888 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.451940 (+ 52us) write_op.cc:270] Start()
0928 10:44:25.451978 (+ 38us) write_op.cc:276] Timestamp: P: 1790592265451860 usec, L: 0
0928 10:44:25.451982 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.452173 (+ 191us) log.cc:842] Serialized 405 byte log entry
0928 10:44:25.458577 (+ 6404us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.458772 (+ 195us) write_op.cc:301] APPLY: starting
0928 10:44:25.458790 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.458832 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.458861 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.458915 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.458950 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.458957 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.459064 (+ 107us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.459131 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.459150 (+ 19us) write_op.cc:454] Released schema lock
0928 10:44:25.459158 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.459216 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.459219 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":498,"apply.run_wall_time_us":497,"num_ops":1,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":709,"raft.queue_time_us":520,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":8,"replication_time_us":6567}]]}
I20260928 10:44:25.462401 8202 raft_consensus.cc:3037] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.462751 6273 tablet_bootstrap.cc:492] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.462895 6273 ts_tablet_manager.cc:1397] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260928 10:44:25.462873 5693 master_service.cc:946] ReplaceTablet: received request to replace tablet e40f3de645114c2382cdfff53c22ce3c from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:25.463634 8140 raft_consensus.cc:482] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.463632 6273 raft_consensus.cc:348] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.463840 6273 raft_consensus.cc:374] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.463755 8140 raft_consensus.cc:504] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.463886 6273 raft_consensus.cc:729] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.464123 6273 consensus_queue.cc:260] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.464274 8140 leader_election.cc:288] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.464751 6273 ts_tablet_manager.cc:1428] T 1b6c19618aa84f24be0f9b1e4224f47f P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:25.464982 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.465210 6021 raft_consensus.cc:2379] T 4a9fb31988e4447f9c4a694056d6e54f P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate ab770e77cb704ea38b5ca8cff97dc73b in this term.
I20260928 10:44:25.465600 6273 tablet_bootstrap.cc:492] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:25.465898 6271 tablet_bootstrap.cc:492] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027: No bootstrap required, opened a new log
I20260928 10:44:25.465919 8202 raft_consensus.cc:2726] T 1f9fc7685a7541219b7207dc38b604e0 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.466030 6271 ts_tablet_manager.cc:1397] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.000s
I20260928 10:44:25.466754 6271 raft_consensus.cc:348] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.466950 6271 raft_consensus.cc:374] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.467006 6271 raft_consensus.cc:729] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.467187 6273 tablet_bootstrap.cc:654] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.467236 6271 consensus_queue.cc:260] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.467850 6271 ts_tablet_manager.cc:1428] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 10:44:25.468110 6271 tablet_bootstrap.cc:492] T ed443629ab604099a6fe5aff1840a553 P 2f6ffbf4f0534383bf89d15aa37e3027: Bootstrap starting.
I20260928 10:44:25.469565 6271 tablet_bootstrap.cc:654] T ed443629ab604099a6fe5aff1840a553 P 2f6ffbf4f0534383bf89d15aa37e3027: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.472199 6270 ts_tablet_manager.cc:1905] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.473192 5698 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1603) took 1241 ms. Trace:
I20260928 10:44:25.473289 5698 rpcz_store.cc:276] 0928 10:44:24.231316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.299495 (+1068179us) service_pool.cc:227] Handling call
0928 10:44:25.420600 (+121105us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.421281 (+ 681us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:25.455123 (+ 33842us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x6060000a86b8. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6cd4e9dcf 00007fa6cd4e9b00 00007fa6e0409853 00007fa6e0403c3f 00007fa6e03fcd35 00007fa6e05fe46a 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e
0928 10:44:25.455337 (+ 214us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.472921 (+ 17584us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.473067 (+ 146us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.473167 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.455854 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.455980 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.455987 (+ 7us) write_op.cc:435] Acquired schema lock
0928 10:44:25.455990 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.456095 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.456108 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.456113 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.456206 (+ 93us) tablet.cc:699] Row locks acquired
0928 10:44:25.456209 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.456249 (+ 40us) write_op.cc:270] Start()
0928 10:44:25.456289 (+ 40us) write_op.cc:276] Timestamp: P: 1790592265456181 usec, L: 0
0928 10:44:25.456293 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.456485 (+ 192us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.470440 (+ 13955us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.470995 (+ 555us) write_op.cc:301] APPLY: starting
0928 10:44:25.471016 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.471065 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.471093 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.471219 (+ 126us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.471258 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.471265 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.471356 (+ 91us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.471429 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.471452 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:25.471459 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":354563712,"child_traces":[["op",{"apply.queue_time_us":489,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":788,"raft.queue_time_us":35,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":14119}]]}
W20260928 10:44:25.473939 6091 leader_election.cc:341] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 503a4bcb9d37441aadf66b45238a3737
I20260928 10:44:25.473996 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a25a99ff9b81405db025150d99b40b96" } modify_external_catalogs: true
I20260928 10:44:25.474059 6091 leader_election.cc:302] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.474157 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_a25a99ff9b81405db025150d99b40b96" } modify_external_catalogs: true
I20260928 10:44:25.481739 5699 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1602) took 1318 ms. Trace:
I20260928 10:44:25.481871 5699 rpcz_store.cc:276] 0928 10:44:24.163677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.299221 (+1135544us) service_pool.cc:227] Handling call
0928 10:44:25.422727 (+123506us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.423259 (+ 532us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:25.475951 (+ 52692us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x6060000a86b8. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6cd4e9dcf 00007fa6cd4e9b00 00007fa6e0409853 00007fa6e0403c3f 00007fa6e03fcd35 00007fa6e05fe46a 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e
0928 10:44:25.476126 (+ 175us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.481473 (+ 5347us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.481627 (+ 154us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.481718 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.476882 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.476994 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.476998 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.477000 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.477071 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.477080 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.477084 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.477144 (+ 60us) tablet.cc:699] Row locks acquired
0928 10:44:25.477146 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.477171 (+ 25us) write_op.cc:270] Start()
0928 10:44:25.477195 (+ 24us) write_op.cc:276] Timestamp: P: 1790592265477156 usec, L: 0
0928 10:44:25.477199 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.477324 (+ 125us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.480774 (+ 3450us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.480846 (+ 72us) write_op.cc:301] APPLY: starting
0928 10:44:25.480864 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.480918 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.480946 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.481086 (+ 140us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.481126 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.481133 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.481216 (+ 83us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.481280 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.481300 (+ 20us) write_op.cc:454] Released schema lock
0928 10:44:25.481307 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.481362 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.481366 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":403849856,"child_traces":[["op",{"apply.queue_time_us":27,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":578,"num_ops":2,"prepare.queue_time_us":324,"prepare.run_cpu_time_us":575,"prepare.run_wall_time_us":967,"raft.queue_time_us":333,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":6,"replication_time_us":3563}]]}
I20260928 10:44:25.482553 5699 master_service.cc:946] ReplaceTablet: received request to replace tablet 780dd46414fe4dfc812f1a308162b8f4 from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:25.484119 6273 tablet_bootstrap.cc:492] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.484254 6273 ts_tablet_manager.cc:1397] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20260928 10:44:25.484987 6273 raft_consensus.cc:348] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.485188 6273 raft_consensus.cc:374] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.485242 6273 raft_consensus.cc:729] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.485476 6273 consensus_queue.cc:260] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.485880 6273 ts_tablet_manager.cc:1428] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 10:44:25.486125 6273 tablet_bootstrap.cc:492] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
W20260928 10:44:25.487237 6091 leader_election.cc:341] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 57b7976063024775b9dde91b32010754
I20260928 10:44:25.487362 6091 leader_election.cc:302] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.487637 8140 raft_consensus.cc:2726] T 57b7976063024775b9dde91b32010754 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.487695 8146 raft_consensus.cc:482] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.487805 8146 raft_consensus.cc:504] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.488121 8191 raft_consensus.cc:482] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.488237 8191 raft_consensus.cc:504] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.488376 8146 leader_election.cc:288] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.488795 8191 leader_election.cc:288] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.488914 6138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257d722a42e44f4ac554b1ebe7d8e31" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.489069 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a3a0fb7a0ca4c3c905bdf32f0ecaae4" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
W20260928 10:44:25.489703 5817 leader_election.cc:341] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.490195 6138 raft_consensus.cc:3037] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.490213 5866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c0af95fa58451490947176ec9301e3" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.491351 5695 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1604) took 1225 ms. Trace:
I20260928 10:44:25.491444 5695 rpcz_store.cc:276] 0928 10:44:24.265540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.303626 (+1038086us) service_pool.cc:227] Handling call
0928 10:44:25.423634 (+120008us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.424129 (+ 495us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:25.476603 (+ 52474us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x6060000a86b8. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6cd4e9dcf 00007fa6cd4e9b00 00007fa6e0409853 00007fa6e0403c3f 00007fa6e03fcd35 00007fa6e05fe46a 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e
0928 10:44:25.476762 (+ 159us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.491115 (+ 14353us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.491244 (+ 129us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.491331 (+ 87us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.477792 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.477875 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.477880 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.477882 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.477958 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.477966 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.477970 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.478029 (+ 59us) tablet.cc:699] Row locks acquired
0928 10:44:25.478031 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.478057 (+ 26us) write_op.cc:270] Start()
0928 10:44:25.478082 (+ 25us) write_op.cc:276] Timestamp: P: 1790592265478042 usec, L: 0
0928 10:44:25.478085 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.478210 (+ 125us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.483080 (+ 4870us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.490580 (+ 7500us) write_op.cc:301] APPLY: starting
0928 10:44:25.490607 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.490650 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.490676 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.490794 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.490831 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.490838 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.490922 (+ 84us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.490985 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.491003 (+ 18us) write_op.cc:454] Released schema lock
0928 10:44:25.491010 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":395426944,"child_traces":[["op",{"apply.queue_time_us":7433,"num_ops":2,"prepare.queue_time_us":704,"prepare.run_cpu_time_us":509,"prepare.run_wall_time_us":557,"raft.queue_time_us":32,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":4973}]]}
I20260928 10:44:25.492167 5695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_be4d1ac72b4d4b6b800c5581b54a252f" } modify_external_catalogs: true
I20260928 10:44:25.492352 5695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_be4d1ac72b4d4b6b800c5581b54a252f" } modify_external_catalogs: true
I20260928 10:44:25.495314 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22c4cea3f8ea413493c3ac23f83d0801" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.496354 5955 leader_election.cc:341] T 22c4cea3f8ea413493c3ac23f83d0801 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.497668 5694 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:45112 (request call id 1600) took 1381 ms. Trace:
I20260928 10:44:25.498181 6273 tablet_bootstrap.cc:654] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.497767 5694 rpcz_store.cc:276] 0928 10:44:24.116394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.241962 (+1125568us) service_pool.cc:227] Handling call
0928 10:44:25.421717 (+179755us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05fe313 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.422285 (+ 568us) catalog_manager.cc:2075] Acquired catalog manager lock
0928 10:44:25.475129 (+ 52844us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x6060000a86b8. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6cd4e9dcf 00007fa6cd4e9b00 00007fa6e0409853 00007fa6e0403c3f 00007fa6e03fcd35 00007fa6e05fe46a 00007fa6d78f0466 00007fa6d78f0195 00007fa6d41049be 00007fa6d410379e
0928 10:44:25.475326 (+ 197us) catalog_manager.cc:2121] Created new table and tablet info
0928 10:44:25.497400 (+ 22074us) catalog_manager.cc:2181] Wrote table and tablets to system table
0928 10:44:25.497537 (+ 137us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0928 10:44:25.497644 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.475978 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.476122 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.476127 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.476130 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.476224 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.476237 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.476242 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.476321 (+ 79us) tablet.cc:699] Row locks acquired
0928 10:44:25.476323 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.476356 (+ 33us) write_op.cc:270] Start()
0928 10:44:25.476503 (+ 147us) write_op.cc:276] Timestamp: P: 1790592265476339 usec, L: 0
0928 10:44:25.476507 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.476662 (+ 155us) log.cc:842] Serialized 433 byte log entry
0928 10:44:25.480714 (+ 4052us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.496676 (+ 15962us) write_op.cc:301] APPLY: starting
0928 10:44:25.496698 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.496748 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.496778 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.497022 (+ 244us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.497110 (+ 88us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 10:44:25.497118 (+ 8us) write_op.cc:312] APPLY: finished
0928 10:44:25.497210 (+ 92us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.497285 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.497308 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:25.497316 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":533418624,"child_traces":[["op",{"apply.queue_time_us":32,"num_ops":2,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":685,"prepare.run_wall_time_us":792,"raft.queue_time_us":1584,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":220,"replication_time_us":4186}]]}
I20260928 10:44:25.498579 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7c0a69fd002a4faba685a359316788fb" } modify_external_catalogs: true
I20260928 10:44:25.498771 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_7c0a69fd002a4faba685a359316788fb" } modify_external_catalogs: true
I20260928 10:44:25.504366 6275 tablet_bootstrap.cc:492] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.504531 6275 ts_tablet_manager.cc:1397] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260928 10:44:25.505254 6275 raft_consensus.cc:348] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.505481 6275 raft_consensus.cc:374] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.505537 6275 raft_consensus.cc:729] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.505759 6275 consensus_queue.cc:260] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.506560 6275 ts_tablet_manager.cc:1428] T 78295825061a4d75984e2d6e110e1c55 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 10:44:25.506846 6275 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
I20260928 10:44:25.509081 6275 tablet_bootstrap.cc:654] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.514389 8167 raft_consensus.cc:482] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.514680 8167 raft_consensus.cc:504] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.515872 8167 leader_election.cc:288] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:25.516206 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946188e312c6424f81926465667b5e11" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.516444 8202 raft_consensus.cc:2726] T 503a4bcb9d37441aadf66b45238a3737 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.516770 5817 leader_election.cc:341] T 946188e312c6424f81926465667b5e11 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.522063 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9fb31988e4447f9c4a694056d6e54f" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.536789 5699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 780dd46414fe4dfc812f1a308162b8f4
I20260928 10:44:25.537227 5699 catalog_manager.cc:6565] ReplaceTablet: tablet 780dd46414fe4dfc812f1a308162b8f4 deleted and replaced by tablet 51c6de3fdab94e78bde04a50aa20896c
I20260928 10:44:25.537712 5873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39e1e4d18d6450580e28614ae4c2895" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b"
I20260928 10:44:25.537914 5873 raft_consensus.cc:3037] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.540016 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 9cf66ffbaf9f401a8d9635911616748e
I20260928 10:44:25.540441 5698 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:45112 (request call id 1607) took 1019 ms. Trace:
I20260928 10:44:25.540431 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 51c6de3fdab94e78bde04a50aa20896c) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.540470 5873 raft_consensus.cc:2454] T d39e1e4d18d6450580e28614ae4c2895 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
I20260928 10:44:25.540522 5698 rpcz_store.cc:276] 0928 10:44:24.521278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.473851 (+952573us) service_pool.cc:227] Handling call
0928 10:44:25.474256 (+ 405us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:25.474380 (+ 124us) catalog_manager.cc:2752] Modifying in-memory table state
0928 10:44:25.474444 (+ 64us) catalog_manager.cc:2761] Locking tablets
0928 10:44:25.527217 (+ 52773us) catalog_manager.cc:2775] Removing table and tablets from system table
0928 10:44:25.539727 (+ 12510us) catalog_manager.cc:2793] Removing table from by-name map
0928 10:44:25.539942 (+ 215us) catalog_manager.cc:2809] Committing in-memory state
0928 10:44:25.539987 (+ 45us) catalog_manager.cc:2813] Aborting table tasks
0928 10:44:25.540421 (+ 434us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.528038 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.528120 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.528125 (+ 5us) write_op.cc:435] Acquired schema lock
0928 10:44:25.528127 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.528215 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.528223 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.528227 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.528306 (+ 79us) tablet.cc:699] Row locks acquired
0928 10:44:25.528308 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.528336 (+ 28us) write_op.cc:270] Start()
0928 10:44:25.528361 (+ 25us) write_op.cc:276] Timestamp: P: 1790592265528316 usec, L: 0
0928 10:44:25.528364 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.528498 (+ 134us) log.cc:842] Serialized 728 byte log entry
0928 10:44:25.535603 (+ 7105us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.539147 (+ 3544us) write_op.cc:301] APPLY: starting
0928 10:44:25.539163 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.539202 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.539225 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.539287 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.539319 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 10:44:25.539324 (+ 5us) write_op.cc:312] APPLY: finished
0928 10:44:25.539551 (+ 227us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.539626 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.539643 (+ 17us) write_op.cc:454] Released schema lock
0928 10:44:25.539650 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.539769 (+ 119us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.539773 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3491,"apply.run_cpu_time_us":498,"apply.run_wall_time_us":703,"num_ops":2,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":562,"prepare.run_wall_time_us":1074,"raft.queue_time_us":340,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":7225}]]}
I20260928 10:44:25.541060 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cf66ffbaf9f401a8d9635911616748e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.541184 5698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b7bbc2010da495f9ad7159ec2337c93" } modify_external_catalogs: true
I20260928 10:44:25.541347 5698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_8b7bbc2010da495f9ad7159ec2337c93" } modify_external_catalogs: true
I20260928 10:44:25.541443 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba67a229f61e4a6b8078b59fe89fae7f" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.541621 5869 raft_consensus.cc:2454] T ba67a229f61e4a6b8078b59fe89fae7f P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:25.542716 6273 tablet_bootstrap.cc:492] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.542842 6273 ts_tablet_manager.cc:1397] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.000s
I20260928 10:44:25.543255 5869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22c4cea3f8ea413493c3ac23f83d0801" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.543470 5869 raft_consensus.cc:2454] T 22c4cea3f8ea413493c3ac23f83d0801 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 0.
I20260928 10:44:25.543593 6273 raft_consensus.cc:348] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.543789 6273 raft_consensus.cc:374] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.543853 6273 raft_consensus.cc:729] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab770e77cb704ea38b5ca8cff97dc73b, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.543931 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cf66ffbaf9f401a8d9635911616748e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.544044 6273 consensus_queue.cc:260] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.544281 8146 raft_consensus.cc:482] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.544385 8146 raft_consensus.cc:504] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.544553 6273 ts_tablet_manager.cc:1428] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 10:44:25.544792 6273 tablet_bootstrap.cc:492] T 7c07d2f6a5c1402c9768b84177f52fc2 P ab770e77cb704ea38b5ca8cff97dc73b: Bootstrap starting.
I20260928 10:44:25.544885 8146 leader_election.cc:288] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:25.545218 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 9cf66ffbaf9f401a8d9635911616748e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cf66ffbaf9f401a8d9635911616748e already in progress: creating tablet
I20260928 10:44:25.545503 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99da54941a4eaf9107f4b2efca5c7b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.545583 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 51c6de3fdab94e78bde04a50aa20896c) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.546166 6273 tablet_bootstrap.cc:654] T 7c07d2f6a5c1402c9768b84177f52fc2 P ab770e77cb704ea38b5ca8cff97dc73b: Neither blocks nor log segments found. Creating new log.
W20260928 10:44:25.546754 5817 leader_election.cc:341] T de99da54941a4eaf9107f4b2efca5c7b P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.547758 5695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet d4ddf3ba4d594607b3fc3ae96797bd03
I20260928 10:44:25.547816 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet c683d17d41e243e798cf9837fa88a4c9
I20260928 10:44:25.548385 5694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f7126c7e16a04b4eb1bb6fa9820f35f1" } modify_external_catalogs: true
I20260928 10:44:25.548578 5694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f7126c7e16a04b4eb1bb6fa9820f35f1" } modify_external_catalogs: true
I20260928 10:44:25.548476 5695 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_def962a990ae4274a6327ae83fb2aa16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.549026 5695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_def962a990ae4274a6327ae83fb2aa16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.549626 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1047) took 7996 ms. Trace:
I20260928 10:44:25.549723 6269 rpcz_store.cc:276] 0928 10:44:17.553327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.553432 (+ 105us) service_pool.cc:227] Handling call
0928 10:44:24.836954 (+7283522us) ts_tablet_manager.cc:1145] Deleting tablet 78295825061a4d75984e2d6e110e1c55
0928 10:44:24.836971 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:24.940964 (+103993us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.089878 (+148914us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.549598 (+459720us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13337,"tablet-delete.queue_time_us":7283257}
I20260928 10:44:25.550216 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1050) took 7849 ms. Trace:
I20260928 10:44:25.550293 6269 rpcz_store.cc:276] 0928 10:44:17.700375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.700450 (+ 75us) service_pool.cc:227] Handling call
0928 10:44:25.550056 (+7849606us) ts_tablet_manager.cc:1145] Deleting tablet 1415cbe9fa15468a91932cdec4612cf9
0928 10:44:25.550069 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.550197 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7849404}
I20260928 10:44:25.550724 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet c683d17d41e243e798cf9837fa88a4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.550927 5860 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.552207 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 78295825061a4d75984e2d6e110e1c55 (table default.Table_9f429f420bbd495c91b854218a0a06f5 [id=86988e047ddc41758ee67111b73d0012]) successfully deleted
W20260928 10:44:25.552454 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 1415cbe9fa15468a91932cdec4612cf9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1415cbe9fa15468a91932cdec4612cf9 already in progress: creating tablet
I20260928 10:44:25.552762 8146 raft_consensus.cc:482] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.552882 8146 raft_consensus.cc:504] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.553463 8146 leader_election.cc:288] T 03ebfc156361479c909ff263c3be4601 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
W20260928 10:44:25.555322 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 780dd46414fe4dfc812f1a308162b8f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 780dd46414fe4dfc812f1a308162b8f4 already in progress: creating tablet
I20260928 10:44:25.555322 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:25.555552 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:25.555838 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:25.555938 6135 tablet_service.cc:1514] Processing DeleteTablet for tablet c683d17d41e243e798cf9837fa88a4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.555984 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet d6c48b8a7efa41a684205df3e6969370 (table default.Table_45fb73a0f9e1445c8e355b4dad0839df [id=5746764388a94c4aa38985de816e9c54]). Expected version 1 got 0
I20260928 10:44:25.556118 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:25.556304 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_e51c54bdc7ea467491d09018c4ea3e3c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]). Expected version 3 got 0
I20260928 10:44:25.556212 8146 consensus_queue.cc:1035] T 4a9fb31988e4447f9c4a694056d6e54f P ab770e77cb704ea38b5ca8cff97dc73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 10:44:25.556397 6129 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.556459 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet eb945bc6b99a44e0932b2a94f05db6c2 (table default.Table_ac3382f500e2403598a7004fd31acc46 [id=f0c8d3a675f345389434e9530f4ed05a]). Expected version 3 got 0
I20260928 10:44:25.556661 5697 catalog_manager.cc:5587] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035) does not have the latest schema for tablet f913900914d149b48d64a0d53908482c (table default.Table_1adc425e9154432e8363944146e9b0ac [id=5d219895c430475a9216792176b8c0cf]). Expected version 3 got 0
W20260928 10:44:25.556917 5818 leader_election.cc:341] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.557053 5818 leader_election.cc:302] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.557245 8146 raft_consensus.cc:2726] T 1c056c078c95461b82c1ca1f31d90752 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.557529 5818 leader_election.cc:341] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.557618 5818 leader_election.cc:302] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.557801 8146 raft_consensus.cc:2726] T d03fd57e996c486384f92000925aff8a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.558146 5818 leader_election.cc:341] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.558245 5818 leader_election.cc:302] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
W20260928 10:44:25.558341 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet c683d17d41e243e798cf9837fa88a4c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c683d17d41e243e798cf9837fa88a4c9 already in progress: creating tablet
I20260928 10:44:25.558416 8146 raft_consensus.cc:2726] T bcecdf79aafe497080e2a1f6256ef6fd P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 10:44:25.558576 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet d4ddf3ba4d594607b3fc3ae96797bd03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4ddf3ba4d594607b3fc3ae96797bd03 already in progress: creating tablet
W20260928 10:44:25.559024 5818 leader_election.cc:341] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.559130 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 5539f8d8794449c3bf862ec6e058cff4 (DEFAULT_TABLE table=default.Table_86a12dcfc994445c92fa44e3eb8bfa0f [id=bd624d347b9a42daa765a98934ddf18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.559129 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 5539f8d8794449c3bf862ec6e058cff4 (DEFAULT_TABLE table=default.Table_86a12dcfc994445c92fa44e3eb8bfa0f [id=bd624d347b9a42daa765a98934ddf18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.559513 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5539f8d8794449c3bf862ec6e058cff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.559513 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5539f8d8794449c3bf862ec6e058cff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.564889 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 871fb70fea304b08bebce18c60998209 (table default.Table_24fe230debec4239b8c473528085c2ed [id=3888c975417043cb8b36d7b70c48e612]). Expected version 1 got 0
I20260928 10:44:25.565299 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 0b67cd4597914a1483fe2bad4de4a8b8 (table default.Table_41dd2a3c11bc45cfa4df997465553ffe [id=43fdc25832e9430e9b57f1dd89d59301]). Expected version 1 got 0
I20260928 10:44:25.565716 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet ed7cd14e0039402ea51f34e8b88e2605 (table default.Table_4527e778dec6400a88d3f4d152764a21 [id=4f40ed0655ac4f5ebe6585bbe58b6e17]). Expected version 2 got 0
I20260928 10:44:25.565930 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 59c67a02d7f84bed9c440c8c451ea4ff (table default.Table_5101a41ebd1d448aba9997e49dd8cfd7 [id=5da24947876c4b628eb01c54da1c3347]). Expected version 2 got 0
I20260928 10:44:25.566779 6135 tablet_service.cc:1467] Processing CreateTablet for tablet 45a47b9af4c6428a8516e3cdde462aa9 (DEFAULT_TABLE table=default.Table_145c1731edea4384886c28efb4d427b2 [id=1390e9aa4eb34738b893fdbe09c20ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.567174 6135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a47b9af4c6428a8516e3cdde462aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.569613 5860 tablet_service.cc:1467] Processing CreateTablet for tablet 45a47b9af4c6428a8516e3cdde462aa9 (DEFAULT_TABLE table=default.Table_145c1731edea4384886c28efb4d427b2 [id=1390e9aa4eb34738b893fdbe09c20ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.569967 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a47b9af4c6428a8516e3cdde462aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.559137 5818 leader_election.cc:302] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.573777 8146 raft_consensus.cc:2726] T 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.575574 6091 leader_election.cc:302] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.576004 8202 raft_consensus.cc:2726] T 58c0af95fa58451490947176ec9301e3 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.576510 6269 tablet_replica.cc:330] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:25.576725 6269 raft_consensus.cc:2229] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.576885 6269 raft_consensus.cc:2258] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.577716 6269 ts_tablet_manager.cc:1905] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.578358 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 0471f13e231a442b80405b75f0b9a3c2 (DEFAULT_TABLE table=default.Table_d9c155961e06410eae6973422e546180 [id=475b2400237b4c9fa317803ae3319dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.579182 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471f13e231a442b80405b75f0b9a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.583040 6091 leader_election.cc:302] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
W20260928 10:44:25.583165 5687 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf -> Peer a2eb817eda984ab99ec4704c47699846 (127.5.100.126:39997): Couldn't send request to peer a2eb817eda984ab99ec4704c47699846. Status: Network error: Client connection negotiation failed: client connection to 127.5.100.126:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 10:44:25.583467 8202 raft_consensus.cc:3037] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.585870 8202 raft_consensus.cc:2726] T 4a9fb31988e4447f9c4a694056d6e54f P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.586653 6269 ts_tablet_manager.cc:1918] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 10:44:25.586756 6269 log.cc:1196] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-0/wal/wals/9012fa19e01f43238c895a84c6dc9815
I20260928 10:44:25.587039 6269 ts_tablet_manager.cc:1939] T 9012fa19e01f43238c895a84c6dc9815 P ab770e77cb704ea38b5ca8cff97dc73b: Deleting consensus metadata
I20260928 10:44:25.587646 6134 tablet_service.cc:1467] Processing CreateTablet for tablet 0471f13e231a442b80405b75f0b9a3c2 (DEFAULT_TABLE table=default.Table_d9c155961e06410eae6973422e546180 [id=475b2400237b4c9fa317803ae3319dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.587754 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1052) took 7886 ms. Trace:
I20260928 10:44:25.587842 6269 rpcz_store.cc:276] 0928 10:44:17.700852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.700898 (+ 46us) service_pool.cc:227] Handling call
0928 10:44:25.576456 (+7875558us) ts_tablet_manager.cc:1145] Deleting tablet 9012fa19e01f43238c895a84c6dc9815
0928 10:44:25.576470 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.581510 (+ 5040us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.586565 (+ 5055us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.587730 (+ 1165us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7875420}
I20260928 10:44:25.588001 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471f13e231a442b80405b75f0b9a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.588199 5688 catalog_manager.cc:4841] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): tablet 9012fa19e01f43238c895a84c6dc9815 (table default.Table_74b56feae3a142d1931815dd8a85abc1 [id=50bf91efd5f24016b5b2b68b53939cec]) successfully deleted
I20260928 10:44:25.590227 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 57062e910c6b4189af00e3226b5d5554 (DEFAULT_TABLE table=default.Table_d4d5233b49dc4cc7b595c2303f40426d [id=6662deac4c294f50875181fe46ec8d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.590646 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57062e910c6b4189af00e3226b5d5554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.591404 8146 raft_consensus.cc:482] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.591518 8146 raft_consensus.cc:504] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.592029 8146 leader_election.cc:288] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.594740 5860 tablet_service.cc:1467] Processing CreateTablet for tablet f35e622b83d84b3da513ad001e510e10 (DEFAULT_TABLE table=default.Table_2d7b55c1a9bd4f21948bffc6f81d9213 [id=856768ebb9934bfc81df0491fc9458cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.595094 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35e622b83d84b3da513ad001e510e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.596836 6125 tablet_service.cc:1467] Processing CreateTablet for tablet a37b3a30b92b4224aa341876745a3c41 (DEFAULT_TABLE table=default.Table_a579299b68764bf0b39b1df631599e07 [id=2ed11fed7cbc4b90be303de44827253a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.597222 6125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a37b3a30b92b4224aa341876745a3c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.597312 6127 tablet_service.cc:1467] Processing CreateTablet for tablet 57062e910c6b4189af00e3226b5d5554 (DEFAULT_TABLE table=default.Table_d4d5233b49dc4cc7b595c2303f40426d [id=6662deac4c294f50875181fe46ec8d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.597637 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57062e910c6b4189af00e3226b5d5554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.598734 6128 tablet_service.cc:1467] Processing CreateTablet for tablet 21433270371f4766b83975ae8ee929dc (DEFAULT_TABLE table=default.Table_86c20c02744a4c969787c39d93471ee7 [id=52b717a902f04e35b7fe2cea090b919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.598840 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e6a1cfc1f2b409889eb91ff2b8b0c4d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.599044 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21433270371f4766b83975ae8ee929dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.602752 6117 tablet_service.cc:1467] Processing CreateTablet for tablet a24448f2727c4693b457658ea4018f6b (DEFAULT_TABLE table=default.Table_b3197981b769443e845cda268a219ac6 [id=792f4fff27694a6b84b4f0ed421dfbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.602905 6132 tablet_service.cc:1467] Processing CreateTablet for tablet 53e3962a3b6e4930afd8c4371f7ff783 (DEFAULT_TABLE table=default.Table_a09c98a1baca4a3baf60afa1750cba65 [id=3642b341fb61454693c4055bec932f03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.603272 6124 tablet_service.cc:1467] Processing CreateTablet for tablet eb8808681bb14f2c98e0c1547d6f10ac (DEFAULT_TABLE table=default.Table_72f42dac40bb4428988d48eed7c63c2a [id=8837b1c35aff4bf4a9ca7640bc014a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.602730 6121 tablet_service.cc:1467] Processing CreateTablet for tablet cbc2d485f8e743e3b54d6e60eecfefa9 (DEFAULT_TABLE table=default.Table_72aaa451c22e47a08a4af3a70faf6d93 [id=e0e49ec742c0416fa195b38c640544d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.603713 6118 tablet_service.cc:1467] Processing CreateTablet for tablet 1431ccf16d424d6b8d3a4024bc73ab5b (DEFAULT_TABLE table=default.Table_111ce6d205c444739a5082270fef23ed [id=b7f1a94c67094be39463eaa537e762de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.603972 6119 tablet_service.cc:1467] Processing CreateTablet for tablet 670d3d3d2c0641b9a4db7a0731f52ae9 (DEFAULT_TABLE table=default.Table_2c99db41386445eea2e6eb8acda300ea [id=ada29f1aa3e04fdbaa9ea7364c42ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.604161 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 861b7d40db7d4c9fa99886cd9228b7fe (DEFAULT_TABLE table=default.Table_431546713d5f45f19cc93a06e85ba939 [id=325e8692a1dd4150945ae0d573472638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.604746 6133 tablet_service.cc:1467] Processing CreateTablet for tablet bed6ef18fa804968bdf96a57baca2a5b (DEFAULT_TABLE table=default.Table_d7765f14238742898bbc21e75798d446 [id=572104292c09444f8f838ddee1cbddbb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:25.604765 5817 leader_election.cc:341] T 6e6a1cfc1f2b409889eb91ff2b8b0c4d P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.605150 6122 tablet_service.cc:1467] Processing CreateTablet for tablet 45da18d481fb4f83b01703da20c52408 (DEFAULT_TABLE table=default.Table_d02af101f64d46a8ae074ddfb8d45afa [id=54306bea077f4a8280b5ca07ef101143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.602730 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd9b7b8a971456b858aad109496b87a (DEFAULT_TABLE table=default.Table_ae94d412a89b44a484fcaa2c3eaf30f0 [id=465c168402cd45b290229880fd8e2b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.606709 5862 tablet_service.cc:1467] Processing CreateTablet for tablet a37b3a30b92b4224aa341876745a3c41 (DEFAULT_TABLE table=default.Table_a579299b68764bf0b39b1df631599e07 [id=2ed11fed7cbc4b90be303de44827253a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.607107 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a37b3a30b92b4224aa341876745a3c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.607241 5856 tablet_service.cc:1467] Processing CreateTablet for tablet bed6ef18fa804968bdf96a57baca2a5b (DEFAULT_TABLE table=default.Table_d7765f14238742898bbc21e75798d446 [id=572104292c09444f8f838ddee1cbddbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.607564 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed6ef18fa804968bdf96a57baca2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.607524 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 21433270371f4766b83975ae8ee929dc (DEFAULT_TABLE table=default.Table_86c20c02744a4c969787c39d93471ee7 [id=52b717a902f04e35b7fe2cea090b919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.607826 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21433270371f4766b83975ae8ee929dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.608033 5858 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd9b7b8a971456b858aad109496b87a (DEFAULT_TABLE table=default.Table_ae94d412a89b44a484fcaa2c3eaf30f0 [id=465c168402cd45b290229880fd8e2b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.608045 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 1431ccf16d424d6b8d3a4024bc73ab5b (DEFAULT_TABLE table=default.Table_111ce6d205c444739a5082270fef23ed [id=b7f1a94c67094be39463eaa537e762de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.608358 5858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd9b7b8a971456b858aad109496b87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.608726 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1431ccf16d424d6b8d3a4024bc73ab5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.610749 5864 tablet_service.cc:1467] Processing CreateTablet for tablet 53e3962a3b6e4930afd8c4371f7ff783 (DEFAULT_TABLE table=default.Table_a09c98a1baca4a3baf60afa1750cba65 [id=3642b341fb61454693c4055bec932f03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.610934 5851 tablet_service.cc:1467] Processing CreateTablet for tablet 861b7d40db7d4c9fa99886cd9228b7fe (DEFAULT_TABLE table=default.Table_431546713d5f45f19cc93a06e85ba939 [id=325e8692a1dd4150945ae0d573472638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.611057 5864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e3962a3b6e4930afd8c4371f7ff783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.611248 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861b7d40db7d4c9fa99886cd9228b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.610934 5849 tablet_service.cc:1467] Processing CreateTablet for tablet eb8808681bb14f2c98e0c1547d6f10ac (DEFAULT_TABLE table=default.Table_72f42dac40bb4428988d48eed7c63c2a [id=8837b1c35aff4bf4a9ca7640bc014a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.611811 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8808681bb14f2c98e0c1547d6f10ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.614312 5854 tablet_service.cc:1467] Processing CreateTablet for tablet 670d3d3d2c0641b9a4db7a0731f52ae9 (DEFAULT_TABLE table=default.Table_2c99db41386445eea2e6eb8acda300ea [id=ada29f1aa3e04fdbaa9ea7364c42ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.614651 5854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 670d3d3d2c0641b9a4db7a0731f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.610745 5855 tablet_service.cc:1467] Processing CreateTablet for tablet a24448f2727c4693b457658ea4018f6b (DEFAULT_TABLE table=default.Table_b3197981b769443e845cda268a219ac6 [id=792f4fff27694a6b84b4f0ed421dfbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.618943 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24448f2727c4693b457658ea4018f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.610745 5857 tablet_service.cc:1467] Processing CreateTablet for tablet cbc2d485f8e743e3b54d6e60eecfefa9 (DEFAULT_TABLE table=default.Table_72aaa451c22e47a08a4af3a70faf6d93 [id=e0e49ec742c0416fa195b38c640544d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.622917 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbc2d485f8e743e3b54d6e60eecfefa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.630828 6133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed6ef18fa804968bdf96a57baca2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631047 6121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbc2d485f8e743e3b54d6e60eecfefa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631280 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd9b7b8a971456b858aad109496b87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631462 6119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 670d3d3d2c0641b9a4db7a0731f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631613 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45da18d481fb4f83b01703da20c52408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631747 6132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e3962a3b6e4930afd8c4371f7ff783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.631929 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24448f2727c4693b457658ea4018f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.634588 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861b7d40db7d4c9fa99886cd9228b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.638327 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1431ccf16d424d6b8d3a4024bc73ab5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.642091 8145 raft_consensus.cc:482] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.642247 8145 raft_consensus.cc:504] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.643375 6124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8808681bb14f2c98e0c1547d6f10ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:25.649837 5686 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 148a0e6334424831abbb6c19d6b39baa (table default.Table_4e7a6e050c5d44c89e7e4108da272948 [id=2bc11b1516a445fbbb1d97f05bf679d5], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 148a0e6334424831abbb6c19d6b39baa consensus state has no leader
I20260928 10:44:25.575095 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257d722a42e44f4ac554b1ebe7d8e31" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.651157 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 780dd46414fe4dfc812f1a308162b8f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 51c6de3fdab94e78bde04a50aa20896c) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.651846 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cf66ffbaf9f401a8d9635911616748e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.652387 6013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946188e312c6424f81926465667b5e11" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.652496 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e6a1cfc1f2b409889eb91ff2b8b0c4d" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.652320 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99da54941a4eaf9107f4b2efca5c7b" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.652318 6019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ebfc156361479c909ff263c3be4601" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.653491 8145 leader_election.cc:288] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.654654 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcecdf79aafe497080e2a1f6256ef6fd" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.655898 6153 raft_consensus.cc:3037] T adb1f2e6392b4329b5520d0e292d6f98 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
W20260928 10:44:25.657398 5818 leader_election.cc:341] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.657514 5818 leader_election.cc:302] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab770e77cb704ea38b5ca8cff97dc73b; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94
I20260928 10:44:25.658955 5985 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ddf3ba4d594607b3fc3ae96797bd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:46336
W20260928 10:44:25.659085 5955 leader_election.cc:341] T bcecdf79aafe497080e2a1f6256ef6fd P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.659474 5985 tablet_service.cc:1467] Processing CreateTablet for tablet 45a47b9af4c6428a8516e3cdde462aa9 (DEFAULT_TABLE table=default.Table_145c1731edea4384886c28efb4d427b2 [id=1390e9aa4eb34738b893fdbe09c20ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.659759 5999 tablet_service.cc:1467] Processing CreateTablet for tablet 21433270371f4766b83975ae8ee929dc (DEFAULT_TABLE table=default.Table_86c20c02744a4c969787c39d93471ee7 [id=52b717a902f04e35b7fe2cea090b919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.659868 5985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a47b9af4c6428a8516e3cdde462aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.659847 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 53e3962a3b6e4930afd8c4371f7ff783 (DEFAULT_TABLE table=default.Table_a09c98a1baca4a3baf60afa1750cba65 [id=3642b341fb61454693c4055bec932f03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.660108 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21433270371f4766b83975ae8ee929dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.660285 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e3962a3b6e4930afd8c4371f7ff783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.660384 5994 tablet_service.cc:1467] Processing CreateTablet for tablet 861b7d40db7d4c9fa99886cd9228b7fe (DEFAULT_TABLE table=default.Table_431546713d5f45f19cc93a06e85ba939 [id=325e8692a1dd4150945ae0d573472638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.660539 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet c683d17d41e243e798cf9837fa88a4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.660770 5983 tablet_service.cc:1467] Processing CreateTablet for tablet 670d3d3d2c0641b9a4db7a0731f52ae9 (DEFAULT_TABLE table=default.Table_2c99db41386445eea2e6eb8acda300ea [id=ada29f1aa3e04fdbaa9ea7364c42ef00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.660847 5997 tablet_service.cc:1467] Processing CreateTablet for tablet 5539f8d8794449c3bf862ec6e058cff4 (DEFAULT_TABLE table=default.Table_86a12dcfc994445c92fa44e3eb8bfa0f [id=bd624d347b9a42daa765a98934ddf18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.661062 5983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 670d3d3d2c0641b9a4db7a0731f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.661247 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 0471f13e231a442b80405b75f0b9a3c2 (DEFAULT_TABLE table=default.Table_d9c155961e06410eae6973422e546180 [id=475b2400237b4c9fa317803ae3319dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.661548 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0471f13e231a442b80405b75f0b9a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.661880 5984 tablet_service.cc:1467] Processing CreateTablet for tablet f35e622b83d84b3da513ad001e510e10 (DEFAULT_TABLE table=default.Table_2d7b55c1a9bd4f21948bffc6f81d9213 [id=856768ebb9934bfc81df0491fc9458cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.662153 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35e622b83d84b3da513ad001e510e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.662741 8167 raft_consensus.cc:2726] T b257d722a42e44f4ac554b1ebe7d8e31 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.662710 5995 tablet_service.cc:1467] Processing CreateTablet for tablet 57062e910c6b4189af00e3226b5d5554 (DEFAULT_TABLE table=default.Table_d4d5233b49dc4cc7b595c2303f40426d [id=6662deac4c294f50875181fe46ec8d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.663010 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57062e910c6b4189af00e3226b5d5554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.663841 5993 tablet_service.cc:1467] Processing CreateTablet for tablet eb8808681bb14f2c98e0c1547d6f10ac (DEFAULT_TABLE table=default.Table_72f42dac40bb4428988d48eed7c63c2a [id=8837b1c35aff4bf4a9ca7640bc014a28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.664125 5993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8808681bb14f2c98e0c1547d6f10ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.664793 8167 raft_consensus.cc:482] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.664813 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 1431ccf16d424d6b8d3a4024bc73ab5b (DEFAULT_TABLE table=default.Table_111ce6d205c444739a5082270fef23ed [id=b7f1a94c67094be39463eaa537e762de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.664950 8140 raft_consensus.cc:482] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.664950 8167 raft_consensus.cc:504] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.665102 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1431ccf16d424d6b8d3a4024bc73ab5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.665060 8140 raft_consensus.cc:504] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.665809 8140 leader_election.cc:288] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035), 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919)
I20260928 10:44:25.666102 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22cc964ceb741febfd3d1322ae05289" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.666359 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5539f8d8794449c3bf862ec6e058cff4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:25.666632 5817 leader_election.cc:341] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.666777 8167 leader_election.cc:288] T c22cc964ceb741febfd3d1322ae05289 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.670471 5994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861b7d40db7d4c9fa99886cd9228b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.671270 5998 tablet_service.cc:1467] Processing CreateTablet for tablet cbc2d485f8e743e3b54d6e60eecfefa9 (DEFAULT_TABLE table=default.Table_72aaa451c22e47a08a4af3a70faf6d93 [id=e0e49ec742c0416fa195b38c640544d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.671330 6012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6037e24ee6ba4399b6100ab27c4ed621" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.671578 6012 raft_consensus.cc:2379] T 6037e24ee6ba4399b6100ab27c4ed621 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dab87557ec9445dbe35ea05e3561a94 in current term 1: Already voted for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in this term.
I20260928 10:44:25.672197 5988 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd9b7b8a971456b858aad109496b87a (DEFAULT_TABLE table=default.Table_ae94d412a89b44a484fcaa2c3eaf30f0 [id=465c168402cd45b290229880fd8e2b56]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 10:44:25.674949 6091 leader_election.cc:341] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): Not found: Tablet not found: 6037e24ee6ba4399b6100ab27c4ed621
I20260928 10:44:25.675071 6091 leader_election.cc:302] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.675580 8202 raft_consensus.cc:3037] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.677804 5698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 137ef0978ed540f88fddfa70eb9c2ca3
I20260928 10:44:25.678823 6001 tablet_service.cc:1467] Processing CreateTablet for tablet a24448f2727c4693b457658ea4018f6b (DEFAULT_TABLE table=default.Table_b3197981b769443e845cda268a219ac6 [id=792f4fff27694a6b84b4f0ed421dfbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.680200 5694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet 0596f6b57ca24a0e888e559cdcad6b71
I20260928 10:44:25.682730 5988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd9b7b8a971456b858aad109496b87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.682883 5695 master_service.cc:946] ReplaceTablet: received request to replace tablet 173abe58eb7a46acb5d9539d521ca2fa from {username='slave'} at 127.0.0.1:45112
I20260928 10:44:25.682919 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24448f2727c4693b457658ea4018f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.684401 5694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_1259b311e4b9413d81198d426cd38e44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:25.665432 5996 tablet_service.cc:1467] Processing CreateTablet for tablet bed6ef18fa804968bdf96a57baca2a5b (DEFAULT_TABLE table=default.Table_d7765f14238742898bbc21e75798d446 [id=572104292c09444f8f838ddee1cbddbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.685104 5996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed6ef18fa804968bdf96a57baca2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.685662 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.685779 5990 tablet_service.cc:1514] Processing DeleteTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.660547 5987 tablet_service.cc:1467] Processing CreateTablet for tablet a37b3a30b92b4224aa341876745a3c41 (DEFAULT_TABLE table=default.Table_a579299b68764bf0b39b1df631599e07 [id=2ed11fed7cbc4b90be303de44827253a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.686113 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a37b3a30b92b4224aa341876745a3c41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:25.686585 5694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1259b311e4b9413d81198d426cd38e44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.688112 5698 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_f8904f2b3dd14bb8947c8a2bfa375a03" } new_table_name: "default.Table_0b30c073850e41f4a6796066dd9386ef" modify_external_catalogs: true
I20260928 10:44:25.689339 8202 raft_consensus.cc:2726] T 6037e24ee6ba4399b6100ab27c4ed621 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.723575 5849 tablet_service.cc:1467] Processing CreateTablet for tablet 55aadba8c1484e2abe2f467c022ba843 (DEFAULT_TABLE table=default.Table_e19b360bf73a49348f7f6d29241c91a7 [id=67cda41a632c4deeadcccc08e487194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.724036 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55aadba8c1484e2abe2f467c022ba843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.726821 5863 tablet_service.cc:1467] Processing CreateTablet for tablet 45da18d481fb4f83b01703da20c52408 (DEFAULT_TABLE table=default.Table_d02af101f64d46a8ae074ddfb8d45afa [id=54306bea077f4a8280b5ca07ef101143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.727670 5863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45da18d481fb4f83b01703da20c52408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.730856 6270 ts_tablet_manager.cc:1918] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:25.730980 6270 log.cc:1196] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-1/wal/wals/daf7a87b82424e25ae47d3f61c2ddb7f
I20260928 10:44:25.735013 5986 tablet_service.cc:1467] Processing CreateTablet for tablet 55aadba8c1484e2abe2f467c022ba843 (DEFAULT_TABLE table=default.Table_e19b360bf73a49348f7f6d29241c91a7 [id=67cda41a632c4deeadcccc08e487194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.735647 5986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55aadba8c1484e2abe2f467c022ba843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.741065 5991 tablet_service.cc:1467] Processing CreateTablet for tablet 45da18d481fb4f83b01703da20c52408 (DEFAULT_TABLE table=default.Table_d02af101f64d46a8ae074ddfb8d45afa [id=54306bea077f4a8280b5ca07ef101143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.741953 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45da18d481fb4f83b01703da20c52408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.748360 8167 raft_consensus.cc:482] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.748525 8167 raft_consensus.cc:504] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.749121 8167 leader_election.cc:288] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.749563 5999 tablet_service.cc:1467] Processing CreateTablet for tablet b940d261b8f6434c8a7990d0832a755e (DEFAULT_TABLE table=default.Table_a7c31d959b0042e5bd6e5800876e0299 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.749763 6000 tablet_service.cc:1467] Processing CreateTablet for tablet 527cf63ccba94f25acad62a57ee37bca (DEFAULT_TABLE table=default.Table_68dbd6569dfb4a3288c9ef6a5fcdde21 [id=406ba0eb4d384b0bae9e88ce67d292d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.749956 5999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b940d261b8f6434c8a7990d0832a755e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.750907 5859 tablet_service.cc:1467] Processing CreateTablet for tablet 527cf63ccba94f25acad62a57ee37bca (DEFAULT_TABLE table=default.Table_68dbd6569dfb4a3288c9ef6a5fcdde21 [id=406ba0eb4d384b0bae9e88ce67d292d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.751271 5859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527cf63ccba94f25acad62a57ee37bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.753369 6270 ts_tablet_manager.cc:1939] T daf7a87b82424e25ae47d3f61c2ddb7f P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting consensus metadata
I20260928 10:44:25.754145 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1267) took 3781 ms. Trace:
I20260928 10:44:25.754232 6270 rpcz_store.cc:276] 0928 10:44:21.972746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:21.972784 (+ 38us) service_pool.cc:227] Handling call
0928 10:44:25.445777 (+3472993us) ts_tablet_manager.cc:1145] Deleting tablet daf7a87b82424e25ae47d3f61c2ddb7f
0928 10:44:25.445787 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.511401 (+ 65614us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.730746 (+219345us) tablet_metadata.cc:641] Metadata flushed
0928 10:44:25.754121 (+ 23375us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3472845}
I20260928 10:44:25.754740 5687 catalog_manager.cc:4841] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): tablet daf7a87b82424e25ae47d3f61c2ddb7f (table default.Table_22e1516105d24daaa1e7b491ce777916 [id=2ac5e881f6e94b97a08cc5e7da381a41]) successfully deleted
I20260928 10:44:25.754839 5860 tablet_service.cc:1467] Processing CreateTablet for tablet b940d261b8f6434c8a7990d0832a755e (DEFAULT_TABLE table=default.Table_a7c31d959b0042e5bd6e5800876e0299 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.755157 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1273) took 3686 ms. Trace:
I20260928 10:44:25.755208 5860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b940d261b8f6434c8a7990d0832a755e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.755309 6270 rpcz_store.cc:276] 0928 10:44:22.068720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:22.068777 (+ 57us) service_pool.cc:227] Handling call
0928 10:44:25.755023 (+3686246us) ts_tablet_manager.cc:1145] Deleting tablet 4bc65ca1ba01481a9efed520c2ea471c
0928 10:44:25.755035 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.755139 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3640407}
W20260928 10:44:25.755795 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 4bc65ca1ba01481a9efed520c2ea471c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bc65ca1ba01481a9efed520c2ea471c already in progress: creating tablet
I20260928 10:44:25.760187 6120 tablet_service.cc:1467] Processing CreateTablet for tablet 55aadba8c1484e2abe2f467c022ba843 (DEFAULT_TABLE table=default.Table_e19b360bf73a49348f7f6d29241c91a7 [id=67cda41a632c4deeadcccc08e487194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.760732 6121 tablet_service.cc:1514] Processing DeleteTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.760802 6134 tablet_service.cc:1467] Processing CreateTablet for tablet f35e622b83d84b3da513ad001e510e10 (DEFAULT_TABLE table=default.Table_2d7b55c1a9bd4f21948bffc6f81d9213 [id=856768ebb9934bfc81df0491fc9458cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.761572 6118 tablet_service.cc:1467] Processing CreateTablet for tablet b940d261b8f6434c8a7990d0832a755e (DEFAULT_TABLE table=default.Table_a7c31d959b0042e5bd6e5800876e0299 [id=0fee54f9bad24423bcc1ec183414dbae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.761991 6126 tablet_service.cc:1467] Processing CreateTablet for tablet 527cf63ccba94f25acad62a57ee37bca (DEFAULT_TABLE table=default.Table_68dbd6569dfb4a3288c9ef6a5fcdde21 [id=406ba0eb4d384b0bae9e88ce67d292d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.762311 6124 tablet_service.cc:1514] Processing DeleteTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.762740 8202 raft_consensus.cc:482] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.762451 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37a685d70ec44acb9f9ffadec2105307" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.762851 8202 raft_consensus.cc:504] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:25.763728 5817 leader_election.cc:341] T 37a685d70ec44acb9f9ffadec2105307 P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.763935 8202 leader_election.cc:288] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.764199 5866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" is_pre_election: true
I20260928 10:44:25.765797 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 137ef0978ed540f88fddfa70eb9c2ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.766527 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet 1934bc7c1f444eaab610a8cdd1c1e5a4 (table default.Table_02f5489736974455aefc7ae3da68ae7e [id=5b8a74dc9dfd4b2685d2d688454e9670]). Expected version 1 got 0
I20260928 10:44:25.766812 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet ee0b7f3bd78a49368abc13ab9e171880 (table default.Table_e51c54bdc7ea467491d09018c4ea3e3c [id=d365b4d48ea44401ae5c5d9c21f0c5ec]). Expected version 3 got 0
I20260928 10:44:25.766957 6120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55aadba8c1484e2abe2f467c022ba843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.767099 5699 catalog_manager.cc:5587] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661) does not have the latest schema for tablet adb1f2e6392b4329b5520d0e292d6f98 (table default.Table_eda004e06ddd4668bbe3d0d4838c4578 [id=9ec6789f62a0465bb887d37706401908]). Expected version 1 got 0
I20260928 10:44:25.767452 5700 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_ba73fd95dcae409380b26dc24042792d [id=2e6d97f53a504da991be069f05b29717] alter complete (version 3)
I20260928 10:44:25.767997 5696 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: default.Table_62812cefd5b44da7a231a4e62521f052 [id=6677562fe2604addb84af531539cbebd] alter complete (version 5)
I20260928 10:44:25.769048 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f13643dbb64dcf97c4d6d94c22d8b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:25.769376 5696 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.65:39775 (request call id 202) took 1426 ms (client timeout 1000 ms). Trace:
I20260928 10:44:25.769647 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 263b9844bdf6465fa7894ddcf2809f24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.769863 5855 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:25.769454 5696 rpcz_store.cc:269] 0928 10:44:24.342840 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.507733 (+164893us) service_pool.cc:227] Handling call
0928 10:44:25.769358 (+1261625us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.421082 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.427230 (+ 6148us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.427236 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:25.427239 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.427361 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.427373 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.427378 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.427444 (+ 66us) tablet.cc:699] Row locks acquired
0928 10:44:25.427447 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.427483 (+ 36us) write_op.cc:270] Start()
0928 10:44:25.427522 (+ 39us) write_op.cc:276] Timestamp: P: 1790592265427418 usec, L: 0
0928 10:44:25.427526 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.427711 (+ 185us) log.cc:842] Serialized 356 byte log entry
0928 10:44:25.433096 (+ 5385us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.434224 (+ 1128us) write_op.cc:301] APPLY: starting
0928 10:44:25.434232 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.434257 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.434278 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.434311 (+ 33us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.434333 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.434340 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.434406 (+ 66us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.434456 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.434466 (+ 10us) write_op.cc:454] Released schema lock
0928 10:44:25.434471 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.434564 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.434568 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1085,"apply.run_cpu_time_us":395,"apply.run_wall_time_us":394,"num_ops":1,"prepare.queue_time_us":174737,"prepare.run_cpu_time_us":731,"prepare.run_wall_time_us":6741,"raft.queue_time_us":281,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":6,"replication_time_us":5538}]]}
I20260928 10:44:25.769994 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f078ae6d2b498d8c5af90afba887ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:16 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.770155 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 402378e09a1d43ea92f694fe24f9c544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.770298 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 917513e857de49a7a57416eca237f70b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:10 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.770192 5696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_fc1eef458ff04d118873b4715f12bc86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:25.771049 6118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b940d261b8f6434c8a7990d0832a755e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 10:44:25.771248 5700 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.67:50395 (request call id 210) took 1251 ms (client timeout 1000 ms). Trace:
W20260928 10:44:25.771323 5700 rpcz_store.cc:269] 0928 10:44:24.519525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.647483 (+127958us) service_pool.cc:227] Handling call
0928 10:44:24.684689 (+ 37206us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.771231 (+1086542us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.229687 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.229786 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.229794 (+ 8us) write_op.cc:435] Acquired schema lock
0928 10:44:25.229797 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.229923 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.229936 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.229940 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.230017 (+ 77us) tablet.cc:699] Row locks acquired
0928 10:44:25.230020 (+ 3us) write_op.cc:260] PREPARE: finished
0928 10:44:25.230058 (+ 38us) write_op.cc:270] Start()
0928 10:44:25.230100 (+ 42us) write_op.cc:276] Timestamp: P: 1790592265230013 usec, L: 0
0928 10:44:25.230105 (+ 5us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.230285 (+ 180us) log.cc:842] Serialized 356 byte log entry
0928 10:44:25.239190 (+ 8905us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.239983 (+ 793us) write_op.cc:301] APPLY: starting
0928 10:44:25.239993 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.240021 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.240048 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.240089 (+ 41us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.240113 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.240119 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.240169 (+ 50us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.240220 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.240231 (+ 11us) write_op.cc:454] Released schema lock
0928 10:44:25.240237 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.240278 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.240282 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 10:44:25.420357 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.420489 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.420495 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:25.420497 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.420622 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.420634 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.420638 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.420706 (+ 68us) tablet.cc:699] Row locks acquired
0928 10:44:25.420708 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.420745 (+ 37us) write_op.cc:270] Start()
0928 10:44:25.420780 (+ 35us) write_op.cc:276] Timestamp: P: 1790592265420682 usec, L: 0
0928 10:44:25.420783 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.420948 (+ 165us) log.cc:842] Serialized 356 byte log entry
0928 10:44:25.426638 (+ 5690us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.433844 (+ 7206us) write_op.cc:301] APPLY: starting
0928 10:44:25.433855 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.433886 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.433915 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.433957 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.433983 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.433989 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.434041 (+ 52us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.434092 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.434105 (+ 13us) write_op.cc:454] Released schema lock
0928 10:44:25.434110 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.434151 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.434155 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":83613440,"child_traces":[["op",{"apply.queue_time_us":767,"apply.run_cpu_time_us":352,"apply.run_wall_time_us":352,"num_ops":1,"prepare.queue_time_us":540747,"prepare.run_cpu_time_us":695,"prepare.run_wall_time_us":695,"raft.queue_time_us":1183,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":9072}],["op",{"apply.queue_time_us":7177,"apply.run_cpu_time_us":351,"apply.run_wall_time_us":350,"num_ops":1,"prepare.queue_time_us":176860,"prepare.run_cpu_time_us":699,"prepare.run_wall_time_us":698,"raft.queue_time_us":1968,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":5839}]]}
I20260928 10:44:25.772308 5700 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_d41c9694a7154e7181ab9046b25ce5b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.772818 5700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d41c9694a7154e7181ab9046b25ce5b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 10:44:25.774293 5696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc1eef458ff04d118873b4715f12bc86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.775246 6126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527cf63ccba94f25acad62a57ee37bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.776723 5853 tablet_service.cc:1514] Processing DeleteTablet for tablet 0596f6b57ca24a0e888e559cdcad6b71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:25 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.778649 5701 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:45112 (request call id 1599) took 1680 ms. Trace:
I20260928 10:44:25.778789 6275 tablet_bootstrap.cc:492] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94: No bootstrap required, opened a new log
I20260928 10:44:25.778896 6275 ts_tablet_manager.cc:1397] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent bootstrapping tablet: real 0.272s user 0.003s sys 0.000s
I20260928 10:44:25.778730 5701 rpcz_store.cc:276] 0928 10:44:24.098158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.081758 (+983600us) service_pool.cc:227] Handling call
0928 10:44:25.227728 (+145970us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e0600586 00007fa6d78f3de6 00007fa6d78f3b15 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.228107 (+ 379us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0928 10:44:25.228315 (+ 208us) catalog_manager.cc:3616] Apply alter schema
0928 10:44:25.228549 (+ 234us) catalog_manager.cc:3639] Acquired catalog manager lock
0928 10:44:25.228618 (+ 69us) catalog_manager.cc:3786] Updating metadata on disk
0928 10:44:25.434695 (+206077us) catalog_manager.cc:3817] Committing alterations to in-memory state
0928 10:44:25.778631 (+343936us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.233610 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.233702 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.233706 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.233708 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.291056 (+ 57348us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.291071 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.291076 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.291152 (+ 76us) tablet.cc:699] Row locks acquired
0928 10:44:25.291154 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.291202 (+ 48us) write_op.cc:270] Start()
0928 10:44:25.291243 (+ 41us) write_op.cc:276] Timestamp: P: 1790592265291150 usec, L: 0
0928 10:44:25.291246 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.420049 (+128803us) log.cc:842] Serialized 405 byte log entry
0928 10:44:25.420246 (+ 197us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6d8ad6d02 00007fa6d9e097f1 00007fa6d9e08359 00007fa6d9e101bb 00007fa6d9e10038 00000000009edb7c 00007fa6cd60e344 00007fa6cd61191b 00007fa6cd611798 00000000009edb7c
0928 10:44:25.426552 (+ 6306us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.433249 (+ 6697us) write_op.cc:301] APPLY: starting
0928 10:44:25.433273 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.433324 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.433327 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.433414 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.433456 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.433463 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.433562 (+ 99us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.433652 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.433676 (+ 24us) write_op.cc:454] Released schema lock
0928 10:44:25.433685 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.433750 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.433753 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":335069952,"child_traces":[["op",{"apply.queue_time_us":6640,"apply.run_cpu_time_us":565,"apply.run_wall_time_us":564,"num_ops":1,"prepare.queue_time_us":4465,"prepare.run_cpu_time_us":1709,"prepare.run_wall_time_us":186703,"raft.queue_time_us":3062,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":279,"replication_time_us":135275,"spinlock_wait_cycles":295657216}]]}
I20260928 10:44:25.779445 5701 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d4d5233b49dc4cc7b595c2303f40426d" } new_table_name: "default.Table_f4f411daa3ec4d48b6387a304ed72c12" modify_external_catalogs: true
I20260928 10:44:25.779582 6275 raft_consensus.cc:348] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.779778 6275 raft_consensus.cc:374] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 10:44:25.779827 6275 raft_consensus.cc:729] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dab87557ec9445dbe35ea05e3561a94, State: Initialized, Role: FOLLOWER
I20260928 10:44:25.779999 6275 consensus_queue.cc:260] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } }
I20260928 10:44:25.780359 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35e622b83d84b3da513ad001e510e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.780488 6275 ts_tablet_manager.cc:1428] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 10:44:25.780781 6275 tablet_bootstrap.cc:492] T 1c8c53b5ae244cda8dff396935fc8e82 P 4dab87557ec9445dbe35ea05e3561a94: Bootstrap starting.
W20260928 10:44:25.784091 5702 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.100.66:43487 (request call id 180) took 997 ms (client timeout 1000 ms). Trace:
W20260928 10:44:25.784178 5702 rpcz_store.cc:269] 0928 10:44:24.786623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:24.802351 (+ 15728us) service_pool.cc:227] Handling call
0928 10:44:24.850412 (+ 48061us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x615000033024. stack: 00007fa6cd5c866e 00007fa6cd5c8430 00007fa6cc64f5ed 00000000008ea064 00000000008ea02d 00007fa6dbce127d 00007fa6dbce1373 00007fa6d8b03361 00007fa6e047666a 00007fa6e05f8d8f 00007fa6d78ed946 00007fa6d78ed675 00007fa6d41049be 00007fa6d410379e 00007fa6d4109b25 00007fa6d410a54f
0928 10:44:25.784071 (+933659us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.231045 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.231149 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.231153 (+ 4us) write_op.cc:435] Acquired schema lock
0928 10:44:25.231156 (+ 3us) tablet.cc:660] Decoding operations
0928 10:44:25.231226 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.231234 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.231238 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0928 10:44:25.231281 (+ 43us) tablet.cc:699] Row locks acquired
0928 10:44:25.231283 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.231307 (+ 24us) write_op.cc:270] Start()
0928 10:44:25.231331 (+ 24us) write_op.cc:276] Timestamp: P: 1790592265231267 usec, L: 0
0928 10:44:25.231334 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.231458 (+ 124us) log.cc:842] Serialized 530 byte log entry
0928 10:44:25.295534 (+ 64076us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.295886 (+ 352us) write_op.cc:301] APPLY: starting
0928 10:44:25.295906 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.295954 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.295991 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.296054 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.296105 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.296111 (+ 6us) write_op.cc:312] APPLY: finished
0928 10:44:25.296205 (+ 94us) log.cc:842] Serialized 23 byte log entry
0928 10:44:25.296281 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.296301 (+ 20us) write_op.cc:454] Released schema lock
0928 10:44:25.296309 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.296369 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.296373 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"spinlock_wait_cycles":106779520,"child_traces":[["op",{"apply.queue_time_us":301,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":538,"num_ops":1,"prepare.queue_time_us":371123,"prepare.run_cpu_time_us":472,"prepare.run_wall_time_us":471,"replication_time_us":64175}]]}
I20260928 10:44:25.785622 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1051) took 8084 ms. Trace:
I20260928 10:44:25.785705 6269 rpcz_store.cc:276] 0928 10:44:17.700729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.700901 (+ 172us) service_pool.cc:227] Handling call
0928 10:44:25.766450 (+8065549us) ts_tablet_manager.cc:1145] Deleting tablet 969cd0bea65344c787308737da1efd46
0928 10:44:25.766623 (+ 173us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.785602 (+ 18979us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8065032}
W20260928 10:44:25.786103 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 969cd0bea65344c787308737da1efd46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 969cd0bea65344c787308737da1efd46 already in progress: creating tablet
I20260928 10:44:25.788046 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e6a1cfc1f2b409889eb91ff2b8b0c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788245 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet b257d722a42e44f4ac554b1ebe7d8e31 with delete_type TABLET_DATA_DELETED (replaced by tablet c2f0c7eabf66422c82d7201ea72514e3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788395 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a685d70ec44acb9f9ffadec2105307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:05 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788532 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet c00ec4cec42a48388360e8723283829b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788659 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c056c078c95461b82c1ca1f31d90752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:02 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788619 5697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_4a3535dfbded45f2a388a68c746c18de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 10:44:25.788776 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet 9012fa19e01f43238c895a84c6dc9815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:17 UTC) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.788887 5857 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a3a0fb7a0ca4c3c905bdf32f0ecaae4 with delete_type TABLET_DATA_DELETED (replaced by tablet a3b0ec0cf3bc4a09b0aaa15d18873f70) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.789001 5854 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d03d764256a4a8d9d8bb17b82fe8bda with delete_type TABLET_DATA_DELETED (replaced by tablet 8b167fd6cdbd4b829d962ebafeee0272) from {username='slave'} at 127.0.0.1:34882
W20260928 10:44:25.789161 5697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a3535dfbded45f2a388a68c746c18de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.789299 6269 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34882 (request call id 1065) took 7889 ms. Trace:
I20260928 10:44:25.789985 5702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45112:
name: "default.Table_77696bbb1e9b47678e23095ce1493bd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 10:44:25.790405 5702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77696bbb1e9b47678e23095ce1493bd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 10:44:25.792593 5856 tablet_service.cc:1467] Processing CreateTablet for tablet b28b055198124251bd497d4f1cb65739 (DEFAULT_TABLE table=default.Table_cb9859645bc648b08f6c8885488dc7d7 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.793044 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28b055198124251bd497d4f1cb65739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.797043 5853 tablet_service.cc:1467] Processing CreateTablet for tablet 2f26bfa078c24157b61c8d0cafc28cfa (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.797518 5853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f26bfa078c24157b61c8d0cafc28cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.805271 8191 raft_consensus.cc:482] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.805451 8191 raft_consensus.cc:504] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.806236 8191 leader_election.cc:288] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.790709 6269 rpcz_store.cc:276] 0928 10:44:17.900152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:17.900203 (+ 51us) service_pool.cc:227] Handling call
0928 10:44:25.789188 (+7888985us) ts_tablet_manager.cc:1145] Deleting tablet 2c3a6c8d0bf1402dbac60afd9298f4e6
0928 10:44:25.789199 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.789285 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7888822}
W20260928 10:44:25.811822 5688 catalog_manager.cc:4821] TS ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035): delete failed for tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c3a6c8d0bf1402dbac60afd9298f4e6 already in progress: creating tablet
I20260928 10:44:25.811950 6275 tablet_bootstrap.cc:654] T 1c8c53b5ae244cda8dff396935fc8e82 P 4dab87557ec9445dbe35ea05e3561a94: Neither blocks nor log segments found. Creating new log.
I20260928 10:44:25.813653 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 75539c390965493eaa69a0d1215fa922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:07 UTC) from {username='slave'} at 127.0.0.1:45886
W20260928 10:44:25.813938 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 137ef0978ed540f88fddfa70eb9c2ca3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137ef0978ed540f88fddfa70eb9c2ca3 already in progress: creating tablet
I20260928 10:44:25.814064 8120 tablet_replica.cc:330] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: stopping tablet replica
I20260928 10:44:25.814299 8120 raft_consensus.cc:2229] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.814460 8120 raft_consensus.cc:2258] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 10:44:25.814364 5686 catalog_manager.cc:4821] TS 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): delete failed for tablet 0596f6b57ca24a0e888e559cdcad6b71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0596f6b57ca24a0e888e559cdcad6b71 already in progress: creating tablet
I20260928 10:44:25.815057 6269 tablet_replica.cc:330] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: stopping tablet replica
I20260928 10:44:25.815469 6269 raft_consensus.cc:2229] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 10:44:25.818027 8120 ts_tablet_manager.cc:1905] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.811007 6143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ebfc156361479c909ff263c3be4601" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.824359 6127 tablet_service.cc:1467] Processing CreateTablet for tablet b28b055198124251bd497d4f1cb65739 (DEFAULT_TABLE table=default.Table_cb9859645bc648b08f6c8885488dc7d7 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.825896 6129 tablet_service.cc:1467] Processing CreateTablet for tablet 2f26bfa078c24157b61c8d0cafc28cfa (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.826752 6118 tablet_service.cc:1514] Processing DeleteTablet for tablet a908ac5d44a74c05b35f6853ab769d91 with delete_type TABLET_DATA_DELETED (replaced by tablet c00ec4cec42a48388360e8723283829b) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.828254 6120 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2990e37a9648669eb39a865392c9e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.829975 5693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ef695111ecc46a1bc1439b0b1a282bf: Sending DeleteTablet for 3 replicas of tablet e40f3de645114c2382cdfff53c22ce3c
I20260928 10:44:25.830464 5693 catalog_manager.cc:6565] ReplaceTablet: tablet e40f3de645114c2382cdfff53c22ce3c deleted and replaced by tablet 96f59a46c262485dadbc0857e866ceb3
I20260928 10:44:25.830696 5693 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:45112 (request call id 1606) took 1541 ms. Trace:
I20260928 10:44:25.830768 5693 rpcz_store.cc:276] 0928 10:44:24.289018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:25.462827 (+1173809us) service_pool.cc:227] Handling call
0928 10:44:25.830672 (+367845us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 10:44:25.761060 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 10:44:25.761162 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0928 10:44:25.761168 (+ 6us) write_op.cc:435] Acquired schema lock
0928 10:44:25.761170 (+ 2us) tablet.cc:660] Decoding operations
0928 10:44:25.761290 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0928 10:44:25.761303 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0928 10:44:25.761308 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0928 10:44:25.761384 (+ 76us) tablet.cc:699] Row locks acquired
0928 10:44:25.761386 (+ 2us) write_op.cc:260] PREPARE: finished
0928 10:44:25.761428 (+ 42us) write_op.cc:270] Start()
0928 10:44:25.761465 (+ 37us) write_op.cc:276] Timestamp: P: 1790592265761381 usec, L: 0
0928 10:44:25.761469 (+ 4us) op_driver.cc:331] REPLICATION: starting
0928 10:44:25.761682 (+ 213us) log.cc:842] Serialized 625 byte log entry
0928 10:44:25.816837 (+ 55155us) op_driver.cc:444] REPLICATION: finished
0928 10:44:25.817105 (+ 268us) write_op.cc:301] APPLY: starting
0928 10:44:25.817124 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0928 10:44:25.817176 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0928 10:44:25.817208 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0928 10:44:25.817341 (+ 133us) tablet.cc:1381] finished ApplyRowOperation cycle
0928 10:44:25.817415 (+ 74us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 10:44:25.817422 (+ 7us) write_op.cc:312] APPLY: finished
0928 10:44:25.817570 (+ 148us) log.cc:842] Serialized 29 byte log entry
0928 10:44:25.817642 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.817665 (+ 23us) write_op.cc:454] Released schema lock
0928 10:44:25.817674 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0928 10:44:25.817748 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0928 10:44:25.817752 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":180,"apply.run_cpu_time_us":700,"apply.run_wall_time_us":699,"num_ops":2,"prepare.queue_time_us":203263,"prepare.run_cpu_time_us":745,"prepare.run_wall_time_us":1107,"raft.queue_time_us":2289,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":230,"replication_time_us":55332}]]}
I20260928 10:44:25.835498 6127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28b055198124251bd497d4f1cb65739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.837957 5693 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_d0ca9a65dc4a4795a42c3f368a1f1816" } new_table_name: "default.Table_1641e36d70d142609bde0970a38fe7d2" modify_external_catalogs: true
I20260928 10:44:25.838400 6129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f26bfa078c24157b61c8d0cafc28cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.839582 5694 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45112:
table { table_name: "default.Table_499f33aa4f674f90aa166f95140d0219" } new_table_name: "default.Table_c38af94069114deb85a3afbf4bf33819" modify_external_catalogs: true
I20260928 10:44:25.841576 8120 ts_tablet_manager.cc:1918] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 10:44:25.841709 8120 log.cc:1196] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Deleting WAL directory at /tmp/dist-test-taskDDK3xd/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790592230757645-5521-0/minicluster-data/ts-2/wal/wals/75539c390965493eaa69a0d1215fa922
I20260928 10:44:25.841992 8120 ts_tablet_manager.cc:1939] T 75539c390965493eaa69a0d1215fa922 P 4dab87557ec9445dbe35ea05e3561a94: Deleting consensus metadata
I20260928 10:44:25.844120 7934 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.844266 7934 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
W20260928 10:44:25.844828 8229 log.cc:924] Time spent T 383eb18f1c0c46209ff5b47e468b9950 P 2f6ffbf4f0534383bf89d15aa37e3027: Append to log took a long time: real 0.137s user 0.000s sys 0.000s
I20260928 10:44:25.846417 6141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87dd8e89c394e4f96c9d8c5fed17e66" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.847456 6126 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d71edffecf044ba9cec14a70683a56f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:00 UTC) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.848127 6150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
I20260928 10:44:25.848343 6150 raft_consensus.cc:2454] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 1.
W20260928 10:44:25.848716 5955 leader_election.cc:341] T a87dd8e89c394e4f96c9d8c5fed17e66 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.849617 5955 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:25.850737 6151 raft_consensus.cc:3037] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.851969 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe0dd05136840ee91d0b2a415ad49fc with delete_type TABLET_DATA_DELETED (replaced by tablet 0cab5ed3a4bc4d88a0f3ec63f1409406) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.852936 6134 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f3de645114c2382cdfff53c22ce3c with delete_type TABLET_DATA_DELETED (replaced by tablet 96f59a46c262485dadbc0857e866ceb3) from {username='slave'} at 127.0.0.1:45886
I20260928 10:44:25.853871 6021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0b7f3bd78a49368abc13ab9e171880" candidate_uuid: "4dab87557ec9445dbe35ea05e3561a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" is_pre_election: true
I20260928 10:44:25.844827 7934 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
I20260928 10:44:25.855089 6270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46336 (request call id 1276) took 3630 ms. Trace:
I20260928 10:44:25.855193 6270 rpcz_store.cc:276] 0928 10:44:22.224505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 10:44:22.224566 (+ 61us) service_pool.cc:227] Handling call
0928 10:44:25.756118 (+3531552us) ts_tablet_manager.cc:1145] Deleting tablet 0de0ff28393d479dadb5e2f3e415d1fa
0928 10:44:25.756129 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 10:44:25.855072 (+ 98943us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3489530}
I20260928 10:44:25.855499 6270 tablet_replica.cc:330] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: stopping tablet replica
I20260928 10:44:25.855697 6270 raft_consensus.cc:2229] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 LEADER]: Raft consensus shutting down.
I20260928 10:44:25.856138 6270 raft_consensus.cc:2258] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.857331 6270 ts_tablet_manager.cc:1905] T f5a00b74133a406996820adcb71194df P 2f6ffbf4f0534383bf89d15aa37e3027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.861892 6000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 527cf63ccba94f25acad62a57ee37bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.863509 6152 raft_consensus.cc:3037] T 45a8098440fb4e919bc5e3f4dd3241a7 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.863662 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cdff9f01974354a81179dd9bd5a26e with delete_type TABLET_DATA_DELETED (replaced by tablet e49c5428f8674548a309e5cf58c82049) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.864607 6138 raft_consensus.cc:3037] T 30fb3f88e66b4f8582fb348e035af290 P 4dab87557ec9445dbe35ea05e3561a94 [term 0 FOLLOWER]: Advancing to term 1
I20260928 10:44:25.849977 7937 raft_consensus.cc:2781] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 10:44:25.869097 7937 raft_consensus.cc:482] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 10:44:25.869194 7937 raft_consensus.cc:3037] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 1 FOLLOWER]: Advancing to term 2
I20260928 10:44:25.870543 6001 tablet_service.cc:1467] Processing CreateTablet for tablet 2f26bfa078c24157b61c8d0cafc28cfa (DEFAULT_TABLE table=default.Table_72ab1b3d84434465bd1df4388c822a90 [id=7e3d67e5c30c4be982a6c6b52d313867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.871348 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f26bfa078c24157b61c8d0cafc28cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.871376 6090 leader_election.cc:302] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dab87557ec9445dbe35ea05e3561a94; no voters: 2f6ffbf4f0534383bf89d15aa37e3027, ab770e77cb704ea38b5ca8cff97dc73b
I20260928 10:44:25.871796 8140 raft_consensus.cc:2726] T ee0b7f3bd78a49368abc13ab9e171880 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 10:44:25.872287 7937 raft_consensus.cc:504] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.872794 7937 leader_election.cc:288] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 election: Requested vote from peers 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661), ab770e77cb704ea38b5ca8cff97dc73b (127.5.100.65:40035)
W20260928 10:44:25.873420 5687 catalog_manager.cc:4821] TS 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919): delete failed for tablet 0de0ff28393d479dadb5e2f3e415d1fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0de0ff28393d479dadb5e2f3e415d1fa already in progress: creating tablet
I20260928 10:44:25.873775 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1934bc7c1f444eaab610a8cdd1c1e5a4" candidate_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94"
I20260928 10:44:25.873935 6151 raft_consensus.cc:3037] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 1 FOLLOWER]: Advancing to term 2
I20260928 10:44:25.876366 6151 raft_consensus.cc:2454] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 4dab87557ec9445dbe35ea05e3561a94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6ffbf4f0534383bf89d15aa37e3027 in term 2.
I20260928 10:44:25.876765 5955 leader_election.cc:302] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6ffbf4f0534383bf89d15aa37e3027, 4dab87557ec9445dbe35ea05e3561a94; no voters:
I20260928 10:44:25.877025 7937 raft_consensus.cc:2781] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 10:44:25.877140 7937 raft_consensus.cc:686] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [term 2 LEADER]: Becoming Leader. State: Replica: 2f6ffbf4f0534383bf89d15aa37e3027, State: Running, Role: LEADER
I20260928 10:44:25.877226 5995 tablet_service.cc:1467] Processing CreateTablet for tablet b28b055198124251bd497d4f1cb65739 (DEFAULT_TABLE table=default.Table_cb9859645bc648b08f6c8885488dc7d7 [id=15fd82a3299c40e08b1774b9554704db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 10:44:25.877352 7937 consensus_queue.cc:237] T 1934bc7c1f444eaab610a8cdd1c1e5a4 P 2f6ffbf4f0534383bf89d15aa37e3027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.877703 5995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28b055198124251bd497d4f1cb65739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 10:44:25.878968 5993 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f3de645114c2382cdfff53c22ce3c with delete_type TABLET_DATA_DELETED (replaced by tablet 96f59a46c262485dadbc0857e866ceb3) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.880365 5996 tablet_service.cc:1514] Processing DeleteTablet for tablet 32560e881a1d4444a706bb8b60dda499 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:04 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.880609 5994 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c6ed97f74540b786ed3a6378dea0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 10:44:03 UTC) from {username='slave'} at 127.0.0.1:46336
I20260928 10:44:25.831178 5863 tablet_service.cc:1514] Processing DeleteTablet for tablet e40f3de645114c2382cdfff53c22ce3c with delete_type TABLET_DATA_DELETED (replaced by tablet 96f59a46c262485dadbc0857e866ceb3) from {username='slave'} at 127.0.0.1:34882
I20260928 10:44:25.853401 8167 raft_consensus.cc:482] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 10:44:25.882658 8167 raft_consensus.cc:504] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67" port: 43661 } } peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } }
I20260928 10:44:25.883417 8167 leader_election.cc:288] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f6ffbf4f0534383bf89d15aa37e3027 (127.5.100.66:32919), 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661)
I20260928 10:44:25.883754 6269 raft_consensus.cc:2258] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 10:44:25.884335 6269 ts_tablet_manager.cc:1905] T 6520ab6acc2142a2a3b8e1f0dabedc7a P ab770e77cb704ea38b5ca8cff97dc73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 10:44:25.884589 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c683445c12e43cc9379bf465f7e252c" candidate_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dab87557ec9445dbe35ea05e3561a94" is_pre_election: true
W20260928 10:44:25.886082 5817 leader_election.cc:341] T 2c683445c12e43cc9379bf465f7e252c P ab770e77cb704ea38b5ca8cff97dc73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dab87557ec9445dbe35ea05e3561a94 (127.5.100.67:43661): Illegal state: must be running to vote when last-logged opid is not known
I20260928 10:44:25.888458 6273 tablet_bootstrap.cc:492] T 7c07d2f6a5c1402c9768b84177f52fc2 P ab770e77cb704ea38b5ca8cff97dc73b: No bootstrap required, opened a new log
I20260928 10:44:25.888589 6273 ts_tablet_manager.cc:1397] T 7c07d2f6a5c1402c9768b84177f52fc2 P ab770e77cb704ea38b5ca8cff97dc73b: Time spent bootstrapping tablet: real 0.344s user 0.011s sys 0.014s
I20260928 10:44:25.889276 6273 raft_consensus.cc:348] T 7c07d2f6a5c1402c9768b84177f52fc2 P ab770e77cb704ea38b5ca8cff97dc73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab770e77cb704ea38b5ca8cff97dc73b" member_type: VOTER last_known_addr { host: "127.5.100.65" port: 40035 } } peers { permanent_uuid: "2f6ffbf4f0534383bf89d15aa37e3027" member_type: VOTER last_known_addr { host: "127.5.100.66" port: 32919 } } peers { permanent_uuid: "4dab87557ec9445dbe35ea05e3561a94" member_type: VOTER last_known_addr { host: "127.5.100.67"